dotnet nuget locals -Clear all
# or
nuget locals all -Clear
# or
nuget locals all -Clear
Keep forgetting these lines, so sticking them here for future reference.
Fix up created nuspec file afterwards.
This will pack and push to both the public NuGet feed and to SymbolSource.