Version 5.4 causes an exception trying to load Microsoft.Azure.Services.AppAuthentication

[arex388]

Please clearly describe what the SQL Sink is doing incorrectly:

As the title says, the latest version (5.4) causes an exception because its trying to load Microsoft.Azure.Services.AppAuthentication which doesn't exist. I don't use any Azure services and have never referenced any in my solution. Weirdly, it works fine when debugging locally, but as soon as its published to my server (IIS 10 on Windows Server 2019 on AWS EC2) the exception is thrown and I'm greeted with an ANCM 500.30 error. I've had to revert to 5.3 to avoid the exception on the server.

Here's the exception trace for details:

Unhandled exception. System.IO.FileNotFoundException: Could not load file or assembly 'Microsoft.Azure.Services.AppAuthentication, Version=1.4.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35'. The system cannot find the file specified.

File name: 'Microsoft.Azure.Services.AppAuthentication, Version=1.4.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35'

   at Serilog.Sinks.MSSqlServer.Sinks.MSSqlServer.Platform.AzureManagedServiceAuthenticator..ctor(Boolean useAzureManagedIdentity, String azureServiceTokenProviderResource)

   at Serilog.Sinks.MSSqlServer.Sinks.MSSqlServer.Dependencies.SinkDependenciesFactory.Create(String connectionString, SinkOptions sinkOptions, IFormatProvider formatProvider, ColumnOptions columnOptions, ITextFormatter logEventFormatter)

   at Serilog.Sinks.MSSqlServer.MSSqlServerSink..ctor(String connectionString, SinkOptions sinkOptions, IFormatProvider formatProvider, ColumnOptions columnOptions, ITextFormatter logEventFormatter)

   at Serilog.Sinks.MSSqlServer.Configuration.Factories.MSSqlServerSinkFactory.Create(String connectionString, SinkOptions sinkOptions, IFormatProvider formatProvider, ColumnOptions columnOptions, ITextFormatter logEventFormatter)

   at Serilog.LoggerConfigurationMSSqlServerExtensions.MSSqlServerInternal(LoggerSinkConfiguration loggerConfiguration, String connectionString, SinkOptions sinkOptions, IConfigurationSection sinkOptionsSection, IConfiguration appConfiguration, LogEventLevel restrictedToMinimumLevel, IFormatProvider formatProvider, ColumnOptions columnOptions, IConfigurationSection columnOptionsSection, ITextFormatter logEventFormatter, IApplySystemConfiguration applySystemConfiguration, IApplyMicrosoftExtensionsConfiguration applyMicrosoftExtensionsConfiguration, IMSSqlServerSinkFactory sinkFactory)

   at Serilog.LoggerConfigurationMSSqlServerExtensions.MSSqlServer(LoggerSinkConfiguration loggerConfiguration, String connectionString, SinkOptions sinkOptions, IConfigurationSection sinkOptionsSection, IConfiguration appConfiguration, LogEventLevel restrictedToMinimumLevel, IFormatProvider formatProvider, ColumnOptions columnOptions, IConfigurationSection columnOptionsSection, ITextFormatter logEventFormatter)

   at Serilog.LoggerConfigurationMSSqlServerExtensions.MSSqlServer(LoggerSinkConfiguration loggerConfiguration, String connectionString, String tableName, IConfiguration appConfiguration, LogEventLevel restrictedToMinimumLevel, Int32 batchPostingLimit, Nullable`1 period, IFormatProvider formatProvider, Boolean autoCreateSqlTable, ColumnOptions columnOptions, IConfigurationSection columnOptionsSection, String schemaName, ITextFormatter logEventFormatter)

   at Serilog.SerilogExtensions.ApplicationSqlServer(LoggerSinkConfiguration configuration, String connectionString) in REDACTED\Extensions\SerilogExtensions.cs:line 52

   at Serilog.LoggerConfigurationExtensions.Update(LoggerConfiguration logger, HostBuilderContext builder) in REDACTED\Extensions\LoggerConfigurationExtensions.cs:line 24

   at REDACTED.Program.<>c.<Main>b__0_1(HostBuilderContext builder, LoggerConfiguration logger) in REDACTED\Program.cs:line 16

   at Serilog.SerilogHostBuilderExtensions.<>c__DisplayClass1_0.<UseSerilog>b__0(HostBuilderContext context, IServiceCollection collection)

   at Microsoft.Extensions.Hosting.HostBuilder.CreateServiceProvider()

   at Microsoft.Extensions.Hosting.HostBuilder.Build()

   at REDACTED.Program.Main(String[] args) in REDACTED\Program.cs:line 10

   at REDACTED.Program.<Main>(String[] args)

Please clearly describe the expected behavior:

Not throwing an exception for Microsoft.Azure.Services.AppAuthentication. It seems to be looking for regardless if its used or not.

List the names and versions of all Serilog packages used in the project:

• Serilog: 2.9.0
• Serilog.AspNetCore: 3.2.0
• Serilog.Sinks.MSSqlServer: 5.3.0

Target framework and operating system:

• .NET Core 3.1
• Windows Server 2019

Provide a simple reproduction of your Serilog configuration code:

N/A

Provide a simple reproduction of your Serilog configuration file, if any:

N/A

Provide a simple reproduction of your application code:

N/A

[darrenschwarz]

Please clearly describe what the SQL Sink is doing incorrectly:

As the title says, the latest version (5.4) causes an exception because its trying to load Microsoft.Azure.Services.AppAuthentication which doesn't exist. I don't use any Azure services and have never referenced any in my solution. Weirdly, it works fine when debugging locally, but as soon as its published to my server (IIS 10 on Windows Server 2019 on AWS EC2) the exception is thrown and I'm greeted with an ANCM 500.30 error. I've had to revert to 5.3 to avoid the exception on the server.

Here's the exception trace for details:

Unhandled exception. System.IO.FileNotFoundException: Could not load file or assembly 'Microsoft.Azure.Services.AppAuthentication, Version=1.4.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35'. The system cannot find the file specified.

File name: 'Microsoft.Azure.Services.AppAuthentication, Version=1.4.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35'

   at Serilog.Sinks.MSSqlServer.Sinks.MSSqlServer.Platform.AzureManagedServiceAuthenticator..ctor(Boolean useAzureManagedIdentity, String azureServiceTokenProviderResource)

   at Serilog.Sinks.MSSqlServer.Sinks.MSSqlServer.Dependencies.SinkDependenciesFactory.Create(String connectionString, SinkOptions sinkOptions, IFormatProvider formatProvider, ColumnOptions columnOptions, ITextFormatter logEventFormatter)

   at Serilog.Sinks.MSSqlServer.MSSqlServerSink..ctor(String connectionString, SinkOptions sinkOptions, IFormatProvider formatProvider, ColumnOptions columnOptions, ITextFormatter logEventFormatter)

   at Serilog.Sinks.MSSqlServer.Configuration.Factories.MSSqlServerSinkFactory.Create(String connectionString, SinkOptions sinkOptions, IFormatProvider formatProvider, ColumnOptions columnOptions, ITextFormatter logEventFormatter)

   at Serilog.LoggerConfigurationMSSqlServerExtensions.MSSqlServerInternal(LoggerSinkConfiguration loggerConfiguration, String connectionString, SinkOptions sinkOptions, IConfigurationSection sinkOptionsSection, IConfiguration appConfiguration, LogEventLevel restrictedToMinimumLevel, IFormatProvider formatProvider, ColumnOptions columnOptions, IConfigurationSection columnOptionsSection, ITextFormatter logEventFormatter, IApplySystemConfiguration applySystemConfiguration, IApplyMicrosoftExtensionsConfiguration applyMicrosoftExtensionsConfiguration, IMSSqlServerSinkFactory sinkFactory)

   at Serilog.LoggerConfigurationMSSqlServerExtensions.MSSqlServer(LoggerSinkConfiguration loggerConfiguration, String connectionString, SinkOptions sinkOptions, IConfigurationSection sinkOptionsSection, IConfiguration appConfiguration, LogEventLevel restrictedToMinimumLevel, IFormatProvider formatProvider, ColumnOptions columnOptions, IConfigurationSection columnOptionsSection, ITextFormatter logEventFormatter)

   at Serilog.LoggerConfigurationMSSqlServerExtensions.MSSqlServer(LoggerSinkConfiguration loggerConfiguration, String connectionString, String tableName, IConfiguration appConfiguration, LogEventLevel restrictedToMinimumLevel, Int32 batchPostingLimit, Nullable`1 period, IFormatProvider formatProvider, Boolean autoCreateSqlTable, ColumnOptions columnOptions, IConfigurationSection columnOptionsSection, String schemaName, ITextFormatter logEventFormatter)

   at Serilog.SerilogExtensions.ApplicationSqlServer(LoggerSinkConfiguration configuration, String connectionString) in REDACTED\Extensions\SerilogExtensions.cs:line 52

   at Serilog.LoggerConfigurationExtensions.Update(LoggerConfiguration logger, HostBuilderContext builder) in REDACTED\Extensions\LoggerConfigurationExtensions.cs:line 24

   at REDACTED.Program.<>c.<Main>b__0_1(HostBuilderContext builder, LoggerConfiguration logger) in REDACTED\Program.cs:line 16

   at Serilog.SerilogHostBuilderExtensions.<>c__DisplayClass1_0.<UseSerilog>b__0(HostBuilderContext context, IServiceCollection collection)

   at Microsoft.Extensions.Hosting.HostBuilder.CreateServiceProvider()

   at Microsoft.Extensions.Hosting.HostBuilder.Build()

   at REDACTED.Program.Main(String[] args) in REDACTED\Program.cs:line 10

   at REDACTED.Program.<Main>(String[] args)

Please clearly describe the expected behavior:

Not throwing an exception for Microsoft.Azure.Services.AppAuthentication. It seems to be looking for regardless if its used or not.

List the names and versions of all Serilog packages used in the project:

• Serilog: 2.9.0
• Serilog.AspNetCore: 3.2.0
• Serilog.Sinks.MSSqlServer: 5.3.0

Target framework and operating system:

• .NET Core 3.1
• Windows Server 2019

Provide a simple reproduction of your Serilog configuration code:

N/A

Provide a simple reproduction of your Serilog configuration file, if any:

N/A

Provide a simple reproduction of your application code:

N/A

Hi @arex388, Would you be able to provide a working (or not as the case may be) sample application which reliably reproduces the problem in AWS, I'd then be more than happy to take a look and try to resolve for you. No Charge! :)

[ckadluba]

Hi @arex388! Thank you for informing us about the issue.

Can you please give us the list of files in the output folder after you called dotnet publish on your app? Can you please also check if all those files were deployed to the target machine without errors?

[ronaldbarendse]

Looks like the dependency on Microsoft.Azure.Services.AppAuthentication is only added for the netcoreapp2.2 and net472 targets:

https://github.com/serilog/serilog-sinks-mssqlserver/blob/5dabed522d02860466fa726c19038b6a17c70856/src/Serilog.Sinks.MSSqlServer/Serilog.Sinks.MSSqlServer.csproj#L77-L87

IMO Serilog.Sinks.MSSqlServer shouldn't have an Azure specific dependency, but only provide a way to set this up (using interfaces, like PR #265 seems to achive). So if you'd require Managed Service Identities (PR #222), you'd need to install this dependency yourself or this should be bundled in a new package (e.g. Serilog.Sinks.MSSqlServer.AzureMsi).

[ckadluba]

Looks like the dependency on Microsoft.Azure.Services.AppAuthentication is only added for the netcoreapp2.2 and net472 targets:

These conditions do specify minimum versions. The Azure Manages Identities features also works when using the sink in a program targeting .NET Core 3.1. I tested this and documented the result in PR 222:

#222 (comment)

The conditional dependency is necessary because the referenced assembly is not supported on all frameworks the sink targets. On the frameworks where it is not supported, the dependency is not used and the implementation is swapped with a stub that does nothing except throwing an exception when enabling the feature by configuration.

[ckadluba]

But probably we can change the code to call the ctor of AzureManagedServiceAuthenticator only if Azure Managed Identities is enabled.

I will take a look into it.

[darrenschwarz]

But probably we can change the code to call the ctor of AzureManagedServiceAuthenticator only if Azure Managed Identities is enabled.

I will take a look into it.

Hi @ckadluba could we have a catch up?Can provide the temp email again if needed.

[ckadluba]

Hi @ckadluba could we have a catch up?Can provide the temp email again if needed.

I sent you my contact now. :)

[ckadluba]

But probably we can change the code to call the ctor of AzureManagedServiceAuthenticator only if Azure Managed Identities is enabled.

I will take a look into it.

I thought about this. I think Microsoft.Azure.Services.AppAuthentication is a dependency like any other and should not require any special treatment in the sink. The assembly should be deployed with the consumer app along with all other nuget packages.

@arex388 have you had yet an opportunity to check the publish artifacts and the deployment of your app? Is the assembly missing there?

[arex388]

@ckadluba I haven’t had a chance to yet. I’ve been stuck doing post-release bug fixes on the project where I discovered the issue. Once things begin to settle down with it I’ll take a look, but it most likely will be at least a week or two before that happens. Hopefully...

[FletcherJohnsonZ]

Hi folks - I have this same problem. What I have found:
I remove the MSQL Sink and then the Azure library (I don't use Azure either). I comment out the references. Everything works. And there are NO Azure libraries.

I add the MSQL Sink back to my application (which adds the 1.4 version of the Azure library) via NuGet. Rebuild the solution. Then I reenable the commented out code that builds the Sink. When I run, I get an exception. It appears that there is an accidental reference to both the 1.5 and 1.4 version of the Azure library.

Why would the Sink install the 1.4 version of the Azure library when it needs the 1.5? I still get errors if I install the 1.5 version of the Azure library.

Here is the exception (note the 1.5 reference):
Could not load file or assembly 'Microsoft.Azure.Services.AppAuthentication, Version=1.5.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35' or one of its dependencies. The located assembly's manifest definition does not match the assembly reference. (Exception from HRESULT: 0x80131040)

And here is the Inner Exception (note the 1.4 reference):
InnerException {"Could not load file or assembly 'Microsoft.Azure.Services.AppAuthentication, Version=1.4.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35' or one of its dependencies. The located assembly's manifest definition does not match the assembly reference. (Exception from HRESULT: 0x80131040)":"Microsoft.Azure.Services.AppAuthentication, Version=1.4.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35"} System.Exception {System.IO.FileLoadException}

If I try to install the 1.5 version of the Azure library via NuGet, I get the following error:TF400024: The change on xxx\packages\Microsoft.Azure.Services.AppAuthentication.1.5.0\Microsoft.Azure.Services.AppAuthentication.1.5.0.nupkg cannot be undone because a file already exists at xxx\packages\Microsoft.Azure.Services.AppAuthentication.1.5.0\Microsoft.Azure.Services.AppAuthentication.1.5.0.nupkg. The file must be deleted from disk for the undo to succeed.

I have tried everything. The only thing that seems to work is going with an older version of the MSQ sink that doesn't want the Azure library.

[FletcherJohnsonZ]

One more thing. It appears to be related to the addition of SinkOptions in 5.4. If I go back to v. 5.3 I am able to run.

[ckadluba]

@FletcherJohnsonZ thank you for the investigation and for sharing your findings. Do you have a sample project to reproduce the problem that you could provide me?

Some points about your observations:

• The .NET Framework 4.7+ and .NET Core 2.2+ builds of Serilog.Sinks.MSSqlServer.dll reference Microsoft.Azure.Services.AppAuthentication 1.4.0. There should be no references to version 1.5.0 of that assembly. Here is the relevant snippet from the csproj file.

<ItemGroup Condition=" '$(TargetFramework)' == 'netcoreapp2.2' Or '$(TargetFramework)' == 'net472' ">
<PackageReference Include="System.Configuration.ConfigurationManager" Version="4.5.0" />
<PackageReference Include="Microsoft.Data.SqlClient" Version="1.1.3" />
<PackageReference Include="Microsoft.Azure.Services.AppAuthentication" Version="1.4.0" />

• In version 5.4.0 of the sink we added support for Azure manages identities and that was also the PR that introduced the nuget reference to Microsoft.Azure.Services.AppAuthentication 1.4.0. The problem has nothing to do with the introduction of the SinkOptions class (which was also added in 5.4.0).

[FletcherJohnsonZ]

Be cautious! Message sent from external source. Christian, Unfortunately, I can’t share the project – this is for an internal project. But I can share the pertinent code. The following works fine with MSSqlServer v 5.3. If I upgrade to 5.4 or 5.5, when this code tries to execute, it gets the errors I posted. I am not sure if it’s the instantiation of the sinkOptions or not. What I know is the Azure library that installs automatically with 5.5 (and 5.4, I believe) is where the issue appears to be. So it might be that your code uses one version, but the dependency install of the Azure library is installing the other. All I know is that the exception references one version of the Azure library and the inner exception references the other. To recreate – uninstall the SQL sink and azure library. Then just install the current sink, letting it install the azure library. Then run the code below, but changed to use the currently commented out sinkOptions and use that to set the table name. Then run. If you don’t get an error, I can try to get more details. But I already spent a lot of time trying to get things to work and I may have to wait until after the current release ships. Note: Values in angle brackets were replaced (but then, you knew that….) try { if (LogToSql && logcfg != null && !string.IsNullOrWhiteSpace(AppValues.DbLogConnection)) { var logTable = "<tableName>"; // Create the sink and set values // The following is used for V5.4+, but not 5.3 // var sinkOptions = new Serilog.Sinks.MSSqlServer.Sinks.MSSqlServer.Options.SinkOptions(); // set the sinkOptions table // Create the column options var columnOptionVals = new ColumnOptions { AdditionalColumns = new System.Collections.ObjectModel.Collection<SqlColumn>() }; // Add columns we want to use columnOptionVals.AdditionalColumns.Add(new SqlColumn("UserId", System.Data.SqlDbType.NVarChar, true, 50)); columnOptionVals.AdditionalColumns.Add(new SqlColumn("Version", System.Data.SqlDbType.NVarChar, true, 15)); // I don't think we need to save the template, since we can // see the specific values in the Properties column columnOptionVals.Store.Remove(StandardColumn.MessageTemplate); columnOptionVals.LogEvent.DataLength = 2048; columnOptionVals.PrimaryKey = columnOptionVals.TimeStamp; columnOptionVals.TimeStamp.NonClusteredIndex = true; // This was using sinkOptions, but that’s not available in 5.3 logcfg.MinimumLevel.Information() .WriteTo.MSSqlServer(AppValues.DbLogConnection, tableName: logTable, restrictedToMinimumLevel: LogEventLevel.Information, columnOptions: columnOptionVals); } } catch (Exception ex) { <Handle error> } Fletcher Johnson [cid:image001.png@01D647C1.68B682A0] 510-474-9051 – Work 408-781-2345 – Cell Fletcher.Johnson@zoetis.com From: Christian Kadluba <notifications@github.com> Sent: Saturday, June 20, 2020 1:22 PM To: serilog/serilog-sinks-mssqlserver <serilog-sinks-mssqlserver@noreply.github.com> Cc: Johnson, Fletcher <fletcher.johnson@zoetis.com>; Mention <mention@noreply.github.com> Subject: [EXTERNAL] Re: [serilog/serilog-sinks-mssqlserver] Version 5.4 causes an exception trying to load Microsoft.Azure.Services.AppAuthentication (#283) Be cautious! Message sent from external source. @FletcherJohnsonZ<https://github.com/FletcherJohnsonZ> thank you for the investigation and for sharing your findings. Do you have a sample project to reproduce the problem that you could provide me? Some points about your observations: * The .NET Framework 4.7+ and .NET Core 2.2+ builds of Serilog.Sinks.MSSqlServer.dll reference Microsoft.Azure.Services.AppAuthentication 1.4.0. There should be no references to version 1.5.0 of that assembly. Here is the relevant snippet from the csproj file. <ItemGroup Condition=" '$(TargetFramework)' == 'netcoreapp2.2' Or '$(TargetFramework)' == 'net472' "> <PackageReference Include="System.Configuration.ConfigurationManager" Version="4.5.0" /> <PackageReference Include="Microsoft.Data.SqlClient" Version="1.1.3" /> <PackageReference Include="Microsoft.Azure.Services.AppAuthentication" Version="1.4.0" /> * In version 5.4.0 of the sink we added support for Azure manages identities and that was also the PR that introduced the nuget reference to Microsoft.Azure.Services.AppAuthentication 1.4.0. The problem has nothing to do with the introduction of the SinkOptions class (which was also added in 5.4.0). — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub<#283 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/ANEMI6K36E2AKXCJDCZKWALRXUK7VANCNFSM4M4S4ULQ>.

[ckadluba]

@FletcherJohnsonZ thanks for the sample. I'll try to reproduce the problem but I'm afk for the next two weeks, so I can probably do it only after the 7th of july.

What target framework does your project use?