FirebirdSql.Data.Common.IscException: Error writing data to the connection

[Mrt John]

Hi.I've migrated one web app from .NET Core 3.1 to. NET 6, Fb Core provider from v7.5.0 to 9.0.1

new app works but sometimes doesn't start  on first run and got in console: Failed to load resource: the server responded with a status of 500 (Internal Server Error)

After I reload it, works fine a while.

I've installed Seriog on production server and got that log:

...

FirebirdSql.Data.FirebirdClient.FbException (0x80004005): Error writing data to the connection.

Error reading data from the connection.

 ---> FirebirdSql.Data.Common.IscException: Error writing data to the connection.

Error reading data from the connection.

 ---> System.IO.IOException: Missing 4 bytes to fill total 4.

   at FirebirdSql.Data.Client.Managed.XdrReaderWriter.ReadBytesAsync(Byte[] buffer, Int32 count, CancellationToken cancellationToken)

   at FirebirdSql.Data.Client.Managed.XdrReaderWriter.ReadInt32Async(CancellationToken cancellationToken)

   at FirebirdSql.Data.Client.Managed.XdrReaderWriter.ReadOperationAsync(CancellationToken cancellationToken)

   at FirebirdSql.Data.Client.Managed.AuthBlock.ProcessContAuthResponseAsync(CancellationToken cancellationToken)

   at FirebirdSql.Data.Client.Managed.GdsConnection.IdentifyAsync(String database, CancellationToken cancellationToken)

   --- End of inner exception stack trace ---

   at FirebirdSql.Data.Client.Managed.GdsConnection.IdentifyAsync(String database, CancellationToken cancellationToken)

   at FirebirdSql.Data.Client.ClientFactory.CreateManagedDatabaseAsync(ConnectionString options, CancellationToken cancellationToken)

   at FirebirdSql.Data.Client.ClientFactory.CreateManagedDatabaseAsync(ConnectionString options, CancellationToken cancellationToken)

   at FirebirdSql.Data.FirebirdClient.FbConnectionInternal.ConnectAsync(CancellationToken cancellationToken)

   at FirebirdSql.Data.FirebirdClient.FbConnectionInternal.ConnectAsync(CancellationToken cancellationToken)

   at FirebirdSql.Data.FirebirdClient.FbConnection.OpenAsync(CancellationToken cancellationToken)

 db connection settings:

  ob.UseFirebird("database=" + userSettings.Host + ":" + userSettings.Path + userSettings.DbName + ".fdb" +

             ";port=" + userSettings.Port +

             ";user=sysdba" +

             ";password=******" +

             ";Pooling=true" +

             ";Role=" +

             ";Dialect=3" +

             ";Charset=NONE" +

             ";ServerType=0" +

             ";Connection lifetime=15" +

             ";Packet Size=8192" +

             ";MinPoolSize=0" +

             ";MaxPoolSize=50" +

             ";WireCrypt=Enabled"

            );

found there a suggestion to disable connection pooling,

older app(NET 3.1+Fb core provider v7.5.0 ) works without any problem

is that a bug in my new app or I must disable connection pooling?

thanks

[Gerdus van Zyl]

This error happens when the firebird server crashes or some network interruption.

Connection pooling usually makes this worse since it keeps old connections that are no longer valid/working around after firebird crash and you only find out when you try to use the connection.

You should handle the exception, clear the connection pool using  FbConnection.ClearAllPools  and retry the connection.

It is strange if it happens only when starting the app, maybe if firebird is also started at the same time, your app may be trying to connect before firebird is ready.

--
You received this message because you are subscribed to the Google Groups "firebird-net-provider" group.
To unsubscribe from this group and stop receiving emails from it, send an email to firebird-net-pro...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/firebird-net-provider/CAK92MR_wqXWFnFMM%2Bq0FVCmzs87PC8%3DWviXfZY8OTq8pnuOi%3DA%40mail.gmail.com.

[Mrt John]

Thanks for your answer,Fb version is 3.0.5,installed on a Windows Vps up 24/7,firebird is always started,there are other desktop app connected by vpn with  no problem

 reverting to .NET 3.1 all work fine.I had this problem since .NET 5,where I rolled back to 3.1

thanks

To view this discussion on the web visit https://groups.google.com/d/msgid/firebird-net-provider/CALvycTmsBbRdG_xpjiq%2BcCWLy53KOoLgK9U5YCkjJpqsfutRjA%40mail.gmail.com.

[Mrt John]

@Gerdus: are you suggesting disabling pooling?

On Tue, May 31, 2022 at 5:28 PM Gerdus van Zyl <gerdus...@gmail.com> wrote:

To view this discussion on the web visit https://groups.google.com/d/msgid/firebird-net-provider/CALvycTmsBbRdG_xpjiq%2BcCWLy53KOoLgK9U5YCkjJpqsfutRjA%40mail.gmail.com.

[Jiří Činčura]

> older app(NET 3.1+Fb core provider v7.5.0 ) works without any problem

I would try to bisect the problem by changing only one variable. Either runtime first or provider (or vice versa).

> is that a bug in my new app or I must disable connection pooling?

Disabling connection pooling at this exact instance will not do anything. The exception happens when the connection is being opened for the first time (aka the connection is not from pool).

The exception was thrown simply because there wasn't enough data to read and that violates the protocol. Why is that happening is unclear so far.

--
Mgr. Jiří Činčura
https://www.tabsoverspaces.com/

[Mrt John]

>I would try to bisect the problem by changing only one variable. Either runtime first or provider (or vice versa).

I think if I change the provider to v9 I have to change the runtime(v9 is compatible with .NET 6 only) or vice versa

thanks

--
You received this message because you are subscribed to the Google Groups "firebird-net-provider" group.
To unsubscribe from this group and stop receiving emails from it, send an email to firebird-net-pro...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/firebird-net-provider/30a3abce-722e-4f64-84d2-b2a94517dc7c%40www.fastmail.com.

[Jiří Činčura]

> I think if I change the provider to v9 I have to change the runtime(v9
> is compatible with .NET 6 only) or vice versa

Nope. You can use it on .NET Core 3.1 as well. You can check all the (transitively) supported versions here https://www.nuget.org/packages/FirebirdSql.Data.FirebirdClient in the Frameworks tab.

[Mrt John]

tried,but got this:    Error NU1202 Package FirebirdSql.EntityFrameworkCore.Firebird 9.0.1 is not compatible with netcoreapp3.1 (.NETCoreApp,Version=v3.1). Package FirebirdSql.EntityFrameworkCore.Firebird 9.0.1 supports: net6.0 (.NETCoreApp,Version=v6.0)

>Nope. You can use it on .NET Core 3.1 as well. You can check all the (transitively) supported versions here https://www.nuget.org/packages/FirebirdSql.Data.FirebirdClient in the Frameworks tab.

--
You received this message because you are subscribed to the Google Groups "firebird-net-provider" group.
To unsubscribe from this group and stop receiving emails from it, send an email to firebird-net-pro...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/firebird-net-provider/07f00c11-4dff-40be-8c44-8441b0bfc9d0%40www.fastmail.com.

[Jiří Činčura]

Yes, but that's EF Core.

[Mrt John]

tried some suggestions found for that problem(update fb engine,increase connection lifetime,disabling pooling),but no fix.

no error found in firebird.log

is there any debugging I can do on my production server?

--
You received this message because you are subscribed to the Google Groups "firebird-net-provider" group.
To unsubscribe from this group and stop receiving emails from it, send an email to firebird-net-pro...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/firebird-net-provider/c3427bbf-a27b-4b15-8bad-335d40b99660%40www.fastmail.com.

[Jiří Činčura]

> is there any debugging I can do on my production server?

Nothing specific from top of my head. Regular debugging, aka looking for a needle in a haystack.

[Thomas Kragh]

Hey John? 

I am experiencing the same problem, in order to find some common denominator could you please send a version of your firebird.config. 

Especially the value of UserManager is interesting, as I use both Legacy_Manager and Srp on our server, perhaps this problem is with the Legacy Manager. 

[Mrt John]

Hi

sure:  https://drive.google.com/file/d/1RQevStFhDkO0C75jI1jJKxqHplpFNkZ1/view?usp=sharing

glad I'm not the only one with this problem,occurs very often making not possible to upgrade to .Net 6

thanks

--
You received this message because you are subscribed to the Google Groups "firebird-net-provider" group.
To unsubscribe from this group and stop receiving emails from it, send an email to firebird-net-pro...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/firebird-net-provider/d770ad90-aaac-4ada-bf7e-392200041513n%40googlegroups.com.

[Thomas Kragh]

Hey

So there is nothing interesting in your firebird.config since you only use Srp. Another user also had the same problem:  https://github.com/FirebirdSQL/NETProvider/issues/1021

I tried creating a load test in my codebase and also using the test suite from the firebird provider, but was unable to reproduce the error. Can you create a sample application that reproduces the problem, and share the code? 

[Mrt John]

I'll try to create a sample but I'm afraid that problem occurs only on production machine

To view this discussion on the web visit https://groups.google.com/d/msgid/firebird-net-provider/75722d94-9e46-4e7c-ba61-72bcb812b156n%40googlegroups.com.

[Mrt John]

Hi

I've create  sample app:     https://drive.google.com/file/d/1hBPfW4dBc5VZknM3yHaLp7_yTCOvObAg/view?usp=sharing

in VS 2022  Angular+NET6 new project

+Serilog

I've created one FB 3 database with one table,TEST.FDB password for db is in MydbContextcs.cs (connection string)

I've created a new action in the controller

    [ApiController]

    public class WeatherForecastController : ControllerBase

......................

        [HttpGet]

        [Route("api/[controller]")]

        public async Task<IActionResult> GetApi()

        {

            F_PAR? res = await db.F_PAR.FirstOrDefaultAsync(p => p.NR_ORD == 1);

            if (res == null)

            {

                return BadRequest();

            }

            else {

                return Ok(res);

            }

        }

I've put it on my vps(windows 2016 server,FB 3.0.9 superserver)  and done some requests from Postman:  http://myserver.com:83/api/weatherforecast

after 10 requests got the error "FirebirdSql.Data.Common.IscException: Error writing data to the connection."

in link above there is file webapi-20220608.log from Serilog 

thanks

To view this discussion on the web visit https://groups.google.com/d/msgid/firebird-net-provider/75722d94-9e46-4e7c-ba61-72bcb812b156n%40googlegroups.com.

[Thomas Kragh]

Hey

I was unfortunately unable to reproduce the exceptions that you get. I tried against a firebird server on my laptop(3.0.5) and a a development server (3.0.10 (snapshot build)), i even replaced the firebird config on my laptop with the one that you provided. 

I used two test patterns, one where connection lifetime was both smaller and larger that the time between requests, so that pooling and new connections was tested - about 3000 requests was made, but with no luck in reproducing the error. 

On the other hand, i was able to reproduce the problem on the codebase that i work on, over the last 4 days the error has occourd 7 times. The failing code, is a timer that is fired every minute to fetch changes from a table based on some timestamps, so in a day this will happen 1440 times, making this quite rare compared to your 1 in 10 requests. 

Thomas 

[Mrt John]

@Thomas: hard to find a clue.for me only occurs on web server,not on dev machine.I'll stay on .working NET 3.1  :(

To view this discussion on the web visit https://groups.google.com/d/msgid/firebird-net-provider/29a894e0-fd3d-4e94-89a3-521cdf069af9n%40googlegroups.com.

[RDS Chauhan]

Some inputs.

I have a deployed application which i continue to upgrade where in the database keeps changing. So to deploy new version, i need to transfer data to the new database, where in table columns would have been added / removed; constraints changed, fields renamed etc.

Migration of data is a long process. During migration i also started to hit upon the same error, while transfering data using DataTable of ADO.NET.

I now copied the data from external database through calling a strored procedure in ADO.NET 

( https://firebirdsql.org/refdocs/langrefupd25-psql-execstat.html#langrefupd25-psql-execstat-on-external  ) 

Now the error reported was very clear saying that a NOT NULL field is being assigned a NULL value.

So here it might be a case of upgraded stringent data validity checks, but error message not being clearly reported.

Please let me know if more details are required to be put here in my case.

.NET Framework 4.8.1

FirebirdSql.Data.FirebirdClient 9.0.2

connectionString=

       "User=SYSDBA; Password=masterkey;

        Database=D:\MtDataBase.FDB; DataSource=MyPC; Port=3050; Dialect=3; Charset=NONE;
        Role=Administrator; Compression=True; Connection Timeout=30; Connection lifetime=60;
        Pooling=true; MinPoolSize=0;MaxPoolSize=50; Packet Size=8192;ServerType=0;"

SELECT rdb$get_context ('SYSTEM', 'ENGINE_VERSION') from RDB$DATABASE;
3.0.9

Win 10

Regards,

Rajiv

[Jiří Činčura]

Can you create reproducible scenario? If so, send it.

--
Mgr. Jiří Činčura
https://www.tabsoverspaces.com/

>>>>>>> To view this discussion on the web visit https://groups.google.com/d/msgid/firebird-net-provider/d770ad90-aaac-4ada-bf7e-392200041513n%40googlegroups.com <https://groups.google.com/d/msgid/firebird-net-provider/d770ad90-aaac-4ada-bf7e-392200041513n%40googlegroups.com?utm_medium=email&utm_source=footer>.

>>>>>
>>>>> --
>>>>> You received this message because you are subscribed to the Google Groups "firebird-net-provider" group.
>>>>> To unsubscribe from this group and stop receiving emails from it, send an email to firebird-net-pro...@googlegroups.com.

>>>>> To view this discussion on the web visit https://groups.google.com/d/msgid/firebird-net-provider/75722d94-9e46-4e7c-ba61-72bcb812b156n%40googlegroups.com <https://groups.google.com/d/msgid/firebird-net-provider/75722d94-9e46-4e7c-ba61-72bcb812b156n%40googlegroups.com?utm_medium=email&utm_source=footer>.

>>>
>>> --
>>> You received this message because you are subscribed to the Google Groups "firebird-net-provider" group.
>>> To unsubscribe from this group and stop receiving emails from it, send an email to firebird-net-pro...@googlegroups.com.

>>> To view this discussion on the web visit https://groups.google.com/d/msgid/firebird-net-provider/29a894e0-fd3d-4e94-89a3-521cdf069af9n%40googlegroups.com <https://groups.google.com/d/msgid/firebird-net-provider/29a894e0-fd3d-4e94-89a3-521cdf069af9n%40googlegroups.com?utm_medium=email&utm_source=footer>.

>
> --
> You received this message because you are subscribed to the Google
> Groups "firebird-net-provider" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to firebird-net-pro...@googlegroups.com.
> To view this discussion on the web visit

> https://groups.google.com/d/msgid/firebird-net-provider/e8aac324-82f3-477a-b7fa-f8fdee34148fn%40googlegroups.com
> <https://groups.google.com/d/msgid/firebird-net-provider/e8aac324-82f3-477a-b7fa-f8fdee34148fn%40googlegroups.com?utm_medium=email&utm_source=footer>.

[Thomas Kragh]

Hey Rajiv

I hope you succeed in reproducing this error, however i wont put my money on null values being the problem, because all the times i have received the error have been during select. 

In this github issue, it has been suggested that its a race condition https://github.com/FirebirdSQL/NETProvider/issues/1021 when multiple connections are created from multiple threads. 

Does your migration job use multiple threads for moving the data? 

[LtColRDSChauhan]

On Mon, 22 Aug 2022, 1:21 am Thomas Kragh, <famili...@gmail.com> wrote:

Hey Rajiv

I hope you succeed in reproducing this error, however i wont put my money on null values being the problem, because all the times i have received the error have been during select. 

I agree. 

Couple of years ago, i too received vague errors on simple select, which I did report here.

In this github issue, it has been suggested that its a race condition https://github.com/FirebirdSQL/NETProvider/issues/1021 when multiple connections are created from multiple threads. 

Does your migration job use multiple threads for moving the data? 

Yes.

You received this message because you are subscribed to a topic in the Google Groups "firebird-net-provider" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/firebird-net-provider/HGRC-OzEb8Q/unsubscribe.
To unsubscribe from this group and all its topics, send an email to firebird-net-pro...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/firebird-net-provider/9213d0c0-59fb-4131-973b-62a60e739f98n%40googlegroups.com.