How Do I Get A Bug In Multiprocessing Fixed?

[Michael Boom]

The below issue is pretty serious and it is preventing me from using a system I wrote on a larger scale. How do I get this bug fixed? Thanks.
https://bugs.python.org/issue43329

[Alexander Neilson]

Hi Michael

It may be helpful to populate the ticket with further details:
* actual output from when you execute the server and client (possibly with
extra verbosity enabled)
* system you are running this on (windows, macos, linux) flavour / version
details
* minor version of Python interpreter used
* whether you are using a packaged version from your os distributor or from
python.org (or even built your own)
* If you believe it's a regression the version it is working on

Some more guidance can be found here covering some of the above
https://docs.python.org/3/bugs.html

I am very interested to note that a report filed in February hasn't had at
least one person take a brief look at it and post a note or set a status
like "needs more info" etc.

Also I am by no means an expert in multi processing at all as so far my
webapps work worker processes, I am wondering if the wrong approach to this
may be happening and so the client is trying to reuse the same pipe and it
may need a different tear down / process to release that and create a new
pipe / socket / underlying connection cleanly rather than the re connect in
the same object.

For example I am running python 3.7.7 on windows:

Manager Output:
>python manager.py
In test_method

>python manager.py


Client Output:
result: '<class 'str'>, TEST'
Kill and restart the server and press return

Got exception <class 'ConnectionResetError'>, ConnectionResetError(10054,
'An existing connection was forcibly closed by the remote host', None,
10054, None)
Reconnecting
Got exception <class 'ConnectionResetError'>, ConnectionResetError(10054,
'An existing connection was forcibly closed by the remote host', None,
10054, None)
Reconnecting
Got exception <class 'ConnectionResetError'>, ConnectionResetError(10054,
'An existing connection was forcibly closed by the remote host', None,
10054, None)
Reconnecting
Got exception <class 'ConnectionResetError'>, ConnectionResetError(10054,
'An existing connection was forcibly closed by the remote host', None,
10054, None)
Reconnecting
Got exception <class 'ConnectionResetError'>, ConnectionResetError(10054,
'An existing connection was forcibly closed by the remote host', None,
10054, None)
Reconnecting
Got exception <class 'ConnectionResetError'>, ConnectionResetError(10054,
'An existing connection was forcibly closed by the remote host', None,
10054, None)
Reconnecting
Got exception <class 'ConnectionResetError'>, ConnectionResetError(10054,
'An existing connection was forcibly closed by the remote host', None,
10054, None)
Reconnecting
Got exception <class 'ConnectionResetError'>, ConnectionResetError(10054,
'An existing connection was forcibly closed by the remote host', None,
10054, None)
Reconnecting
Got exception <class 'ConnectionResetError'>, ConnectionResetError(10054,
'An existing connection was forcibly closed by the remote host', None,
10054, None)
Reconnecting
Got exception <class 'ConnectionResetError'>, ConnectionResetError(10054,
'An existing connection was forcibly closed by the remote host', None,
10054, None)
Reconnecting
Got exception <class 'ConnectionResetError'>, ConnectionResetError(10054,
'An existing connection was forcibly closed by the remote host', None,
10054, None)
Reconnecting
Got exception <class 'ConnectionResetError'>, ConnectionResetError(10054,
'An existing connection was forcibly closed by the remote host', None,
10054, None)
Reconnecting # At this point I terminated the manager
Got exception <class 'ConnectionRefusedError'>,
ConnectionRefusedError(10061, 'No connection could be made because the
target machine actively refused it', None, 10061, None)
Reconnecting
Traceback (most recent call last):
File
"C:\Users\Alexander\AppData\Local\Programs\Python\Python37\lib\multiprocessing\connection.py",
line 619, in SocketClient
s.connect(address)
ConnectionRefusedError: [WinError 10061] No connection could be made
because the target machine actively refused it

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "client.py", line 27, in <module>
manager.connect()
File
"C:\Users\Alexander\AppData\Local\Programs\Python\Python37\lib\multiprocessing\managers.py",
line 532, in connect
conn = Client(self._address, authkey=self._authkey)
File
"C:\Users\Alexander\AppData\Local\Programs\Python\Python37\lib\multiprocessing\connection.py",
line 492, in Client
c = SocketClient(address)
File
"C:\Users\Alexander\AppData\Local\Programs\Python\Python37\lib\multiprocessing\connection.py",
line 619, in SocketClient
s.connect(address)
KeyboardInterrupt




Regards
Alexander

Alexander Neilson
Neilson Productions Limited

alex...@neilson.net.nz
021 329 681
022 456 2326

> --
> https://mail.python.org/mailman/listinfo/python-list
>

[Barry]

Also you report requires any developer to write a program from you notes to reproduce the problem.

Attach a program that shows the problem would help.

Better yet diagnose the problem after you reproduce it with a fix in a PR.

Barry

> On 18 Jun 2021, at 06:07, Alexander Neilson <alex...@neilson.net.nz> wrote:
>
> Hi Michael

> --
> https://mail.python.org/mailman/listinfo/python-list
>

[Oscar Benjamin]

On Fri, 18 Jun 2021 at 15:27, Michael Boom <boom...@hotmail.com> wrote:

> The below issue is pretty serious and it is preventing me from using a
> system I wrote on a larger scale. How do I get this bug fixed? Thanks.
> https://bugs.python.org/issue43329

On Fri, 18 Jun 2021 at 06:07, Alexander Neilson <alex...@neilson.net.nz>
wrote:

>

> I am very interested to note that a report filed in February hasn't had at
> least one person take a brief look at it and post a note or set a status
> like "needs more info" etc.
>

Personally I don't find that surprising. I just looked at the issue very
quickly and I couldn't immediately tell if the problem was a bug in
multiprocessing or a mistake in the code shown. Just figuring that out
would take more than the very little time I was prepared to spend looking
at it so I moved on. If the OP hopes that someone else will use their
limited time to fix this issue for them then they should do what they can
to make it as quick as possible for that other person. The first part of
that is making clear why it should be considered a bug in the first place.
Don't expect the reader to spend time deciphering your code to figure that
out.

If there is a bug in multiprocessing then the issue should be clearer about
what it is or why it should be considered a bug. Which function is
documented as doing something that apparently does not work in this case?
Why should it be expected to work?

--
Oscar

[Terry Reedy]

On 6/17/2021 5:02 PM, Michael Boom wrote:
> The below issue is pretty serious and it is preventing me from using a system I wrote on a larger scale. How do I get this bug fixed? Thanks.
> https://bugs.python.org/issue43329

Reduce your code to the minimum needed to exhibit the problem. Then run
it with 3.9.5 and 3.10.0b3. 3.8 only gets security fixes. To get
attention, demonstrate that there is a problem with current versions.


--
Terry Jan Reedy