Consumer RxEndofFile Exception

34 views

Skip to first unread message

Shivananda Sahu

unread,

Jul 17, 2023, 1:26:55 PM7/17/23

to Pika

Using django-dramatiq to publish and process messages from RabbitMQ.

We are seeing the errors:

Unexpected connection close detected: StreamLostError: ("Stream connection lost: RxEndOfFile(-1, 'End of input stream (EOF)')",)
connection_lost: StreamLostError: ("Stream connection lost: RxEndOfFile(-1, 'End of input stream (EOF)')",)
pika.adapters.utils.io_services_utils._AsyncTransportBase.RxEndOfFile: [Errno -1] End of input stream (EOF)
raise self.RxEndOfFile()
File "/usr/local/lib/python3.10/site-packages/pika/adapters/utils/io_services_utils.py", line 797, in _consume
super(_AsyncSSLTransport, self)._consume()
File "/usr/local/lib/python3.10/site-packages/pika/adapters/utils/io_services_utils.py", line 1235, in _consume
return func(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/pika/diagnostic_utils.py", line 53, in log_exception_func_wrap
Traceback (most recent call last):
pika.adapters.utils.io_services_utils._AsyncTransportBase.RxEndOfFile: [Errno -1] End of input stream (EOF)
raise self.RxEndOfFile()

Python version: python 3.10
Pika version: 1.3.1
RabbitMQ version: 3.8.11
Operating system used for your Python application as well as RabbitMQ
- Python: Linux debian - bookworm
- RabbitMQ: Hosted AWS
IMPORTANT: RabbitMQ log messages around the time of these exceptions
- 2023-07-15 12:22:16.668 [error] <0.5149.1534> Supervisor {<0.5149.1534>,rabbit_connection_helper_sup} had child heartbeat_sender started with rabbit_heartbeat:start_heartbeat_sender({sslsocket,{gen_tcp,#Port<0.7704585>,tls_connection,[{option_tracker,<0.1532.0>},{session_tickets_tracker,...},...]},...}, 60, #Fun<rabbit_reader.4.96323348>, {heartbeat_sender,<<"10.0.16.37:47096 -> 172.18.0.5:5671">>}) at <0.2307.1534> exit with reason noproc in context shutdown_error
  2023-07-15 15:04:44.618 [warning] <0.267.0> rabbit_sysmon_handler busy_dist_port <0.1334.0> [{name,delegate_management_4},{initial_call,{delegate,init,1}},{gen_server2,process_next_msg,1},{message_queue_len,0}] {#Port<0.764>,unknown}
  2023-07-15 22:35:41.612 [warning] <0.267.0> rabbit_sysmon_handler busy_dist_port <0.1334.0> [{name,delegate_management_4},{initial_call,{delegate,init,1}},{gen_server2,process_next_msg,1},{message_queue_len,0}] {#Port<0.764>,unknown}

Shivananda Sahu

unread,

Jul 17, 2023, 1:36:43 PM7/17/23

to Pika

I attempted to search the list for similar errors - but could not find a relevant thread. Attempting to debug why none of our worker nodes processed any messages from rabbitmq.