COMMENT:CONNECTION 11, TCP FD 31. In uv_close() callback. May 1 16:03:39 mobius pexd[15007]: MPOLL: IDX 11 FD 31 HANDLE 0x15984f0 - CLOSE POLLING: Backend FD 16 May 1 16:03:39 mobius pexd[15007]: LOOP 0xc27800: Watch 0x7f7218000910 NWatch 62 Nfds 24 *FD: USER (nil) BACKEND (nil) May 1 16:03:39 mobius pexd[15007]: @FD[0] (nil), @FD[1] (nil), @FD[2] (nil), @FD[3] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[4] (nil), @FD[5] (nil), @FD[6] (nil), @FD[7] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[8] (nil), @FD[9] (nil), @FD[10] (nil), @FD[11] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[12] (nil), @FD[13] (nil), @FD[14] (nil), @FD[15] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[16] (nil), @FD[17] 0xc27a30, @FD[18] (nil), @FD[19] 0xc279c8, May 1 16:03:39 mobius pexd[15007]: @FD[20] 0x159b258, @FD[21] 0x159aa58, @FD[22] 0x1599e58, @FD[23] 0x159a758, May 1 16:03:39 mobius pexd[15007]: @FD[24] 0x159a458, @FD[25] 0x159a558, @FD[26] 0x159a158, @FD[27] 0x1599958, May 1 16:03:39 mobius pexd[15007]: @FD[28] 0x159a858, @FD[29] 0x1599058, @FD[30] (nil), @FD[31] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[32] 0x159a658, @FD[33] 0x1599a58, @FD[34] 0x1598f58, @FD[35] 0x1599b58, May 1 16:03:39 mobius pexd[15007]: @FD[36] 0x159a058, @FD[37] 0x1598858, @FD[38] 0x1598c58, @FD[39] 0x1598a58, May 1 16:03:39 mobius pexd[15007]: @FD[40] 0x1599258, @FD[41] 0x1599358, @FD[42] 0x1599158, @FD[43] 0x159b158, May 1 16:03:39 mobius pexd[15007]: @FD[44] (nil), @FD[45] (nil), @FD[46] (nil), @FD[47] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[48] (nil), @FD[49] (nil), @FD[50] (nil), @FD[51] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[52] (nil), @FD[53] (nil), @FD[54] (nil), @FD[55] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[56] (nil), @FD[57] (nil), @FD[58] (nil), @FD[59] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[60] (nil), @FD[61] (nil), May 1 16:03:39 mobius pexd[15007]: HANDLE: NULL COMMENT: Protocol_Task() receive T_DISMANTLE_RSP from IO_Task() and sends a T_CONN_DISMANTLE_REQ to the main() task, (All action on connection 11.) May 1 16:03:39 mobius pexd[15007]: PROTO_TASK: RX EVENT 62345 - CONN[11] State 15 Class 2 Type 36 May 1 16:03:39 mobius pexd[15007]: PROTO_TASK: RX EVENT CONN[11] Release State 1 Class 2 Type 36 May 1 16:03:39 mobius pexd[15007]: MAIN_TASK(Proxy): CONN[11] Type 35 May 1 16:03:39 mobius pexd[15007]: PROTO_TASK: RX EVENT 62346 - CONN[11] State 15 Class 2 Type 36 May 1 16:03:39 mobius pexd[15007]: IO_TASK(Proxy): RX EVENT - CONN[10] Type 32 May 1 16:03:39 mobius pexd[15007]: MPOLL: IDX 10 FD 30 HANDLE (nil) - PRE-INIT POLLING: Backend FD 16 May 1 16:03:39 mobius pexd[15007]: LOOP 0xc27800: Watch 0x7f7218000910 NWatch 62 Nfds 24 *FD: USER (nil) BACKEND (nil) May 1 16:03:39 mobius pexd[15007]: @FD[0] (nil), @FD[1] (nil), @FD[2] (nil), @FD[3] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[4] (nil), @FD[5] (nil), @FD[6] (nil), @FD[7] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[8] (nil), @FD[9] (nil), @FD[10] (nil), @FD[11] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[12] (nil), @FD[13] (nil), @FD[14] (nil), @FD[15] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[16] (nil), @FD[17] 0xc27a30, @FD[18] (nil), @FD[19] 0xc279c8, May 1 16:03:39 mobius pexd[15007]: @FD[20] 0x159b258, @FD[21] 0x159aa58, @FD[22] 0x1599e58, @FD[23] 0x159a758, May 1 16:03:39 mobius pexd[15007]: @FD[24] 0x159a458, @FD[25] 0x159a558, @FD[26] 0x159a158, @FD[27] 0x1599958, May 1 16:03:39 mobius pexd[15007]: @FD[28] 0x159a858, @FD[29] 0x1599058, @FD[30] (nil), @FD[31] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[32] 0x159a658, @FD[33] 0x1599a58, @FD[34] 0x1598f58, @FD[35] 0x1599b58, May 1 16:03:39 mobius pexd[15007]: @FD[36] 0x159a058, @FD[37] 0x1598858, @FD[38] 0x1598c58, @FD[39] 0x1598a58, May 1 16:03:39 mobius pexd[15007]: @FD[40] 0x1599258, @FD[41] 0x1599358, @FD[42] 0x1599158, @FD[43] 0x159b158, May 1 16:03:39 mobius pexd[15007]: @FD[44] (nil), @FD[45] (nil), @FD[46] (nil), @FD[47] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[48] (nil), @FD[49] (nil), @FD[50] (nil), @FD[51] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[52] (nil), @FD[53] (nil), @FD[54] (nil), @FD[55] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[56] (nil), @FD[57] (nil), @FD[58] (nil), @FD[59] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[60] (nil), @FD[61] (nil), May 1 16:03:39 mobius pexd[15007]: HANDLE: NULL May 1 16:03:39 mobius pexd[15007]: MPOLL: IDX 10 FD 30 HANDLE (nil) - POST-INIT POLLING: Backend FD 16 May 1 16:03:39 mobius pexd[15007]: LOOP 0xc27800: Watch 0x7f7218000910 NWatch 62 Nfds 24 *FD: USER (nil) BACKEND (nil) May 1 16:03:39 mobius pexd[15007]: @FD[0] (nil), @FD[1] (nil), @FD[2] (nil), @FD[3] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[4] (nil), @FD[5] (nil), @FD[6] (nil), @FD[7] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[8] (nil), @FD[9] (nil), @FD[10] (nil), @FD[11] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[12] (nil), @FD[13] (nil), @FD[14] (nil), @FD[15] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[16] (nil), @FD[17] 0xc27a30, @FD[18] (nil), @FD[19] 0xc279c8, May 1 16:03:39 mobius pexd[15007]: @FD[20] 0x159b258, @FD[21] 0x159aa58, @FD[22] 0x1599e58, @FD[23] 0x159a758, May 1 16:03:39 mobius pexd[15007]: @FD[24] 0x159a458, @FD[25] 0x159a558, @FD[26] 0x159a158, @FD[27] 0x1599958, May 1 16:03:39 mobius pexd[15007]: @FD[28] 0x159a858, @FD[29] 0x1599058, @FD[30] (nil), @FD[31] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[32] 0x159a658, @FD[33] 0x1599a58, @FD[34] 0x1598f58, @FD[35] 0x1599b58, May 1 16:03:39 mobius pexd[15007]: @FD[36] 0x159a058, @FD[37] 0x1598858, @FD[38] 0x1598c58, @FD[39] 0x1598a58, May 1 16:03:39 mobius pexd[15007]: @FD[40] 0x1599258, @FD[41] 0x1599358, @FD[42] 0x1599158, @FD[43] 0x159b158, May 1 16:03:39 mobius pexd[15007]: @FD[44] (nil), @FD[45] (nil), @FD[46] (nil), @FD[47] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[48] (nil), @FD[49] (nil), @FD[50] (nil), @FD[51] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[52] (nil), @FD[53] (nil), @FD[54] (nil), @FD[55] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[56] (nil), @FD[57] (nil), @FD[58] (nil), @FD[59] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[60] (nil), @FD[61] (nil), May 1 16:03:39 mobius pexd[15007]: PROTO_TASK: RX EVENT CONN[11] Release State 2 Class 2 Type 36 May 1 16:03:39 mobius pexd[15007]: PROTO_TASK: CONN[11] - CONNECTION RELEASE COMPLETE May 1 16:03:39 mobius pexd[15007]: HANDLE: LOOP PTR 0xc27800 type 8 flags 8d Q-Head: Prev 0xc27810 Next 0x159a810 Loop FD 0 POLL CB (nil) May 1 16:03:39 mobius pexd[15007]: IO FIELDS: cb 0x415050 fd 30 events 0 pevents 0 May 1 16:03:39 mobius pexd[15007]: IO WATCHER Queues: Pending Q-Head: Prev 0x1598660 Next 0x1598660 Watcher Q-Head: Prev 0x1598670 Next 0x1598670 May 1 16:03:39 mobius pexd[15007]: MPOLL: IDX 10 FD 30 HANDLE (nil) - START POLLING: Backend FD 16 May 1 16:03:39 mobius pexd[15007]: LOOP 0xc27800: Watch 0x7f7218000910 NWatch 62 Nfds 25 *FD: USER 0x1598658 BACKEND (nil) May 1 16:03:39 mobius pexd[15007]: @FD[0] (nil), @FD[1] (nil), @FD[2] (nil), @FD[3] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[4] (nil), @FD[5] (nil), @FD[6] (nil), @FD[7] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[8] (nil), @FD[9] (nil), @FD[10] (nil), @FD[11] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[12] (nil), @FD[13] (nil), @FD[14] (nil), @FD[15] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[16] (nil), @FD[17] 0xc27a30, @FD[18] (nil), @FD[19] 0xc279c8, May 1 16:03:39 mobius pexd[15007]: @FD[20] 0x159b258, @FD[21] 0x159aa58, @FD[22] 0x1599e58, @FD[23] 0x159a758, May 1 16:03:39 mobius pexd[15007]: @FD[24] 0x159a458, @FD[25] 0x159a558, @FD[26] 0x159a158, @FD[27] 0x1599958, May 1 16:03:39 mobius pexd[15007]: @FD[28] 0x159a858, @FD[29] 0x1599058, @FD[30] 0x1598658, @FD[31] (nil), May 1 16:03:39 mobius pexd[15007]: DB_TASK: RX EVENT - CONN[11] State 15 Class 4 Type 56 May 1 16:03:39 mobius pexd[15007]: DB_TASK: CONN[11] - NETWORK SERVICE DOWN May 1 16:03:39 mobius pexd[15007]: PROTO_TASK: RX EVENT 62347 - CONN[11] State 15 Class 2 Type 30 May 1 16:03:39 mobius pexd[15007]: PROTO_TASK: RX EVENT CONN[11] Release State 2 Class 2 Type 30 May 1 16:03:39 mobius pexd[15007]: @FD[32] 0x159a658, @FD[33] 0x1599a58, @FD[34] 0x1598f58, @FD[35] 0x1599b58, May 1 16:03:39 mobius pexd[15007]: @FD[36] 0x159a058, @FD[37] 0x1598858, @FD[38] 0x1598c58, @FD[39] 0x1598a58, May 1 16:03:39 mobius pexd[15007]: @FD[40] 0x1599258, @FD[41] 0x1599358, @FD[42] 0x1599158, @FD[43] 0x159b158, May 1 16:03:39 mobius pexd[15007]: @FD[44] (nil), @FD[45] (nil), @FD[46] (nil), @FD[47] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[48] (nil), @FD[49] (nil), @FD[50] (nil), @FD[51] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[52] (nil), @FD[53] (nil), @FD[54] (nil), @FD[55] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[56] (nil), @FD[57] (nil), @FD[58] (nil), @FD[59] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[60] (nil), @FD[61] (nil), May 1 16:03:39 mobius pexd[15007]: HANDLE: LOOP PTR 0xc27800 type 8 flags 12d Q-Head: Prev 0xc27810 Next 0x159a810 Loop FD 0 POLL CB 0x4058be May 1 16:03:39 mobius pexd[15007]: IO FIELDS: cb 0x415050 fd 30 events 0 pevents 1 May 1 16:03:39 mobius pexd[15007]: IO WATCHER Queues: Pending Q-Head: Prev 0x1598660 Next 0x1598660 Watcher Q-Head: Prev 0xc27858 Next 0xc27858 COMMENT: Some non-Libuv events. May 1 16:03:39 mobius pexd[15007]: PROTO_TASK: RX EVENT 62348 - CONN[10] State 0 Class 2 Type 33 May 1 16:03:39 mobius pexd[15007]: PROTO_TASK: RX EVENT 62349 - CONN[1] State 13 Class 0 Type 8 May 1 16:03:39 mobius pexd[15007]: PROTO_TASK: RX SEG - State 2 Type 8 Segment 4 May 1 16:03:39 mobius pexd[15007]: PROTO_TASK: CONN[1] - DATASET COMPLETE May 1 16:03:39 mobius pexd[15007]: DB_TASK: CONN[1] - Xfer Started, Final Segment = 0 May 1 16:03:39 mobius pexd[15007]: PROTO_TASK: RX EVENT 62350 - CONN[6] State 13 Class 0 Type 8 May 1 16:03:39 mobius pexd[15007]: PROTO_TASK: RX SEG - State 1 Type 8 Segment 2 May 1 16:03:39 mobius pexd[15007]: DB_TASK: RX EVENT - CONN[1] State 13 Class 4 Type 54 May 1 16:03:39 mobius pexd[15007]: DB_TASK: CONN[1] - Xfer Finished May 1 16:03:39 mobius pexd[15007]: DB_TASK: CONN[1] - Xfer Succeeded May 1 16:03:39 mobius pexd[15007]: PROTO_TASK: RX EVENT 62351 - CONN[1] State 13 Class 2 Type 30 May 1 16:03:39 mobius pexd[15007]: PROTO_TASK: TX EVENT 62352 - CONN[1] State 12 Class 0 Type 9 May 1 16:03:39 mobius pexd[15007]: PROTO_TASK: RX EVENT 62353 - CONN[1] State 12 Class 0 Type 2 May 1 16:03:39 mobius pexd[15007]: PROTO_TASK: CONN[1] - SESSION COMPLETE May 1 16:03:39 mobius pexd[15007]: PROTO_TASK: TX EVENT 62354 - CONN[1] State 1 Class 0 Type 9 May 1 16:03:39 mobius pexd[15007]: PROTO_TASK: RX EVENT 62355 - CONN[5] State 13 Class 0 Type 8 May 1 16:03:39 mobius pexd[15007]: PROTO_TASK: RX SEG - State 2 Type 8 Segment 2 ****************************** CYCLE 1 *************************************** COMMENT: TCP Connection on connection 11. This begins a successful session on connection 11 using TCP FD 31. However, the use of FD 31 is matter of chance rather than a direct factor in subsequent use of that FD. May 1 16:03:39 mobius pexd[15007]: MAIN_TASK: NEW CONNECTION ESTABLISHED - CONN 11 FD 31 COMMENT: CYCLE 1, CONNECTION 11, TCP FD 31. After uv_accept(). May 1 16:03:39 mobius pexd[15007]: MPOLL: IDX 11 FD 31 HANDLE (nil) - ACCEPT: Backend FD 16 May 1 16:03:39 mobius pexd[15007]: LOOP 0xc27800: Watch 0x7f7218000910 NWatch 62 Nfds 25 *FD: USER (nil) BACKEND (nil) May 1 16:03:39 mobius pexd[15007]: @FD[0] (nil), @FD[1] (nil), @FD[2] (nil), @FD[3] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[4] (nil), @FD[5] (nil), @FD[6] (nil), @FD[7] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[8] (nil), @FD[9] (nil), @FD[10] (nil), @FD[11] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[12] (nil), @FD[13] (nil), @FD[14] (nil), @FD[15] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[16] (nil), @FD[17] 0xc27a30, @FD[18] (nil), @FD[19] 0xc279c8, May 1 16:03:39 mobius pexd[15007]: @FD[20] 0x159b258, @FD[21] 0x159aa58, @FD[22] 0x1599e58, @FD[23] 0x159a758, May 1 16:03:39 mobius pexd[15007]: @FD[24] 0x159a458, @FD[25] 0x159a558, @FD[26] 0x159a158, @FD[27] 0x1599958, May 1 16:03:39 mobius pexd[15007]: @FD[28] 0x159a858, @FD[29] 0x1599058, @FD[30] 0x1598658, @FD[31] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[32] 0x159a658, @FD[33] 0x1599a58, @FD[34] 0x1598f58, @FD[35] 0x1599b58, May 1 16:03:39 mobius pexd[15007]: @FD[36] 0x159a058, @FD[37] 0x1598858, @FD[38] 0x1598c58, @FD[39] 0x1598a58, May 1 16:03:39 mobius pexd[15007]: @FD[40] 0x1599258, @FD[41] 0x1599358, @FD[42] 0x1599158, @FD[43] 0x159b158, May 1 16:03:39 mobius pexd[15007]: @FD[44] (nil), @FD[45] (nil), @FD[46] (nil), @FD[47] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[48] (nil), @FD[49] (nil), @FD[50] (nil), @FD[51] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[52] (nil), @FD[53] (nil), @FD[54] (nil), @FD[55] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[56] (nil), @FD[57] (nil), @FD[58] (nil), @FD[59] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[60] (nil), @FD[61] (nil), May 1 16:03:39 mobius pexd[15007]: HANDLE: NULL COMMENT: IO_Task() receives a T_POLL_CONFIG_REQ message from the main() task. May 1 16:03:39 mobius pexd[15007]: IO_TASK(Proxy): RX EVENT - CONN[11] Type 32 COMMENT: CYCLE 1, CONNECTION 11, TCP FD 31. Before uv_poll_init(). I believe the data structures have correct values at this point. May 1 16:03:39 mobius pexd[15007]: MPOLL: IDX 11 FD 31 HANDLE (nil) - PRE-INIT POLLING: Backend FD 16 May 1 16:03:39 mobius pexd[15007]: LOOP 0xc27800: Watch 0x7f7218000910 NWatch 62 Nfds 25 *FD: USER (nil) BACKEND (nil) May 1 16:03:39 mobius pexd[15007]: @FD[0] (nil), @FD[1] (nil), @FD[2] (nil), @FD[3] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[4] (nil), @FD[5] (nil), @FD[6] (nil), @FD[7] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[8] (nil), @FD[9] (nil), @FD[10] (nil), @FD[11] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[12] (nil), @FD[13] (nil), @FD[14] (nil), @FD[15] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[16] (nil), @FD[17] 0xc27a30, @FD[18] (nil), @FD[19] 0xc279c8, May 1 16:03:39 mobius pexd[15007]: @FD[20] 0x159b258, @FD[21] 0x159aa58, @FD[22] 0x1599e58, @FD[23] 0x159a758, May 1 16:03:39 mobius pexd[15007]: @FD[24] 0x159a458, @FD[25] 0x159a558, @FD[26] 0x159a158, @FD[27] 0x1599958, May 1 16:03:39 mobius pexd[15007]: @FD[28] 0x159a858, @FD[29] 0x1599058, @FD[30] 0x1598658, @FD[31] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[32] 0x159a658, @FD[33] 0x1599a58, @FD[34] 0x1598f58, @FD[35] 0x1599b58, May 1 16:03:39 mobius pexd[15007]: @FD[36] 0x159a058, @FD[37] 0x1598858, @FD[38] 0x1598c58, @FD[39] 0x1598a58, May 1 16:03:39 mobius pexd[15007]: @FD[40] 0x1599258, @FD[41] 0x1599358, @FD[42] 0x1599158, @FD[43] 0x159b158, May 1 16:03:39 mobius pexd[15007]: @FD[44] (nil), @FD[45] (nil), @FD[46] (nil), @FD[47] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[48] (nil), @FD[49] (nil), @FD[50] (nil), @FD[51] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[52] (nil), @FD[53] (nil), @FD[54] (nil), @FD[55] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[56] (nil), @FD[57] (nil), @FD[58] (nil), @FD[59] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[60] (nil), @FD[61] (nil), May 1 16:03:39 mobius pexd[15007]: HANDLE: NULL COMMENT: CYCLE 1, CONNECTION 11, TCP FD 31. After uv_poll_init(). I believe the data structures have the right values as this point. May 1 16:03:39 mobius pexd[15007]: MPOLL: IDX 11 FD 31 HANDLE (nil) - POST-INIT POLLING: Backend FD 16 May 1 16:03:39 mobius pexd[15007]: LOOP 0xc27800: Watch 0x7f7218000910 NWatch 62 Nfds 25 *FD: USER (nil) BACKEND (nil) May 1 16:03:39 mobius pexd[15007]: @FD[0] (nil), @FD[1] (nil), @FD[2] (nil), @FD[3] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[4] (nil), @FD[5] (nil), @FD[6] (nil), @FD[7] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[8] (nil), @FD[9] (nil), @FD[10] (nil), @FD[11] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[12] (nil), @FD[13] (nil), @FD[14] (nil), @FD[15] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[16] (nil), @FD[17] 0xc27a30, @FD[18] (nil), @FD[19] 0xc279c8, May 1 16:03:39 mobius pexd[15007]: @FD[20] 0x159b258, @FD[21] 0x159aa58, @FD[22] 0x1599e58, @FD[23] 0x159a758, May 1 16:03:39 mobius pexd[15007]: @FD[24] 0x159a458, @FD[25] 0x159a558, @FD[26] 0x159a158, @FD[27] 0x1599958, May 1 16:03:39 mobius pexd[15007]: @FD[28] 0x159a858, @FD[29] 0x1599058, @FD[30] 0x1598658, @FD[31] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[32] 0x159a658, @FD[33] 0x1599a58, @FD[34] 0x1598f58, @FD[35] 0x1599b58, May 1 16:03:39 mobius pexd[15007]: @FD[36] 0x159a058, @FD[37] 0x1598858, @FD[38] 0x1598c58, @FD[39] 0x1598a58, May 1 16:03:39 mobius pexd[15007]: @FD[40] 0x1599258, @FD[41] 0x1599358, @FD[42] 0x1599158, @FD[43] 0x159b158, May 1 16:03:39 mobius pexd[15007]: @FD[44] (nil), @FD[45] (nil), @FD[46] (nil), @FD[47] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[48] (nil), @FD[49] (nil), @FD[50] (nil), @FD[51] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[52] (nil), @FD[53] (nil), @FD[54] (nil), @FD[55] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[56] (nil), @FD[57] (nil), @FD[58] (nil), @FD[59] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[60] (nil), @FD[61] (nil), May 1 16:03:39 mobius pexd[15007]: HANDLE: LOOP PTR 0xc27800 type 8 flags 8d Q-Head: Prev 0xc27810 Next 0x1598610 Loop FD 0 POLL CB (nil) May 1 16:03:39 mobius pexd[15007]: IO FIELDS: cb 0x415050 fd 31 events 0 pevents 0 May 1 16:03:39 mobius pexd[15007]: IO WATCHER Queues: Pending Q-Head: Prev 0x159ab60 Next 0x159ab60 Watcher Q-Head: Prev 0x159ab70 Next 0x159ab70 COMMENT: CYCLE 1, CONNECTION 11, TCP FD 31. After uv_poll_start(). May 1 16:03:39 mobius pexd[15007]: MPOLL: IDX 11 FD 31 HANDLE (nil) - START POLLING: Backend FD 16 May 1 16:03:39 mobius pexd[15007]: LOOP 0xc27800: Watch 0x7f7218000910 NWatch 62 Nfds 26 *FD: USER 0x159ab58 BACKEND (nil) May 1 16:03:39 mobius pexd[15007]: @FD[0] (nil), @FD[1] (nil), @FD[2] (nil), @FD[3] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[4] (nil), @FD[5] (nil), @FD[6] (nil), @FD[7] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[8] (nil), @FD[9] (nil), @FD[10] (nil), @FD[11] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[12] (nil), @FD[13] (nil), @FD[14] (nil), @FD[15] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[16] (nil), @FD[17] 0xc27a30, @FD[18] (nil), @FD[19] 0xc279c8, May 1 16:03:39 mobius pexd[15007]: @FD[20] 0x159b258, @FD[21] 0x159aa58, @FD[22] 0x1599e58, @FD[23] 0x159a758, May 1 16:03:39 mobius pexd[15007]: @FD[24] 0x159a458, @FD[25] 0x159a558, @FD[26] 0x159a158, @FD[27] 0x1599958, May 1 16:03:39 mobius pexd[15007]: @FD[28] 0x159a858, @FD[29] 0x1599058, @FD[30] 0x1598658, @FD[31] 0x159ab58, May 1 16:03:39 mobius pexd[15007]: @FD[32] 0x159a658, @FD[33] 0x1599a58, @FD[34] 0x1598f58, @FD[35] 0x1599b58, May 1 16:03:39 mobius pexd[15007]: @FD[36] 0x159a058, @FD[37] 0x1598858, @FD[38] 0x1598c58, @FD[39] 0x1598a58, May 1 16:03:39 mobius pexd[15007]: @FD[40] 0x1599258, @FD[41] 0x1599358, @FD[42] 0x1599158, @FD[43] 0x159b158, May 1 16:03:39 mobius pexd[15007]: @FD[44] (nil), @FD[45] (nil), @FD[46] (nil), @FD[47] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[48] (nil), @FD[49] (nil), @FD[50] (nil), @FD[51] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[52] (nil), @FD[53] (nil), @FD[54] (nil), @FD[55] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[56] (nil), @FD[57] (nil), @FD[58] (nil), @FD[59] (nil), May 1 16:03:39 mobius pexd[15007]: @FD[60] (nil), @FD[61] (nil), May 1 16:03:39 mobius pexd[15007]: HANDLE: LOOP PTR 0xc27800 type 8 flags 12d Q-Head: Prev 0xc27810 Next 0x1598610 Loop FD 0 POLL CB 0x4058be May 1 16:03:39 mobius pexd[15007]: IO FIELDS: cb 0x415050 fd 31 events 0 pevents 1 May 1 16:03:39 mobius pexd[15007]: IO WATCHER Queues: Pending Q-Head: Prev 0x159ab60 Next 0x159ab60 Watcher Q-Head: Prev 0xc27858 Next 0xc27858 COMMENT: Some non-Libuv events. May 1 16:03:39 mobius pexd[15007]: PROTO_TASK: RX EVENT 62356 - CONN[11] State 0 Class 2 Type 33 May 1 16:03:39 mobius pexd[15007]: PROTO_TASK: RX EVENT 62357 - CONN[2] State 13 Class 0 Type 8 May 1 16:03:39 mobius pexd[15007]: PROTO_TASK: RX SEG - State 2 Type 8 Segment 4 May 1 16:03:39 mobius pexd[15007]: PROTO_TASK: CONN[2] - DATASET COMPLETE May 1 16:03:39 mobius pexd[15007]: DB_TASK: CONN[2] - Xfer Started, Final Segment = 0 May 1 16:03:39 mobius pexd[15007]: PROTO_TASK: RX EVENT 62358 - CONN[7] State 13 Class 0 Type 8 May 1 16:03:39 mobius pexd[15007]: PROTO_TASK: RX SEG - State 1 Type 8 Segment 2 May 1 16:03:39 mobius pexd[15007]: DB_TASK: RX EVENT - CONN[2] State 13 Class 4 Type 54 May 1 16:03:39 mobius pexd[15007]: DB_TASK: CONN[2] - Xfer Finished May 1 16:03:39 mobius pexd[15007]: DB_TASK: CONN[2] - Xfer Succeeded May 1 16:03:39 mobius pexd[15007]: PROTO_TASK: RX EVENT 62359 - CONN[2] State 13 Class 2 Type 30 May 1 16:03:39 mobius pexd[15007]: PROTO_TASK: TX EVENT 62360 - CONN[2] State 12 Class 0 Type 9 May 1 16:03:39 mobius pexd[15007]: PROTO_TASK: RX EVENT 62361 - CONN[2] State 12 Class 0 Type 2 May 1 16:03:39 mobius pexd[15007]: PROTO_TASK: CONN[2] - SESSION COMPLETE May 1 16:03:39 mobius pexd[15007]: PROTO_TASK: TX EVENT 62362 - CONN[2] State 1 Class 0 Type 9 May 1 16:03:50 mobius pexd[15007]: MPOLL: IDX 6 FD 26 HANDLE (nil) - PRE-INIT POLLING: Backend FD 16 May 1 16:03:50 mobius pexd[15007]: LOOP 0xc27800: Watch 0x7f7218000910 NWatch 62 Nfds 23 *FD: USER (nil) BACKEND (nil) May 1 16:03:50 mobius pexd[15007]: @FD[0] (nil), @FD[1] (nil), @FD[2] (nil), @FD[3] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[4] (nil), @FD[5] (nil), @FD[6] (nil), @FD[7] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[8] (nil), @FD[9] (nil), @FD[10] (nil), @FD[11] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[12] (nil), @FD[13] (nil), @FD[14] (nil), @FD[15] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[16] (nil), @FD[17] 0xc27a30, @FD[18] (nil), @FD[19] 0xc279c8, May 1 16:03:50 mobius pexd[15007]: @FD[20] 0x159a958, @FD[21] 0x1598358, @FD[22] 0x1599e58, @FD[23] 0x159b258, May 1 16:03:50 mobius pexd[15007]: @FD[24] 0x159aa58, @FD[25] 0x159a558, @FD[26] (nil), @FD[27] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[28] (nil), @FD[29] 0x1599558, @FD[30] 0x1598658, @FD[31] 0x159ab58, May 1 16:03:50 mobius pexd[15007]: @FD[32] 0x1599a58, @FD[33] 0x1599058, @FD[34] 0x1598f58, @FD[35] 0x1599858, May 1 16:03:50 mobius pexd[15007]: @FD[36] 0x1599b58, @FD[37] 0x1598958, @FD[38] 0x1598c58, @FD[39] 0x1598858, May 1 16:03:50 mobius pexd[15007]: @FD[40] 0x1598258, @FD[41] 0x1599358, @FD[42] 0x1599158, @FD[43] 0x1599258, May 1 16:03:50 mobius pexd[15007]: DB_TASK: CONN[5] - Session Started May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX EVENT 62911 - CONN[5] State 4 Class 2 Type 30 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: TX EVENT 62912 - CONN[5] State 6 Class 0 Type 9 May 1 16:03:50 mobius pexd[15007]: @FD[44] (nil), @FD[45] (nil), @FD[46] (nil), @FD[47] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[48] (nil), @FD[49] (nil), @FD[50] (nil), @FD[51] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[52] (nil), @FD[53] (nil), @FD[54] (nil), @FD[55] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[56] (nil), @FD[57] (nil), @FD[58] (nil), @FD[59] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[60] (nil), @FD[61] (nil), May 1 16:03:50 mobius pexd[15007]: HANDLE: NULL May 1 16:03:50 mobius pexd[15007]: MPOLL: IDX 6 FD 26 HANDLE (nil) - POST-INIT POLLING: Backend FD 16 May 1 16:03:50 mobius pexd[15007]: LOOP 0xc27800: Watch 0x7f7218000910 NWatch 62 Nfds 23 *FD: USER (nil) BACKEND (nil) May 1 16:03:50 mobius pexd[15007]: @FD[0] (nil), @FD[1] (nil), @FD[2] (nil), @FD[3] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[4] (nil), @FD[5] (nil), @FD[6] (nil), @FD[7] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[8] (nil), @FD[9] (nil), @FD[10] (nil), @FD[11] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[12] (nil), @FD[13] (nil), @FD[14] (nil), @FD[15] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[16] (nil), @FD[17] 0xc27a30, @FD[18] (nil), @FD[19] 0xc279c8, May 1 16:03:50 mobius pexd[15007]: @FD[20] 0x159a958, @FD[21] 0x1598358, @FD[22] 0x1599e58, @FD[23] 0x159b258, May 1 16:03:50 mobius pexd[15007]: @FD[24] 0x159aa58, @FD[25] 0x159a558, @FD[26] (nil), @FD[27] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[28] (nil), @FD[29] 0x1599558, @FD[30] 0x1598658, @FD[31] 0x159ab58, May 1 16:03:50 mobius pexd[15007]: @FD[32] 0x1599a58, @FD[33] 0x1599058, @FD[34] 0x1598f58, @FD[35] 0x1599858, May 1 16:03:50 mobius pexd[15007]: @FD[36] 0x1599b58, @FD[37] 0x1598958, @FD[38] 0x1598c58, @FD[39] 0x1598858, May 1 16:03:50 mobius pexd[15007]: @FD[40] 0x1598258, @FD[41] 0x1599358, @FD[42] 0x1599158, @FD[43] 0x1599258, May 1 16:03:50 mobius pexd[15007]: @FD[44] (nil), @FD[45] (nil), @FD[46] (nil), @FD[47] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[48] (nil), @FD[49] (nil), @FD[50] (nil), @FD[51] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[52] (nil), @FD[53] (nil), @FD[54] (nil), @FD[55] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[56] (nil), @FD[57] (nil), @FD[58] (nil), @FD[59] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[60] (nil), @FD[61] (nil), May 1 16:03:50 mobius pexd[15007]: HANDLE: LOOP PTR 0xc27800 type 8 flags 8d Q-Head: Prev 0xc27810 Next 0x159a510 Loop FD 0 POLL CB (nil) May 1 16:03:50 mobius pexd[15007]: IO FIELDS: cb 0x415050 fd 26 events 0 pevents 0 May 1 16:03:50 mobius pexd[15007]: IO WATCHER Queues: Pending Q-Head: Prev 0x159a860 Next 0x159a860 Watcher Q-Head: Prev 0x159a870 Next 0x159a870 May 1 16:03:50 mobius pexd[15007]: MPOLL: IDX 6 FD 26 HANDLE (nil) - START POLLING: Backend FD 16 May 1 16:03:50 mobius pexd[15007]: LOOP 0xc27800: Watch 0x7f7218000910 NWatch 62 Nfds 24 *FD: USER 0x159a858 BACKEND (nil) May 1 16:03:50 mobius pexd[15007]: @FD[0] (nil), @FD[1] (nil), @FD[2] (nil), @FD[3] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[4] (nil), @FD[5] (nil), @FD[6] (nil), @FD[7] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[8] (nil), @FD[9] (nil), @FD[10] (nil), @FD[11] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[12] (nil), @FD[13] (nil), @FD[14] (nil), @FD[15] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[16] (nil), @FD[17] 0xc27a30, @FD[18] (nil), @FD[19] 0xc279c8, May 1 16:03:50 mobius pexd[15007]: @FD[20] 0x159a958, @FD[21] 0x1598358, @FD[22] 0x1599e58, @FD[23] 0x159b258, May 1 16:03:50 mobius pexd[15007]: @FD[24] 0x159aa58, @FD[25] 0x159a558, @FD[26] 0x159a858, @FD[27] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[28] (nil), @FD[29] 0x1599558, @FD[30] 0x1598658, @FD[31] 0x159ab58, May 1 16:03:50 mobius pexd[15007]: @FD[32] 0x1599a58, @FD[33] 0x1599058, @FD[34] 0x1598f58, @FD[35] 0x1599858, May 1 16:03:50 mobius pexd[15007]: @FD[36] 0x1599b58, @FD[37] 0x1598958, @FD[38] 0x1598c58, @FD[39] 0x1598858, May 1 16:03:50 mobius pexd[15007]: @FD[40] 0x1598258, @FD[41] 0x1599358, @FD[42] 0x1599158, @FD[43] 0x1599258, May 1 16:03:50 mobius pexd[15007]: @FD[44] (nil), @FD[45] (nil), @FD[46] (nil), @FD[47] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[48] (nil), @FD[49] (nil), @FD[50] (nil), @FD[51] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[52] (nil), @FD[53] (nil), @FD[54] (nil), @FD[55] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[56] (nil), @FD[57] (nil), @FD[58] (nil), @FD[59] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[60] (nil), @FD[61] (nil), May 1 16:03:50 mobius pexd[15007]: HANDLE: LOOP PTR 0xc27800 type 8 flags 12d Q-Head: Prev 0xc27810 Next 0x159a510 Loop FD 0 POLL CB 0x4058be May 1 16:03:50 mobius pexd[15007]: IO FIELDS: cb 0x415050 fd 26 events 0 pevents 1 May 1 16:03:50 mobius pexd[15007]: IO WATCHER Queues: Pending Q-Head: Prev 0x159a860 Next 0x159a860 Watcher Q-Head: Prev 0xc27858 Next 0xc27858 COMMENT: Some non-Libuv events. May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX EVENT 62913 - CONN[6] State 0 Class 2 Type 33 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX EVENT 62914 - CONN[5] State 6 Class 0 Type 5 May 1 16:03:50 mobius pexd[15007]: DB_TASK: RX EVENT - CONN[5] State 6 Class 0 Type 5 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX EVENT 62915 - CONN[5] State 6 Class 2 Type 30 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: TX EVENT 62916 - CONN[5] State 8 Class 0 Type 9 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX EVENT 62917 - CONN[5] State 8 Class 0 Type 6 May 1 16:03:50 mobius pexd[15007]: DB_TASK: RX EVENT - CONN[5] State 8 Class 0 Type 6 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX EVENT 62918 - CONN[5] State 8 Class 2 Type 30 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: TX EVENT 62919 - CONN[5] State 10 Class 0 Type 9 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX EVENT 62920 - CONN[5] State 10 Class 0 Type 7 May 1 16:03:50 mobius pexd[15007]: DB_TASK: RX EVENT - CONN[5] State 10 Class 0 Type 7 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX EVENT 62921 - CONN[5] State 10 Class 2 Type 30 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: TX EVENT 62922 - CONN[5] State 12 Class 0 Type 9 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX EVENT 62923 - CONN[5] State 12 Class 0 Type 8 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX SEG - State 0 Type 8 Segment 1 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX EVENT 62924 - CONN[2] State 13 Class 0 Type 8 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX SEG - State 1 Type 8 Segment 2 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX EVENT 62925 - CONN[3] State 13 Class 0 Type 8 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX SEG - State 2 Type 8 Segment 2 May 1 16:03:50 mobius pexd[15007]: MAIN_TASK: NEW CONNECTION ESTABLISHED - CONN 7 FD 27 COMMENT: Some non-Libuv events mostly on connection 8. May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX EVENT 62973 - CONN[8] State 1 Class 0 Type 1 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: CONN[8] - Release State 0 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: TX EVENT 62974 - CONN[8] State 4 Class 0 Type 9 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX EVENT 62975 - CONN[8] State 4 Class 0 Type 4 May 1 16:03:50 mobius pexd[15007]: DB_TASK: RX EVENT - CONN[8] State 4 Class 0 Type 4 May 1 16:03:50 mobius pexd[15007]: DB_TASK: CONN[8] - Session Started May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX EVENT 62976 - CONN[8] State 4 Class 2 Type 30 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: TX EVENT 62977 - CONN[8] State 6 Class 0 Type 9 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX EVENT 62978 - CONN[8] State 6 Class 0 Type 5 May 1 16:03:50 mobius pexd[15007]: DB_TASK: RX EVENT - CONN[8] State 6 Class 0 Type 5 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX EVENT 62979 - CONN[8] State 6 Class 2 Type 30 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: TX EVENT 62980 - CONN[8] State 8 Class 0 Type 9 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX EVENT 62981 - CONN[8] State 8 Class 0 Type 6 May 1 16:03:50 mobius pexd[15007]: DB_TASK: RX EVENT - CONN[8] State 8 Class 0 Type 6 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX EVENT 62982 - CONN[8] State 8 Class 2 Type 30 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: TX EVENT 62983 - CONN[8] State 10 Class 0 Type 9 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX EVENT 62984 - CONN[8] State 10 Class 0 Type 7 May 1 16:03:50 mobius pexd[15007]: DB_TASK: RX EVENT - CONN[8] State 10 Class 0 Type 7 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX EVENT 62985 - CONN[8] State 10 Class 2 Type 30 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: TX EVENT 62986 - CONN[8] State 12 Class 0 Type 9 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX EVENT 62987 - CONN[8] State 12 Class 0 Type 8 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX SEG - State 0 Type 8 Segment 1 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX EVENT 62988 - CONN[11] State 1 Class 1 Type 21 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: CONN[11] - Release State 0 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX EVENT 62989 - CONN[10] State 1 Class 1 Type 21 COMMENT: The IO_Task() receives a T_POLL_DISMATLE_REQ from the Protocol_Task(). May 1 16:03:50 mobius pexd[15007]: IO_TASK(Proxy): RX EVENT - CONN[11] Type 34 COMMENT: CYCLE 1, CONNECTION 11, TCP FD 31. After uv_poll_stop(). According to the documentation this should free FD 31 to the user. May 1 16:03:50 mobius pexd[15007]: MPOLL: IDX 11 FD 31 HANDLE 0x159aaf0 - STOP POLLING: Backend FD 16 May 1 16:03:50 mobius pexd[15007]: LOOP 0xc27800: Watch 0x7f7218000910 NWatch 62 Nfds 25 *FD: USER (nil) BACKEND (nil) May 1 16:03:50 mobius pexd[15007]: @FD[0] (nil), @FD[1] (nil), @FD[2] (nil), @FD[3] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[4] (nil), @FD[5] (nil), @FD[6] (nil), @FD[7] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[8] (nil), @FD[9] (nil), @FD[10] (nil), @FD[11] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[12] (nil), @FD[13] (nil), @FD[14] (nil), @FD[15] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[16] (nil), @FD[17] 0xc27a30, @FD[18] (nil), @FD[19] 0xc279c8, May 1 16:03:50 mobius pexd[15007]: @FD[20] 0x159a958, @FD[21] 0x1598358, @FD[22] 0x1599e58, @FD[23] 0x159b258, May 1 16:03:50 mobius pexd[15007]: @FD[24] 0x159aa58, @FD[25] 0x159a558, @FD[26] 0x159a858, @FD[27] 0x159b058, May 1 16:03:50 mobius pexd[15007]: @FD[28] 0x159a158, @FD[29] 0x1599558, @FD[30] 0x1598658, @FD[31] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[32] 0x1599a58, @FD[33] 0x1599058, @FD[34] 0x1598f58, @FD[35] 0x1599858, May 1 16:03:50 mobius pexd[15007]: @FD[36] 0x1599b58, @FD[37] 0x1598958, @FD[38] 0x1598c58, @FD[39] 0x1598858, May 1 16:03:50 mobius pexd[15007]: @FD[40] 0x1598258, @FD[41] 0x1599358, @FD[42] 0x1599158, @FD[43] 0x1599258, May 1 16:03:50 mobius pexd[15007]: @FD[44] (nil), @FD[45] (nil), @FD[46] (nil), @FD[47] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[48] (nil), @FD[49] (nil), @FD[50] (nil), @FD[51] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[52] (nil), @FD[53] (nil), @FD[54] (nil), @FD[55] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[56] (nil), @FD[57] (nil), @FD[58] (nil), @FD[59] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[60] (nil), @FD[61] (nil), May 1 16:03:50 mobius pexd[15007]: HANDLE: LOOP PTR 0xc27800 type 8 flags 8d Q-Head: Prev 0x1598f10 Next 0x1598610 Loop FD 0 POLL CB 0x4058be May 1 16:03:50 mobius pexd[15007]: IO FIELDS: cb 0x415050 fd 31 events 0 pevents 0 May 1 16:03:50 mobius pexd[15007]: IO WATCHER Queues: Pending Q-Head: Prev 0x159ab60 Next 0x159ab60 Watcher Q-Head: Prev 0x159ab70 Next 0x159ab70 COMMENT: CYCLE 1, CONNECTION 11, TCP FD 31. In the uv_close() callback. This should release FD 31 to the user. May 1 16:03:50 mobius pexd[15007]: MPOLL: IDX 11 FD 31 HANDLE 0x159aaf0 - CLOSE POLLING: Backend FD 16 May 1 16:03:50 mobius pexd[15007]: LOOP 0xc27800: Watch 0x7f7218000910 NWatch 62 Nfds 25 *FD: USER (nil) BACKEND (nil) May 1 16:03:50 mobius pexd[15007]: @FD[0] (nil), @FD[1] (nil), @FD[2] (nil), @FD[3] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[4] (nil), @FD[5] (nil), @FD[6] (nil), @FD[7] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[8] (nil), @FD[9] (nil), @FD[10] (nil), @FD[11] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[12] (nil), @FD[13] (nil), @FD[14] (nil), @FD[15] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[16] (nil), @FD[17] 0xc27a30, @FD[18] (nil), @FD[19] 0xc279c8, May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: CONN[10] - Release State 0 May 1 16:03:50 mobius pexd[15007]: @FD[20] 0x159a958, @FD[21] 0x1598358, @FD[22] 0x1599e58, @FD[23] 0x159b258, May 1 16:03:50 mobius pexd[15007]: @FD[24] 0x159aa58, @FD[25] 0x159a558, @FD[26] 0x159a858, @FD[27] 0x159b058, May 1 16:03:50 mobius pexd[15007]: @FD[28] 0x159a158, @FD[29] 0x1599558, @FD[30] 0x1598658, @FD[31] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[32] 0x1599a58, @FD[33] 0x1599058, @FD[34] 0x1598f58, @FD[35] 0x1599858, May 1 16:03:50 mobius pexd[15007]: @FD[36] 0x1599b58, @FD[37] 0x1598958, @FD[38] 0x1598c58, @FD[39] 0x1598858, May 1 16:03:50 mobius pexd[15007]: @FD[40] 0x1598258, @FD[41] 0x1599358, @FD[42] 0x1599158, @FD[43] 0x1599258, May 1 16:03:50 mobius pexd[15007]: @FD[44] (nil), @FD[45] (nil), @FD[46] (nil), @FD[47] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[48] (nil), @FD[49] (nil), @FD[50] (nil), @FD[51] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[52] (nil), @FD[53] (nil), @FD[54] (nil), @FD[55] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[56] (nil), @FD[57] (nil), @FD[58] (nil), @FD[59] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[60] (nil), @FD[61] (nil), May 1 16:03:50 mobius pexd[15007]: HANDLE: NULL COMMENT: The Protocol_Task() receieves a T_DISMAMTLE_RSP from the IO_Task() and sends a T_CONN_DISMALTE_REQ to the main() task. The main() task responds with another T_DISMATLE_RSP. Upon reception of that message the Protocol_Task() release the FD with the Linux close(). (All action on connection 11.) May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX EVENT 62990 - CONN[11] State 15 Class 2 Type 36 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX EVENT CONN[11] Release State 1 Class 2 Type 36 May 1 16:03:50 mobius pexd[15007]: MAIN_TASK(Proxy): CONN[11] Type 35 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX EVENT 62991 - CONN[11] State 15 Class 2 Type 36 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX EVENT CONN[11] Release State 2 Class 2 Type 36 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: CONN[11] - CONNECTION RELEASE COMPLETE May 1 16:03:50 mobius pexd[15007]: DB_TASK: RX EVENT - CONN[11] State 15 Class 4 Type 56 May 1 16:03:50 mobius pexd[15007]: DB_TASK: CONN[11] - NETWORK SERVICE DOWN May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX EVENT 62992 - CONN[11] State 15 Class 2 Type 30 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX EVENT CONN[11] Release State 2 Class 2 Type 30 May 1 16:03:50 mobius pexd[15007]: IO_TASK(Proxy): RX EVENT - CONN[10] Type 34 May 1 16:03:50 mobius pexd[15007]: MPOLL: IDX 10 FD 30 HANDLE 0x15985f0 - STOP POLLING: Backend FD 16 May 1 16:03:50 mobius pexd[15007]: LOOP 0xc27800: Watch 0x7f7218000910 NWatch 62 Nfds 24 *FD: USER (nil) BACKEND (nil) May 1 16:03:50 mobius pexd[15007]: @FD[0] (nil), @FD[1] (nil), @FD[2] (nil), @FD[3] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[4] (nil), @FD[5] (nil), @FD[6] (nil), @FD[7] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[8] (nil), @FD[9] (nil), @FD[10] (nil), @FD[11] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[12] (nil), @FD[13] (nil), @FD[14] (nil), @FD[15] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[16] (nil), @FD[17] 0xc27a30, @FD[18] (nil), @FD[19] 0xc279c8, May 1 16:03:50 mobius pexd[15007]: @FD[20] 0x159a958, @FD[21] 0x1598358, @FD[22] 0x1599e58, @FD[23] 0x159b258, May 1 16:03:50 mobius pexd[15007]: @FD[24] 0x159aa58, @FD[25] 0x159a558, @FD[26] 0x159a858, @FD[27] 0x159b058, May 1 16:03:50 mobius pexd[15007]: @FD[28] 0x159a158, @FD[29] 0x1599558, @FD[30] (nil), @FD[31] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[32] 0x1599a58, @FD[33] 0x1599058, @FD[34] 0x1598f58, @FD[35] 0x1599858, May 1 16:03:50 mobius pexd[15007]: @FD[36] 0x1599b58, @FD[37] 0x1598958, @FD[38] 0x1598c58, @FD[39] 0x1598858, May 1 16:03:50 mobius pexd[15007]: @FD[40] 0x1598258, @FD[41] 0x1599358, @FD[42] 0x1599158, @FD[43] 0x1599258, May 1 16:03:50 mobius pexd[15007]: @FD[44] (nil), @FD[45] (nil), @FD[46] (nil), @FD[47] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[48] (nil), @FD[49] (nil), @FD[50] (nil), @FD[51] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[52] (nil), @FD[53] (nil), @FD[54] (nil), @FD[55] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[56] (nil), @FD[57] (nil), @FD[58] (nil), @FD[59] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[60] (nil), @FD[61] (nil), May 1 16:03:50 mobius pexd[15007]: HANDLE: LOOP PTR 0xc27800 type 8 flags 8d Q-Head: Prev 0x1598f10 Next 0x642fa0 Loop FD 0 POLL CB 0x4058be May 1 16:03:50 mobius pexd[15007]: IO FIELDS: cb 0x415050 fd 30 events 0 pevents 0 May 1 16:03:50 mobius pexd[15007]: IO WATCHER Queues: Pending Q-Head: Prev 0x1598660 Next 0x1598660 Watcher Q-Head: Prev 0x1598670 Next 0x1598670 COMMENT: This is the last polling operation before the cycle in which the crash occurs. It may be significant because it is where I believe TCP FD 30 should be released. May 1 16:03:50 mobius pexd[15007]: MPOLL: IDX 10 FD 30 HANDLE 0x15985f0 - CLOSE POLLING: Backend FD 16 May 1 16:03:50 mobius pexd[15007]: LOOP 0xc27800: Watch 0x7f7218000910 NWatch 62 Nfds 24 *FD: USER (nil) BACKEND (nil) May 1 16:03:50 mobius pexd[15007]: @FD[0] (nil), @FD[1] (nil), @FD[2] (nil), @FD[3] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[4] (nil), @FD[5] (nil), @FD[6] (nil), @FD[7] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[8] (nil), @FD[9] (nil), @FD[10] (nil), @FD[11] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[12] (nil), @FD[13] (nil), @FD[14] (nil), @FD[15] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[16] (nil), @FD[17] 0xc27a30, @FD[18] (nil), @FD[19] 0xc279c8, May 1 16:03:50 mobius pexd[15007]: @FD[20] 0x159a958, @FD[21] 0x1598358, @FD[22] 0x1599e58, @FD[23] 0x159b258, May 1 16:03:50 mobius pexd[15007]: @FD[24] 0x159aa58, @FD[25] 0x159a558, @FD[26] 0x159a858, @FD[27] 0x159b058, May 1 16:03:50 mobius pexd[15007]: @FD[28] 0x159a158, @FD[29] 0x1599558, @FD[30] (nil), @FD[31] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[32] 0x1599a58, @FD[33] 0x1599058, @FD[34] 0x1598f58, @FD[35] 0x1599858, May 1 16:03:50 mobius pexd[15007]: @FD[36] 0x1599b58, @FD[37] 0x1598958, @FD[38] 0x1598c58, @FD[39] 0x1598858, May 1 16:03:50 mobius pexd[15007]: @FD[40] 0x1598258, @FD[41] 0x1599358, @FD[42] 0x1599158, @FD[43] 0x1599258, May 1 16:03:50 mobius pexd[15007]: @FD[44] (nil), @FD[45] (nil), @FD[46] (nil), @FD[47] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[48] (nil), @FD[49] (nil), @FD[50] (nil), @FD[51] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[52] (nil), @FD[53] (nil), @FD[54] (nil), @FD[55] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[56] (nil), @FD[57] (nil), @FD[58] (nil), @FD[59] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[60] (nil), @FD[61] (nil), May 1 16:03:50 mobius pexd[15007]: HANDLE: NULL COMMENT: This is the final sequence of non-Libuv events before the Crash. The Protocol_Task() receives the T_DISMANTLE_RSP message from the IO_Task() and a T_CONN_DISMANTL_REQ to the main() task. May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX EVENT 62993 - CONN[10] State 15 Class 2 Type 36 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX EVENT CONN[10] Release State 1 Class 2 Type 36 May 1 16:03:50 mobius pexd[15007]: MAIN_TASK(Proxy): CONN[10] Type 35 COMMENT: The Protocol_Task() receives a T_DISMANTLE_RSP from the main() task, cleans up everthing and uses Linux close() for the final file descriptor release. May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX EVENT 62994 - CONN[10] State 15 Class 2 Type 36 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX EVENT CONN[10] Release State 2 Class 2 Type 36 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: CONN[10] - CONNECTION RELEASE COMPLETE May 1 16:03:50 mobius pexd[15007]: DB_TASK: RX EVENT - CONN[10] State 15 Class 4 Type 56 May 1 16:03:50 mobius pexd[15007]: DB_TASK: CONN[10] - NETWORK SERVICE DOWN *********************************** CYCLE N ******************************************* COMMENT: This is the cycle in which the Crash occurs. TCP connection on connection 11. May 1 16:03:50 mobius pexd[15007]: MAIN_TASK: NEW CONNECTION ESTABLISHED - CONN 11 FD 30 COMMENT: CYCLE N, CONNECTION 11, TCP FD 30. After uv_accept(). Do the uv_loop_t Poll_Loop, and uv_poll_t data structure look right at this point ? May 1 16:03:50 mobius pexd[15007]: MPOLL: IDX 11 FD 30 HANDLE (nil) - ACCEPT: Backend FD 16 May 1 16:03:50 mobius pexd[15007]: LOOP 0xc27800: Watch 0x7f7218000910 NWatch 62 Nfds 24 *FD: USER (nil) BACKEND (nil) May 1 16:03:50 mobius pexd[15007]: @FD[0] (nil), @FD[1] (nil), @FD[2] (nil), @FD[3] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[4] (nil), @FD[5] (nil), @FD[6] (nil), @FD[7] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[8] (nil), @FD[9] (nil), @FD[10] (nil), @FD[11] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[12] (nil), @FD[13] (nil), @FD[14] (nil), @FD[15] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[16] (nil), @FD[17] 0xc27a30, @FD[18] (nil), @FD[19] 0xc279c8, May 1 16:03:50 mobius pexd[15007]: @FD[20] 0x159a958, @FD[21] 0x1598358, @FD[22] 0x1599e58, @FD[23] 0x159b258, May 1 16:03:50 mobius pexd[15007]: @FD[24] 0x159aa58, @FD[25] 0x159a558, @FD[26] 0x159a858, @FD[27] 0x159b058, May 1 16:03:50 mobius pexd[15007]: @FD[28] 0x159a158, @FD[29] 0x1599558, @FD[30] (nil), @FD[31] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[32] 0x1599a58, @FD[33] 0x1599058, @FD[34] 0x1598f58, @FD[35] 0x1599858, May 1 16:03:50 mobius pexd[15007]: @FD[36] 0x1599b58, @FD[37] 0x1598958, @FD[38] 0x1598c58, @FD[39] 0x1598858, May 1 16:03:50 mobius pexd[15007]: @FD[40] 0x1598258, @FD[41] 0x1599358, @FD[42] 0x1599158, @FD[43] 0x1599258, May 1 16:03:50 mobius pexd[15007]: @FD[44] (nil), @FD[45] (nil), @FD[46] (nil), @FD[47] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[48] (nil), @FD[49] (nil), @FD[50] (nil), @FD[51] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[52] (nil), @FD[53] (nil), @FD[54] (nil), @FD[55] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[56] (nil), @FD[57] (nil), @FD[58] (nil), @FD[59] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[60] (nil), @FD[61] (nil), May 1 16:03:50 mobius pexd[15007]: HANDLE: NULL COMMENT: The last message in this sequence is T_POLL_CONFIG_REQ sent to the IO_Task() by the main() task to request polling initiation. May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX EVENT 62995 - CONN[10] State 15 Class 2 Type 30 May 1 16:03:50 mobius pexd[15007]: PROTO_TASK: RX EVENT CONN[10] Release State 2 Class 2 Type 30 May 1 16:03:50 mobius pexd[15007]: IO_TASK(Proxy): RX EVENT - CONN[11] Type 32 COMMENT: CYCLE N, CONNECTION 11, TCP FD 30. Just before uv_poll_init(). There is definitely something wrong with the data structures at this point and uv_poll_init() will return EEXIST. May 1 16:03:50 mobius pexd[15007]: MPOLL: IDX 11 FD 30 HANDLE (nil) - PRE-INIT POLLING: Backend FD 16 May 1 16:03:50 mobius pexd[15007]: LOOP 0xc27800: Watch 0x7f7218000910 NWatch 62 Nfds 24 *FD: USER (nil) BACKEND (nil) May 1 16:03:50 mobius pexd[15007]: @FD[0] (nil), @FD[1] (nil), @FD[2] (nil), @FD[3] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[4] (nil), @FD[5] (nil), @FD[6] (nil), @FD[7] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[8] (nil), @FD[9] (nil), @FD[10] (nil), @FD[11] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[12] (nil), @FD[13] (nil), @FD[14] (nil), @FD[15] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[16] (nil), @FD[17] 0xc27a30, @FD[18] (nil), @FD[19] 0xc279c8, May 1 16:03:50 mobius pexd[15007]: @FD[20] 0x159a958, @FD[21] 0x1598358, @FD[22] 0x1599e58, @FD[23] 0x159b258, May 1 16:03:50 mobius pexd[15007]: @FD[24] 0x159aa58, @FD[25] 0x159a558, @FD[26] 0x159a858, @FD[27] 0x159b058, May 1 16:03:50 mobius pexd[15007]: @FD[28] 0x159a158, @FD[29] 0x1599558, @FD[30] (nil), @FD[31] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[32] 0x1599a58, @FD[33] 0x1599058, @FD[34] 0x1598f58, @FD[35] 0x1599858, May 1 16:03:50 mobius pexd[15007]: @FD[36] 0x1599b58, @FD[37] 0x1598958, @FD[38] 0x1598c58, @FD[39] 0x1598858, May 1 16:03:50 mobius pexd[15007]: @FD[40] 0x1598258, @FD[41] 0x1599358, @FD[42] 0x1599158, @FD[43] 0x1599258, May 1 16:03:50 mobius pexd[15007]: @FD[44] (nil), @FD[45] (nil), @FD[46] (nil), @FD[47] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[48] (nil), @FD[49] (nil), @FD[50] (nil), @FD[51] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[52] (nil), @FD[53] (nil), @FD[54] (nil), @FD[55] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[56] (nil), @FD[57] (nil), @FD[58] (nil), @FD[59] (nil), May 1 16:03:50 mobius pexd[15007]: @FD[60] (nil), @FD[61] (nil), May 1 16:03:50 mobius pexd[15007]: HANDLE: NULL May 1 16:03:50 mobius pexd[15007]: IO_TASK: POLL_PROXY - Polling Initialization Error -9, EBADF