%YDB-E-NORECVPOOL -- How to handle?

28 views
Skip to first unread message

Kevin Toppenberg

unread,
Feb 24, 2026, 12:52:03 PM (9 days ago) Feb 24
to Everything MUMPS
I went through the acculturation guide and got the replication working.  I then built up scripts to do the various steps.  All seemed to be OK until some combination of script action on the differing VM's happened.  No I get "no receiver pool" error. 

Here is the script
ydbuser@paris:~/jnlex/repl_controller/test_v1$ cat replicating_start
#!/bin/bash
source ~/jnlex/jnlex_env
filename="$ydb_dir/receive_`date +%Y%m%d:%H:%M:%S`.log"
echo "================================================"
echo "Starting to listen for a primary server on port 3000"
echo "Logging to file: $filename"
echo "================================================"
$ydb_dist/mupip replicate -source -start -passive -instsecondary=dummy -buffsize=1048576 -log=$ydb_dir/source_dummy.log
$ydb_dist/mupip replicate -receive -start -listenport=3000 -buffsize=1048576 -log="$filename"
echo "================================================"

Here I run it
ydbuser@paris:~/jnlex/repl_controller/test_v1$ ./replicating_start
================================================
Starting to listen for a primary server on port 3000
Logging to file: /home/ydbuser/jnlex/receive_20260224:18:42:40.log
================================================
Tue Feb 24 18:42:40 2026 : Initiating START of source server for secondary instance [dummy]
================================================

No obvious error after above.   But a checkhealth shows a problem. 

ydbuser@paris:~/jnlex/repl_controller/test_v1$ mupip replicate -receive -checkhealth
%YDB-E-NORECVPOOL, No receiver pool info found in the replication instance of /home/ydbuser/jnlex/paris.repl
ydbuser@paris:~/jnlex/repl_controller/test_v1$

I do have a paris.repl file, and I'll include a hex dump of it. 

The documentation of this error says:

NORECVPOOL

NORECVPOOL, No receiver pool info found in the replication instance of xxxx

Run Time/MUPIP Error: This indicates that YottaDB/MUPIP did not get replication information from the instance file specified. The replication instance file was not initialized because the receiver server did not start, or some other process reset the replication instance file.

Action: Start the receiver server if the server was not started. If the receiver server was running, stop the server and perform a MUPIP RUNDOWN (if MUPIP RUNDOWN fails, try MUPIP RUNDOWN region * ).


I tried running down, and that would work, but then after rundown and running replicating_start again, I would get the same thing. 

I am on a test system, so it doesn't really matter, but I need to know how to handle for when on a real system. 

Thanks in advance
Kevin


ydbuser@paris:~/jnlex$ xxd paris.repl
00000000: 4744 5352 504c 554e 5830 3500 0101 0100  GDSRPLUNX05.....
00000010: 0980 0200 1f80 0000 ffff ffff ffff ffff  ................
00000020: 10e3 9d69 0000 0000 10e3 9d69 0000 0000  ...i.......i....
00000030: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000040: 7061 7269 7300 0000 0000 0000 0000 0000  paris...........
00000050: 7061 7269 7300 0000 0000 0000 0000 0000  paris...........
00000060: fcc0 8b69 9f03 0000 7061 7269 7300 0000  ...i....paris...
00000070: 0000 0000 0000 0000 7061 7269 7300 0000  ........paris...
00000080: 0000 0000 0000 0000 fcc0 8b69 9f03 0000  ...........i....
00000090: 1300 0000 0000 0000 0700 0000 0900 0000  ................
000000a0: 0900 0000 0100 0000 0100 0000 0000 0000  ................
000000b0: 0800 0000 ffff ffff ffff ffff ffff ffff  ................
000000c0: ffff ffff ffff ffff ffff ffff ffff ffff  ................
000000d0: ffff ffff ffff ffff ffff ffff ffff ffff  ................
000000e0: ffff ffff ffff ffff ffff ffff ffff ffff  ................
000000f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000100: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000110: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000120: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000130: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000140: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000150: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000160: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000170: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000180: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000190: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000001a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000001b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000001c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000001d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000001e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000001f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000200: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000210: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000220: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000230: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000240: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000250: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000260: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000270: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000280: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000290: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000002a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000002b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000002c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000002d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000002e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000002f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000300: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000310: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000320: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000330: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000340: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000350: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000360: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000370: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000380: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000390: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000003a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000003b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000003c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000003d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000003e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000003f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000400: 7361 6e74 6961 676f 0000 0000 0000 0000  santiago........
00000410: 1100 0000 0000 0000 1100 0000 0000 0000  ................
00000420: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000430: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000440: 6d65 6c62 6f75 726e 6500 0000 0000 0000  melbourne.......
00000450: 1100 0000 0000 0000 1100 0000 0000 0000  ................
00000460: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000470: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000480: 6475 6d6d 7900 0000 0000 0000 0000 0000  dummy...........
00000490: 0100 0000 0000 0000 0000 0000 0000 0000  ................
000004a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000004b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000004c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000004d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000004e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000004f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000500: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000510: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000520: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000530: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000540: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000550: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000560: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000570: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000580: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000590: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000005a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000005b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000005c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000005d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000005e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000005f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000600: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000610: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000620: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000630: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000640: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000650: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000660: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000670: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000680: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000690: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000006a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000006b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000006c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000006d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000006e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000006f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000700: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000710: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000720: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000730: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000740: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000750: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000760: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000770: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000780: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000790: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000007a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000007b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000007c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000007d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000007e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
000007f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000800: 7061 7269 7300 0000 0000 0000 0000 0000  paris...........
00000810: 0100 0000 0000 0000 0000 0000 0000 0000  ................
00000820: 0100 0000 2e04 0000 72c5 8b69 0000 0000  ........r..i....
00000830: ffff ffff 0001 0000 4a97 78c1 4e7f 0000  ........J.x.N...
00000840: e030 48b9 c155 0000 584a 53b9 c155 0000  .0H..U..XJS..U..
00000850: 3840 53b9 c155 0000 0000 0000 0000 0000  8@S..U..........
00000860: ffff ffff ffff ffff ffff ffff ffff ffff  ................
00000870: ffff ffff ffff ffff ffff ffff ffff ffff  ................
00000880: ffff ffff ffff ffff ffff ffff ffff ffff  ................
00000890: ffff ffff ffff ffff ffff ffff ffff ffff  ................
000008a0: 7061 7269 7300 0000 0000 0000 0000 0000  paris...........
000008b0: 0300 0000 0000 0000 0000 0000 0000 0000  ................
000008c0: 0300 0000 4402 0000 9c09 8e69 0100 0000  ....D......i....
000008d0: 0000 0000 0001 0000 4a97 0ee5 227f 0000  ........J..."...
000008e0: e080 10c5 9355 0000 589a 1bc5 9355 0000  .....U..X....U..
000008f0: 3890 1bc5 9355 0000 0000 0000 0000 0000  8....U..........
00000900: 0000 0000 ffff ffff ffff ffff ffff ffff  ................
00000910: ffff ffff ffff ffff ffff ffff ffff ffff  ................
00000920: ffff ffff ffff ffff ffff ffff ffff ffff  ................
00000930: ffff ffff ffff ffff ffff ffff ffff ffff  ................
00000940: 6d65 6c62 6f75 726e 6500 0000 0000 0000  melbourne.......
00000950: 0600 0000 0000 0000 0000 0000 0000 0000  ................
00000960: 0100 0000 eb02 0000 4d0d 8e69 0200 0000  ........M..i....
00000970: 0100 0000 0001 0000 4ae7 a178 7b7f 0000  ........J..x{...
00000980: e020 b184 2f56 0000 583a bc84 2f56 0000  . ../V..X:../V..
00000990: 3830 bc84 2f56 0000 0000 0000 0000 0000  80../V..........
000009a0: 0100 0000 ffff ffff ffff ffff ffff ffff  ................
000009b0: ffff ffff ffff ffff ffff ffff ffff ffff  ................
000009c0: ffff ffff ffff ffff ffff ffff ffff ffff  ................
000009d0: ffff ffff ffff ffff ffff ffff ffff ffff  ................
000009e0: 7361 6e74 6961 676f 0000 0000 0000 0000  santiago........
000009f0: 0700 0000 0000 0000 0000 0000 0000 0000  ................
00000a00: 0100 0000 d402 0000 3f1c 8e69 0300 0000  ........?..i....
00000a10: 0200 0000 0001 0000 4a77 dbf5 5b7f 0000  ........Jw..[...
00000a20: e010 963c 4256 0000 582a a13c 4256 0000  ...<BV..X*.<BV..
00000a30: 3820 a13c 4256 0000 0000 0000 0000 0000  8 .<BV..........
00000a40: 0200 0000 ffff ffff ffff ffff ffff ffff  ................
00000a50: ffff ffff ffff ffff ffff ffff ffff ffff  ................
00000a60: ffff ffff ffff ffff ffff ffff ffff ffff  ................
00000a70: ffff ffff ffff ffff ffff ffff ffff ffff  ................
00000a80: 7061 7269 7300 0000 0000 0000 0000 0000  paris...........
00000a90: 0a00 0000 0000 0000 0000 0000 0000 0000  ................
00000aa0: 0400 0000 4303 0000 2121 8e69 0400 0000  ....C...!!.i....
00000ab0: 0300 0000 0001 0000 4a77 eaaf 117f 0000  ........Jw......
00000ac0: e030 c0c2 6c55 0000 584a cbc2 6c55 0000  .0..lU..XJ..lU..
00000ad0: 3840 cbc2 6c55 0000 0000 0000 0000 0000  8@..lU..........
00000ae0: 0300 0000 ffff ffff ffff ffff ffff ffff  ................
00000af0: ffff ffff ffff ffff ffff ffff ffff ffff  ................
00000b00: ffff ffff ffff ffff ffff ffff ffff ffff  ................
00000b10: ffff ffff ffff ffff ffff ffff ffff ffff  ................
00000b20: 6d65 6c62 6f75 726e 6500 0000 0000 0000  melbourne.......
00000b30: 0c00 0000 0000 0000 0000 0000 0000 0000  ................
00000b40: 0300 0000 c207 0000 67a3 8f69 0500 0000  ........g..i....
00000b50: 0400 0000 0001 0000 4a87 eaba 087f 0000  ........J.......
00000b60: e020 17c0 5b55 0000 583a 22c0 5b55 0000  . ..[U..X:".[U..
00000b70: 3830 22c0 5b55 0000 0000 0000 0000 0000  80".[U..........
00000b80: 0400 0000 ffff ffff ffff ffff ffff ffff  ................
00000b90: ffff ffff ffff ffff ffff ffff ffff ffff  ................
00000ba0: ffff ffff ffff ffff ffff ffff ffff ffff  ................
00000bb0: ffff ffff ffff ffff ffff ffff ffff ffff  ................
00000bc0: 6d65 6c62 6f75 726e 6500 0000 0000 0000  melbourne.......
00000bd0: 0d00 0000 0000 0000 0000 0000 0000 0000  ................
00000be0: 0400 0000 3808 0000 aaaa 8f69 0600 0000  ....8......i....
00000bf0: 0500 0000 0001 0000 4af7 71b1 387f 0000  ........J.q.8...
00000c00: e060 00df 0056 0000 587a 0bdf 0056 0000  .`...V..Xz...V..
00000c10: 3870 0bdf 0056 0000 0000 0000 0000 0000  8p...V..........
00000c20: 0500 0000 ffff ffff ffff ffff ffff ffff  ................
00000c30: ffff ffff ffff ffff ffff ffff ffff ffff  ................
00000c40: ffff ffff ffff ffff ffff ffff ffff ffff  ................
00000c50: ffff ffff ffff ffff ffff ffff ffff ffff  ................
00000c60: 6d65 6c62 6f75 726e 6500 0000 0000 0000  melbourne.......
00000c70: 0f00 0000 0000 0000 0000 0000 0000 0000  ................
00000c80: 0500 0000 4b0d 0000 d0b1 8f69 0700 0000  ....K......i....
00000c90: 0600 0000 0001 0000 4ae7 c6a2 a17f 0000  ........J.......
00000ca0: e050 214d d455 0000 586a 2c4d d455 0000  .P!M.U..Xj,M.U..
00000cb0: 3860 2c4d d455 0000 0000 0000 0000 0000  8`,M.U..........
00000cc0: 0600 0000 ffff ffff ffff ffff ffff ffff  ................
00000cd0: ffff ffff ffff ffff ffff ffff ffff ffff  ................
00000ce0: ffff ffff ffff ffff ffff ffff ffff ffff  ................
00000cf0: ffff ffff ffff ffff ffff ffff ffff ffff  ................
00000d00: 7061 7269 7300 0000 0000 0000 0000 0000  paris...........
00000d10: 1100 0000 0000 0000 0000 0000 0000 0000  ................
00000d20: 0700 0000 c86a 0600 6ad6 9c69 0800 0000  .....j..j..i....
00000d30: 0700 0000 0001 0000 4aa7 7e82 d97f 0000  ........J.~.....
00000d40: e010 2c86 6255 0000 582a 3786 6255 0000  ..,.bU..X*7.bU..
00000d50: 3820 3786 6255 0000 0000 0000 0000 0000  8 7.bU..........
00000d60: 0700 0000 ffff ffff ffff ffff ffff ffff  ................
00000d70: ffff ffff ffff ffff ffff ffff ffff ffff  ................
00000d80: ffff ffff ffff ffff ffff ffff ffff ffff  ................
00000d90: ffff ffff ffff ffff ffff ffff ffff ffff  ................

Kevin Toppenberg

unread,
Feb 24, 2026, 1:05:47 PM (9 days ago) Feb 24
to Everything MUMPS
I noticed that the paris.repl had multiple entries for the various nodes, melbourne, santiago etc.  So I made a new one as follows:

ydbuser@paris:~/jnlex$ mupip replicate -instance_create
%YDB-I-FILERENAME, File /home/ydbuser/jnlex/paris.repl is renamed to /home/ydbuser/jnlex/paris.repl_2026055185833

I hex dump (not included this time) shows all the multiple entries are now gone.  

I then again tried to start replication:
ydbuser@paris:~/jnlex$ ./repl_controller/replicating_start.py
================================================
Starting to listen for a primary server on port 3000
Logging to file: /home/ydbuser/jnlex/receive_20260224:19:00:03.log
================================================
Tue Feb 24 19:00:03 2026 : Initiating START of source server for secondary instance [dummy]
================================================

But I still get the same error:
ydbuser@paris:~/jnlex/repl_controller$ mupip replicate -receive -checkhealth

%YDB-E-NORECVPOOL, No receiver pool info found in the replication instance of /home/ydbuser/jnlex/paris.repl

I check if there were any errors log, but find nothing:

ydbuser@paris:~/jnlex/repl_controller$ cat receive_20260224:19:00:03.log
cat: 'receive_20260224:19:00:03.log': No such file or directory

I don't know how to go forward. 

Kevin

Shane Dewitt

unread,
Feb 24, 2026, 5:06:11 PM (9 days ago) Feb 24
to Kevin Toppenberg, Everything MUMPS

--
You received this message because you are subscribed to the Google Groups "Everything MUMPS" group.
To unsubscribe from this group and stop receiving emails from it, send an email to everythingmum...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/everythingmumps/f8106854-e74d-4bd2-af9a-77b35146ec82n%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Kevin Toppenberg

unread,
Feb 24, 2026, 5:30:59 PM (9 days ago) Feb 24
to Everything MUMPS
It is starting, but then shutting down because of a sequence number mismatch.  See below. 

As in prior post, I thought there was a problem with the .repl file, so I recreated it.  The prior one was renamed and kept. Here was the log from that:


ydbuser@paris:~/jnlex$ mupip replicate -instance_create
%YDB-I-FILERENAME, File /home/ydbuser/jnlex/paris.repl is renamed to /home/ydbuser/jnlex/paris.repl_2026055185833

How to recover from this state?

Thanks

Kevin
----------------------------------------------------

Tue Feb 24 23:25:07 2026 : /usr/local/lib/yottadb/r202/mupip replicate -receive -start -listenport=3000 -buffsize=1048576 -log=/home/ydbuser/jnlex/receive_20260224:23:24:28.log
Tue Feb 24 23:25:07 2026 : %YDB-I-REPLINFO, GTM Replication Receiver Server with Pid [691791] started on replication instance [paris]
Tue Feb 24 23:25:07 2026 : Attached to existing jnlpool with shmid = [32829] and semid = [196629]
Tue Feb 24 23:25:07 2026 : Created recvpool with shmid = [65540] and semid = [196642]
Tue Feb 24 23:25:07 2026 : Update Process started. PID 691792 [0xA8E50]
Tue Feb 24 23:25:07 2026 : Waiting for a connection...
Tue Feb 24 23:25:08 2026 : SO_KEEPALIVE is ON. TCP_KEEPCNT is 5, TCP_KEEPIDLE is 5, TCP_KEEPINTVL is 5.
Tue Feb 24 23:25:08 2026 : Connection established, using TCP send buffer size 87040 receive buffer size 425984
Tue Feb 24 23:25:08 2026 : Connection information:: Local: ::ffff:10.0.2.15:3000 Remote: vostro:59260
Tue Feb 24 23:25:08 2026 : Waiting for Update Process to write jnl_seqno
Tue Feb 24 23:25:08 2026 : Requesting transactions from JNL_SEQNO 19 [0x13]
Tue Feb 24 23:25:08 2026 : Sending REPL_START_JNL_SEQNO message with seqno 19 [0x13]
Tue Feb 24 23:25:08 2026 : Waiting for REPL_WILL_RESTART_WITH_INFO or REPL_ROLLBACK_FIRST message
Tue Feb 24 23:25:08 2026 : Source and Receiver sides have same endianness
Tue Feb 24 23:25:08 2026 : Remote side source log file path is /home/ydbuser/jnlex/paris_20260225:05:04:27.log; Source Server PID = 690533
Tue Feb 24 23:25:08 2026 : Received REPL_NEED_INSTINFO message from primary instance [melbourne]
Tue Feb 24 23:25:08 2026 : Sending REPL_INSTINFO message
Tue Feb 24 23:25:08 2026 : Received REPL_NEED_HISTINFO message for seqno 19 [0x13]
Tue Feb 24 23:25:08 2026 : Update process has processed upto seqno 19 [0x13]
Tue Feb 24 23:25:08 2026 : Starting seqno of the last valid history in the receive pool is 0 [0x0]
Tue Feb 24 23:25:08 2026 : Searching for the desired history in the replication instance file
%YDB-E-REPLINSTNOHIST, History information for seqno 18 [0x12] not found in replication instance file /home/ydbuser/jnlex/paris.repl
Tue Feb 24 23:25:08 2026 : Initiating shut down of Helpers
Tue Feb 24 23:25:08 2026 : Initiating shut down of Update Process
Tue Feb 24 23:25:08 2026 : Update Process exited
Tue Feb 24 23:25:08 2026 : REPL INFO - Current Jnlpool Seqno : 19
Tue Feb 24 23:25:08 2026 : REPL INFO - Current Update process Read Seqno : 19
Tue Feb 24 23:25:08 2026 : REPL INFO - Current Receive Pool Seqno : 19
Tue Feb 24 23:25:08 2026 : REPL INFO - Last Recvd Seqno : 18  Jnl Total : 0  Msg Total : 184
Tue Feb 24 23:25:08 2026 : REPL INFO - Last Seqno processed by update process : 18
Tue Feb 24 23:25:08 2026 : Initiating shut down
Tue Feb 24 23:25:08 2026 : Receive pool shared memory removed
Tue Feb 24 23:25:08 2026 : Receive pool semaphore removed
Tue Feb 24 23:25:08 2026 : Receiver server exiting...

ydbuser@paris:~/jnlex/repl_controller/test_v1$ date
Tue Feb 24 23:25:44 CET 2026

Kevin Toppenberg

unread,
Feb 24, 2026, 5:36:41 PM (9 days ago) Feb 24
to Everything MUMPS
I tried a rollback_resync, via script below. 

#!/bin/bash
source ~/jnlex/jnlex_env
filename="/home/ydbuser/jnlex/Unreplic_Trans_Report_`date +%Y%m%d%H%M%S`.txt"
echo "================================================"
echo "Rolling back any transactions needed to prepare"
echo "  for becoming a replicating (secondary) server"
echo "  Any rolled back entries will be sent store in:"
echo "  $filename"
echo "CMD: $ydb_dist/mupip journal -rollback -backward -fetchresync=3000 -losttrans='$filename' '*'"
$ydb_dist/mupip journal -rollback -backward -fetchresync=3000 -losttrans="$filename" "*"
echo "================================================"

Here is the output:

================================================
Rolling back any transactions needed to prepare
  for becoming a replicating (secondary) server
  Any rolled back entries will be sent store in:
  /home/ydbuser/jnlex/Unreplic_Trans_Report_20260224233140.txt
CMD: /usr/local/lib/yottadb/r202/mupip journal -rollback -backward -fetchresync=3000 -losttrans='/home/ydbuser/jnlex/Unreplic_Trans_Report_20260224233140.txt' '*'
%YDB-I-MUJNLSTAT, Initial processing started at Tue Feb 24 23:31:40 2026
Replpool semaphore (id = 196629) for replication instance /home/ydbuser/jnlex/paris.repl is in use by another process.
%YDB-E-MUJPOOLRNDWNFL, Jnlpool section (id = 32829) belonging to the replication instance /home/ydbuser/jnlex/paris.repl rund
own failed
%YDB-E-MUNOACTION, MUPIP unable to perform requested action
%YDB-I-FILENOTCREATE, Lost transactions extract file /home/ydbuser/jnlex/Unreplic_Trans_Report_20260224233140.txt not created
%YDB-I-MUJNLSTAT, End processing at Tue Feb 24 23:31:40 2026
================================================

Notice that there are errors.  I don't understand

MUJPOOLRNDWNFL

MUJPOOLRNDWNFL, Jnlpool section (id = xxxx) belonging to the replication instance yyyy rundown failed

MUPIP Error: This indicates that an attempt to run-down the shared memory for a journal pool failed; xxxx is the resource ID of the memory and yyyy is the instance designation.

Action: Analyze the preceding messages for additional information on the failure before attempting the run-down again.


Thanks in advance.
Kevin

Kevin Toppenberg

unread,
Feb 24, 2026, 5:46:17 PM (9 days ago) Feb 24
to Everything MUMPS
I think I fixed it.  It looked like there might have been some hung process.  The error message included "Replpool semaphore (id = 196629) for replication instance /home/ydbuser/jnlex/paris.repl is in use by another process."  So I rebooted the VM server.  Then tried a rollback_resync.  But it complained about missing sequence data from paris.repl.  So I renamed the paris.repl_2026055185833 which had been made as backup, and named it paris.repl.  Then did a rollback_resync, and that all worked OK.  Then did a replication_start and finally it is working!

I'm not sure how I got in that state, but I guess I'm glad to be out of it. 

Thanks
Kevin
Reply all
Reply to author
Forward
0 new messages