Re: [Earthworm Forum] Issue about slink2ew timestamps

[Paul Friberg]

I recommend running sniffwave on the data in the ring to see that the data in the ring are complete for a given SCNL. Note that it detects gaps and overlaps too. You can send the output to a file and then review the file later. Maybe you can capture the case where your router reboots.

Also, there is a nice feature in slink2ew called MseedRing that allows you to dump TYPE_MSEED into a separate ring and this is what we have ewmseedarchiver archive.

If you have it deal with the uncompressed TYPE_TRACEBUF2 packets, then it is just re-compressing data and wasting CPU cycles and possibly not getting a complete picture if there are problems with the TYPE_TRACEBUF2 overrflowing the ring....just a thought.

Paul

On Thu, Jan 26, 2023 at 8:15 AM El Berto <ra.crs....@gmail.com> wrote:

Hi to all! I'm having some issues about slink2ew on Earthworm v7.10 .

I'm collecting data from seedlink server using 4G router and saving data on disk using mseedarchiver.
I found several gaps on saved mseed files.

Here wave_serverV log example:

20230126_UTC_15:45:29 WARNING: Tracebuf fails validity check, discarding: <M0107.EHE.OY.-->
    packet start=1674747866.34 end=1674747868.41 nsamp=208 samprate=100.00 Tank-endtime=1674747868.41. datatype=[i4]
    packet's start (2023/01/26 15:44:26.34) is before end of tank's last good packet received time (2023/01/26 15:44:28.41)

So I added timestamp control on slink2ew to check packet starttime versus expected starttime of tracebuf data put into ring:

20230126_UTC_13:59:21 network timeout (600s), reconnecting in 30s
20230126_UTC_14:04:39 [ERROR] detected gap: received EHN [1674741731.240000 but expected starttime 1674741733.380000!!!

So I supposed something wrong with Nanometrics digitizer but locally saved mseed are all ok, the same for realtime data collected using SeisGram2K on same server, then I discovered this happens every time 4G router reboots.
So issue is on earthworm side.

Here my slink2ew:

StateFile     #[filename]
#StateFileInt   100
#NetworkTimeout 600
#NetworkDelay   30
#KeepAlive      0
#MaxRate        0

#SLRecSize       512

Is there something wrongly set or should I start debugging mseed packets?
Thanks.

--
--
You received this message because you are subscribed to the Google
Groups "Earthworm Community Forum" group.
 
To post to this group, send an email to earthwo...@googlegroups.com
 
To unsubscribe from this group, send an email to
earthworm_for...@googlegroups.com
 
For more options, visit this group at
http://groups.google.com/group/earthworm_forum?hl=en

---
You received this message because you are subscribed to the Google Groups "Earthworm Community Forum" group.
To unsubscribe from this group and stop receiving emails from it, send an email to earthworm_for...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/earthworm_forum/89070ae7-e682-4764-ac12-9e4259d69e57n%40googlegroups.com.

--

===================================
Paul Friberg   p.fr...@isti.com
CEO/Seismologist
ISTI==Instrumental Software Technologies, Inc.
Phone +1.518.602.0001  

[El Berto]

Goodmorning Paul,

my focus was on slink2ew side because I supposed there was something wrong reading warnings on wave_serverV log, but looking to the code it was just I was receiving double mseed packets due to .state file.
In fact I'm storing strange mseed files, I'll take a look on tbuf2mseed and ewmseedarchiver.
Thanks.

[Paul Friberg]

OK, got it.

Still, I would NOT use tbuf2mseed if you are using slink2ew. Use the MseedRing directive inside slink2ew instead. ewmseedarchiver can read TYPE_MSEED messages directly from this ring but you need to make sure it is a separate ring as there will be many packets.  Note that you can have Tracebuf's go to one ring, and MSEED to another purely for archiving via the ewmseedarchiver.

Cheers,

Paul

To view this discussion on the web visit https://groups.google.com/d/msgid/earthworm_forum/48e68697-b548-4d37-80b9-833fc03d4f71n%40googlegroups.com.

[El Berto]

I'll check your solution but my actual settings already have different rings:

slink2ew -> WAVE_RING
WAVE_RING -> tbuf2mseed -> MSEED_RING
MSEED_RING -> ewmseedarchiver

[Paul Friberg]

Yes, unless you have other non-seedlink data feeds, get rid of tbuf2mseed, it is not necessary and a waste of CPU cycles. You can just do MSEED directly using the method described earlier with the MSeedRing directive. Please let us know if your problem goes away.

Paul

To view this discussion on the web visit https://groups.google.com/d/msgid/earthworm_forum/41798972-5abb-4355-8a28-2cb2761275ffn%40googlegroups.com.

[El Berto]

Goodmorning Paul,

I made a test and it seems working.

Here my actual configuration:

Rings = WAVE_RING, MSEED_RING, HYPO_RING

wave_serverV on WAVE_RING

statmgr on HYPO_RING
copystatus from WAVE_RING to HYPO_RING
slink2ew_1 on MSEED_RING sending TYPE_MSEED

slink2ew_2 on WAVE_RING
tbuf2mseed WAVE_RING => MSEED_RING (for modules collecting data different than seedlink)

ewmseedarchiver on MSEED_RING

Is this configuration correct?
I usually check data using getmenu but it's obviously not working for modules using TYPE_MSEED, how can I check these modules?
Thanks.