Error trying to upload to sondehub

266 views
Skip to first unread message

Graham c

unread,
Feb 10, 2022, 7:36:12 PM2/10/22
to radiosonde_auto_rx

Using radiosonde_auto_rx and has been working very well.

Recently I noticed that received data was not being uploaded to SondeHub BUT when I checked on the SondeHub web page for my station, the station was were it should it be and shows the correct version of the software and a recent date-time for last contact.

I updated to the most recent version 1.5.9. Checked and double checked the station.cfg file to no avail

Raspberry Pi running Buster

snippet from journalctl -u auto_rx.service -f -n

Feb 11 00:16:49 SondeAutoRX auto_rx[350]: 2022-02-11 00:16:49,601 ERROR:Sondehub Uploader - Error uploading to Sondehub. Status Code: 202 {"message": "some or all payloads could not be processed", "errors": [{"error_message": "DFM radiosonde above 1000 and not enough data to perform z-check. Not adding DB to protect against double frequency usage.", "payload": {"software_name": "radiosonde_auto_rx", "software_version": "1.5.9", "uploader_callsign": "Embrun_ON", "uploader_position": [45.3, -75.3, 75.0], "uploader_antenna": "5/8 wave monopole", "time_received": "2022-02-11T00:16:39.497870Z", "datetime": "2022-02-11T00:16:38.000000Z", "manufacturer": "Graw", "type": "DFM", "subtype": "DFM09P", "serial": "20049018", "frame": 1328573798, "lat": 46.30068, "lon": -75.37315, "alt": 3725.04, "temp": -24.6, "vel_v": -3.51, "vel_h": 12.93, "heading": 111.83, "sats": 9, "batt": 4.98, "frequency": 403.009, "snr": 17.5, "dfm_failure": true}}, {"error_message": "DFM radiosonde above 1000 and not enough data to perform z-check. Not adding DB to protect against double frequency usage.", "payload": {"software_name": "radiosonde_auto_rx", "software_version": "1.5.9", "uploader_callsign": "Embrun_ON", "uploader_position": [45.3, -75.3, 75.0], "uploader_antenna": "5/8 wave monopole", "time_received": "2022-02-11T00:16:40.404404Z", "datetime": "2022-02-11T00:16:39.000000Z", "manufacturer": "Graw", "type": "DFM", "subtype": "DFM09P", "serial": "20049018", "frame": 1328573799, "lat": 46.30064, "lon": -75.373, "alt": 3721.19, "temp": -24.6, "vel_v": -3.81, "vel_h": 12.71, "heading": 110.64, "sats": 9, "batt": 4.98, "frequency": 403.009, "snr": 17.9, "dfm_failure": true}}, {"error_message": "DFM radiosonde above 1000 and not enough data to perform z-check. Not adding DB to protect against double frequency usage.", "payload": {"software_name": "radiosonde_auto_rx", "software_version": "1.5.9", "uploader_callsign": "Embrun_ON", "uploader_position": [45.3, -75.3, 75.0], "uploader_antenna": "5/8 wave monopole", "time_received": "2022-02-11T00:16:41.510843Z", "datetime": "2022-02-11T00:16:40.000000Z", "manufacturer": "Graw", "type": "DFM", "subtype": "DFM09P", "serial": "20049018", "frame": 1328573800, "lat": 46.3006, "lon": -75.37285, "alt": 3717.48, "temp": -24.6, "vel_v": -3.7, "vel_h": 12.33, "heading": 109.41, "sats": 9, "batt": 4.97, "frequency": 403.009, "snr": 17.9, "dfm_failure": true}}, {"error_message": "DFM radiosonde above 1000 and not enough data to perform z-check. Not adding DB to protect against double frequency usage.", "payload": {"software_name": "radiosonde_auto_rx", "software_version": "1.5.9", "uploader_callsign": "Embrun_ON", "uploader_position": [45.3, -75.3, 75.0], "uploader_antenna": "5/8 wave monopole", "time_received": "2022-02-11T00:16:42.415179Z", "datetime": "2022-02-11T00:16:41.000000Z", "manufacturer": "Graw", "type": "DFM", "subtype": "DFM09P", "serial": "20049018", "frame": 1328573801, "lat": 46.30057, "lon": -75.37269, "alt": 3713.9, "temp": -24.5, "vel_v": -3.59, "vel_h": 12.15, "heading": 107.46, "sats": 9, "batt": 4.97, "frequency": 403.009, "snr": 17.4, "dfm_failure": true}}, {"error_message": "DFM radiosonde above 1000 and not enough data to perform z-check. Not adding DB to protect against double frequency usage.", "payload": {"software_name": "radiosonde_auto_rx", "software_version": "1.5.9", "uploader_callsign": "Embrun_ON", "uploader_position": [45.3, -75.3, 75.0], "uploader_antenna": "5/8 wave monopole", "time_received": "2022-02-11T00:16:43.519902Z", "datetime": "2022-02-11T00:16:42.000000Z", "manufacturer": "Graw", "type": "DFM", "subtype": "DFM09P", "serial": "20049018", "frame": 1328573802, "lat": 46.30053, "lon": -75.37254, "alt": 3710.21, "temp": -24.5, "vel_v": -3.75, "vel_h": 12.36, "heading": 106.66, "sats": 9, "batt": 4.97, "frequency": 403.009, "snr": 17.4, "dfm_failure": true}}, {"error_message": "DFM radiosonde above 1000 and not enough data to perform z-check. Not adding DB to protect against double frequency usage.", "payload": {"software_name": "radiosonde_auto_rx", "software_version": "1.5.9", "uploader_callsign": "Embrun_ON", "uploader_position": [45.3, -75.3, 75.0], "uploader_antenna": "5/8 wave monopole", "time_received": "2022-02-11T00:16:44.424294Z", "datetime": "2022-02-11T00:16:43.000000Z", "manufacturer": "Graw", "type": "DFM", "subtype": "DFM09P", "serial": "20049018", "frame": 1328573803, "lat": 46.3005, "lon": -75.37239, "alt": 3706.66, "temp": -24.4, "vel_v": -3.59, "vel_h": 12.68, "heading": 105.42, "sats": 9, "batt": 4.97, "frequency": 403.009, "snr": 17.4, "dfm_failure": true}}, {"error_message": "DFM radiosonde above 1000 and not enough data to perform z-check. Not adding DB to protect against double frequency usage.", "payload": {"software_name": "radiosonde_auto_rx", "software_version": "1.5.9", "uploader_callsign": "Embrun_ON", "uploader_position": [45.3, -75.3, 75.0], "uploader_antenna": "5/8 wave monopole", "time_received": "2022-02-11T00:16:45.529099Z", "datetime": "2022-02-11T00:16:44.000000Z", "manufacturer": "Graw", "type": "DFM", "subtype": "DFM09P", "serial": "20049018", "frame": 1328573804, "lat": 46.30047, "lon": -75.37223, "alt": 3703.18, "temp": -24.4, "vel_v": -3.45, "vel_h": 13.01, "heading": 105.28, "sats": 9, "batt": 4.97, "frequency": 403.009, "snr": 16.8, "dfm_failure": true}}, {"error_message": "DFM radiosonde above 1000 and not enough data to perform z-check. Not adding DB to protect against double frequency usage.", "payload": {"software_name": "radiosonde_auto_rx", "software_version": "1.5.9", "uploader_callsign": "Embrun_ON", "uploader_position": [45.3, -75.3, 75.0], "uploader_antenna": "5/8 wave monopole", "time_received": "2022-02-11T00:16:46.433590Z", "datetime": "2022-02-11T00:16:45.000000Z", "manufacturer": "Graw", "type": "DFM", "subtype": "DFM09P", "serial": "20049018", "frame": 1328573805, "lat": 46.30044, "lon": -75.37206, "alt": 3699.89, "temp": -24.4, "vel_v": -3.48, "vel_h": 13.24, "heading": 107.11, "sats": 9, "batt": 4.97, "frequency": 403.009, "snr": 15.4, "dfm_failure": true}}, {"error_message": "DFM radiosonde above 1000 and not enough data to perform z-check. Not adding DB to protect against double frequency usage.", "payload": {"software_name": "radiosonde_auto_rx", "software_version": "1.5.9", "uploader_callsign": "Embrun_ON", "uploader_position": [45.3, -75.3, 75.0], "uploader_antenna": "5/8 wave monopole", "time_received": "2022-02-11T00:16:47.638698Z", "datetime": "2022-02-11T00:16:46.000000Z", "manufacturer": "Graw", "type": "DFM", "subtype": "DFM09P", "serial": "20049018", "frame": 1328573806, "lat": 46.3004, "lon": -75.3719, "alt": 3697.06, "temp": -24.4, "vel_v": -3.11, "vel_h": 13.38, "heading": 109.39, "sats": 9, "batt": 4.97, "frequency": 403.009, "snr": 15.5, "dfm_failure": true}}, {"error_message": "DFM radiosonde above 1000 and not enough data to perform z-check. Not adding DB to protect against double frequency usage.", "payload": {"software_name": "radiosonde_auto_rx", "software_version": "1.5.9", "uploader_callsign": "Embrun_ON", "uploader_position": [45.3, -75.3, 75.0], "uploader_antenna": "5/8 wave monopole", "time_received": "2022-02-11T00:16:48.543310Z", "datetime": "2022-02-11T00:16:47.000000Z", "manufacturer": "Graw", "type": "DFM", "subtype": "DFM09P", "serial": "20049018", "frame": 1328573807, "lat": 46.30036, "lon": -75.37174, "alt": 3693.75, "temp": -24.3, "vel_v": -3.39, "vel_h": 13.27, "heading": 110.09, "sats": 9, "batt": 4.97, "frequency": 403.009, "snr": 15.9, "dfm_failure": true}}]}.
Feb 11 00:16:49 SondeAutoRX auto_rx[350]: 2022-02-11 00:16:49,602 ERROR:Sondehub Uploader - Upload failed after 0 retries

But it only seems to a problem for DFM06 sondes.

I have run out of ideas on what to check that might be the problem.

Any ideas?

cheers, Graham

Graham c

unread,
Feb 10, 2022, 7:46:59 PM2/10/22
to radiosonde_auto_rx
Should be DFM09P sondes

RS41 sonde data gets uploaded without error

cheers, Graham


Michaela Wheeler

unread,
Feb 10, 2022, 9:13:26 PM2/10/22
to radiosonde_auto_rx
--
You received this message because you are subscribed to the Google Groups "radiosonde_auto_rx" group.
To unsubscribe from this group and stop receiving emails from it, send an email to radiosonde_auto...@googlegroups.com.

Graham c

unread,
Feb 11, 2022, 7:48:20 AM2/11/22
to radiosonde_auto_rx

Thank you Michaela.

That adds a bit of understanding to the error message.

However, why have suddenly uploads starting giving this error whereas not so long ago uploads worked fine?

What has changed? Anything? Something on the server side?

These DFM09P sondes that I copy every day are launched some distance from my location and I only ever start receiving them when they are above 1000m. In fact, they are the only DFM09 type sondes in the area, everything else are RS41 or LMS6.

I think I have figured out a fix - change this value in station.cfg

sondehub_upload_rate = 10

from ( in my case and I don't know why my .cfg file was set to 10 ) 10 to 20 seconds.

I see that the master station.cfg on the wiki is 15

Thank you for your help

cheers, Graham

Michaela Wheeler

unread,
Feb 11, 2022, 2:21:42 PM2/11/22
to radiosonde_auto_rx
It's a recent backend change we made as we've been having several cases of the issue reported to us recently so felt that we had to implement something to reduce the issue. Unfortunately due to how DFMs work there's not a huge amount we can do and this appears to be the best compromise at the moment.

-- 
  Michaela Wheeler

Mark Jessop

unread,
Feb 12, 2022, 12:53:44 AM2/12/22
to Michaela Wheeler, radiosonde_auto_rx
There are some modifications to the DFM decoder in the current testing release (1.5.10-beta1) that may help limit the telemetry corruption we have been seeing, however the filtering on sondehub may still be a bit overzealous.

I really need some stations in areas where multiple DFMs are seen to test it out, and submit some recordings so we can be sure it's working. Then once we have a critical mass of stations on v1.5.10, we can probably reduce the filtering.

73
Mark VK5QI

To view this discussion on the web visit https://groups.google.com/d/msgid/radiosonde_auto_rx/69b15224-0c2e-4b23-8709-600b66d0e20e%40www.fastmail.com.
Reply all
Reply to author
Forward
0 new messages