Previous report thread has been running......launching report thread anyway

[Vince Skahan]

I've seen two occasions recently where my tiny AWS Lightsail instance got hosed up on the Amazon side with some metrics there leading me to believe their network stack got hammered at the same time, although my webserver and fail2ban logs show nothing unusual incoming.  Guessing (hoping) a hardware issue on the AWS side.

Weewx got a bit shaky (debug=1 log snippet below) as a result.

Digging on the weewx pi, I found the StdReport thread was still processing because the rsync handler never times out when the target system doesn't respond in an expected manner.  A 'ps' command on the pi showed multiple rsync instances on the pi trying to rsync up to the AWS instance, yet never exiting.

Should there be an option to terminate the report thread or the rsync process after some configurable period of time ?

(I might note that after manually rebooting the AWS instance I rsync to weewx recovered just fine, although I did do a killall to nuke the running/hung rsync processes on the weewx pi to try to help a little there).

2026-06-26T08:05:16.337188-07:00 pi5 weewxd-vp2[2225840]: INFO weewx.restx: PWSWeather: Published record 2026-06-26 08:05:00 PDT (1782486300)
2026-06-26T08:05:16.384095-07:00 pi5 weewxd-vp2[2225840]: INFO weewx.restx: Wunderground-PWS: Published record 2026-06-26 08:05:00 PDT (1782486300)
2026-06-26T08:10:15.957476-07:00 pi5 weewxd-vp2[2225840]: INFO weewx.manager: Added record 2026-06-26 08:10:16 PDT (1782486616) to database 'purpleair.sdb'
2026-06-26T08:10:15.957582-07:00 pi5 weewxd-vp2[2225840]: INFO weewx.manager: Added record 2026-06-26 08:10:16 PDT (1782486616) to daily summary in 'purpleair.sdb'
2026-06-26T08:10:15.965598-07:00 pi5 weewxd-vp2[2225840]: INFO weewx.manager: Added record 2026-06-26 08:10:16 PDT (1782486616) to database 'mem.sdb'
2026-06-26T08:10:15.966039-07:00 pi5 weewxd-vp2[2225840]: INFO weewx.manager: Added record 2026-06-26 08:10:16 PDT (1782486616) to daily summary in 'mem.sdb'
2026-06-26T08:10:15.981593-07:00 pi5 weewxd-vp2[2225840]: INFO weewx.manager: Added record 2026-06-26 08:10:00 PDT (1782486600) to database 'vp2.sdb'
2026-06-26T08:10:15.990264-07:00 pi5 weewxd-vp2[2225840]: INFO weewx.manager: Added record 2026-06-26 08:10:00 PDT (1782486600) to daily summary in 'vp2.sdb'
2026-06-26T08:10:15.999248-07:00 pi5 weewxd-vp2[2225840]: INFO weewx.engine: Launch of report thread aborted: existing report thread still running
2026-06-26T08:10:16.182124-07:00 pi5 weewxd-vp2[2225840]: INFO weewx.restx: PWSWeather: Published record 2026-06-26 08:10:00 PDT (1782486600)
2026-06-26T08:10:16.362972-07:00 pi5 weewxd-vp2[2225840]: INFO weewx.restx: Wunderground-PWS: Published record 2026-06-26 08:10:00 PDT (1782486600)
2026-06-26T08:10:56.108734-07:00 pi5 weewxd-vp2[2225840]: INFO weewx.restx: CWOP: Published record 2026-06-26 08:10:00 PDT (1782486600)
2026-06-26T08:15:15.965763-07:00 pi5 weewxd-vp2[2225840]: INFO weewx.manager: Added record 2026-06-26 08:15:16 PDT (1782486916) to database 'purpleair.sdb'
2026-06-26T08:15:15.965861-07:00 pi5 weewxd-vp2[2225840]: INFO weewx.manager: Added record 2026-06-26 08:15:16 PDT (1782486916) to daily summary in 'purpleair.sdb'
2026-06-26T08:15:15.977836-07:00 pi5 weewxd-vp2[2225840]: INFO weewx.manager: Added record 2026-06-26 08:15:16 PDT (1782486916) to database 'mem.sdb'
2026-06-26T08:15:15.978244-07:00 pi5 weewxd-vp2[2225840]: INFO weewx.manager: Added record 2026-06-26 08:15:16 PDT (1782486916) to daily summary in 'mem.sdb'
2026-06-26T08:15:15.995040-07:00 pi5 weewxd-vp2[2225840]: INFO weewx.manager: Added record 2026-06-26 08:15:00 PDT (1782486900) to database 'vp2.sdb'
2026-06-26T08:15:16.002789-07:00 pi5 weewxd-vp2[2225840]: INFO weewx.manager: Added record 2026-06-26 08:15:00 PDT (1782486900) to daily summary in 'vp2.sdb'
2026-06-26T08:15:16.011556-07:00 pi5 weewxd-vp2[2225840]: WARNING weewx.engine: Previous report thread has been running 600.0014319419861 seconds.  Launching report thread anyway.
2026-06-26T08:15:16.237005-07:00 pi5 weewxd-vp2[2225840]: INFO weewx.restx: PWSWeather: Published record 2026-06-26 08:15:00 PDT (1782486900)
2026-06-26T08:15:16.377262-07:00 pi5 weewxd-vp2[2225840]: INFO weewx.restx: Wunderground-PWS: Published record 2026-06-26 08:15:00 PDT (1782486900)
2026-06-26T08:20:15.936584-07:00 pi5 weewxd-vp2[2225840]: INFO weewx.manager: Added record 2026-06-26 08:20:16 PDT (1782487216) to database 'purpleair.sdb'
2026-06-26T08:20:15.937256-07:00 pi5 weewxd-vp2[2225840]: INFO weewx.manager: Added record 2026-06-26 08:20:16 PDT (1782487216) to daily summary in 'purpleair.sdb'
2026-06-26T08:20:15.950013-07:00 pi5 weewxd-vp2[2225840]: INFO weewx.manager: Added record 2026-06-26 08:20:16 PDT (1782487216) to database 'mem.sdb'
2026-06-26T08:20:15.950437-07:00 pi5 weewxd-vp2[2225840]: INFO weewx.manager: Added record 2026-06-26 08:20:16 PDT (1782487216) to daily summary in 'mem.sdb'
2026-06-26T08:20:15.970928-07:00 pi5 weewxd-vp2[2225840]: INFO weewx.manager: Added record 2026-06-26 08:20:00 PDT (1782487200) to database 'vp2.sdb'
2026-06-26T08:20:15.983881-07:00 pi5 weewxd-vp2[2225840]: INFO weewx.manager: Added record 2026-06-26 08:20:00 PDT (1782487200) to daily summary in 'vp2.sdb'
2026-06-26T08:20:15.995132-07:00 pi5 weewxd-vp2[2225840]: INFO weewx.engine: Launch of report thread aborted: existing report thread still running

(and so on)

[Pablo Sanchez]

On 2026-06-26 14:46, Vince Skahan wrote:

[ trimmed ]

Digging on the weewx pi, I found the StdReport thread was still processing because the rsync handler never times out when the target system doesn't respond in an expected manner.  A 'ps' command on the pi showed multiple rsync instances on the pi trying to rsync up to the AWS instance, yet never exiting.

Should there be an option to terminate the report thread or the rsync process after some configurable period of time ?

Hi Vince,

You can handle that via an ssh_config file for the Linux user. If you man ssh_config, it will tell you where ssh searches config files. In my distribution, it can be found here:  ~/.ssh/config

You can use Gen AI to help you create a config file.

Cheers!

---
pablo