ftp upload fails

Chris Thompstone

unread,

Apr 10, 2021, 7:47:08 AM4/10/21

to weewx-user

Hi, thought I'd better start a new topic.

Have just moved to ver 4.5.1 from 3.9.x

Have copied my standard skin over etc, database and so forth.

But I can't use the FTP upload to remote server.

I get the below and it just loops continuously, trying to upload the whole of the www forever. So I have to turn it off, my broadband can't handle it.

It seems to error on the 1 file, if I delete it all, the error will still happen, but moves to a different file.

Apr 10 12:33:04 weewx weewx[7372] DEBUG weeutil.ftpupload: 144 ./NOAA/NOAA-2015-06.txt 3c7a19998d74ef1457dd61e89a1eb848ff84c4ba5956c71b04227262f10507b2

Apr 10 12:33:04 weewx weewx[7372] DEBUG weeutil.ftpupload: Uploaded file /var/www/NOAA/NOAA-2015-06.txt to /NOAA/NOAA-2015-06.txt

Apr 10 12:33:04 weewx weewx[7372] DEBUG weeutil.ftpupload: 145 ./NOAA/NOAA-2015-05.txt f261402ab917dc68cccbe73afb6e88213369a894a30613cc82505ea005923ca7

Apr 10 12:33:04 weewx weewx[7372] DEBUG weeutil.ftpupload: Uploaded file /var/www/NOAA/NOAA-2015-05.txt to /NOAA/NOAA-2015-05.txt

Apr 10 12:33:04 weewx weewx[7372] DEBUG weeutil.ftpupload: 146 ./NOAA/NOAA-2015-04.txt e5dca630c7f48cbd72ad396b4e869a3732497db4580654f6617aa091b443161b

Apr 10 12:33:04 weewx weewx[7372] DEBUG weeutil.ftpupload: Uploaded file /var/www/NOAA/NOAA-2015-04.txt to /NOAA/NOAA-2015-04.txt

Apr 10 12:33:04 weewx weewx[7372] DEBUG weeutil.ftpupload: 147 ./NOAA/NOAA-2015-03.txt 045e6defcc621acc823b67678bab43888cb032d6240d08c8a5db486582c9d19a

Apr 10 12:33:05 weewx weewx[7372] DEBUG weeutil.ftpupload: Uploaded file /var/www/NOAA/NOAA-2015-03.txt to /NOAA/NOAA-2015-03.txt

Apr 10 12:33:05 weewx weewx[7372] DEBUG weeutil.ftpupload: 148 ./NOAA/NOAA-2015-02.txt fe588dc95bf05b3620b7cd40fab59852ad83cf8a2f53c4b232dca8109f6f9c84

Apr 10 12:33:05 weewx weewx[7372] DEBUG weeutil.ftpupload: Uploaded file /var/www/NOAA/NOAA-2015-02.txt to /NOAA/NOAA-2015-02.txt

Apr 10 12:33:05 weewx weewx[7372] DEBUG weeutil.ftpupload: 149 ./NOAA/NOAA-2015-01.txt 05c6e945b3d3980ac4667a9e2f84b3c1d714de8940bfa4f278b4c77837faa6f9

Apr 10 12:33:05 weewx weewx[7372] DEBUG weeutil.ftpupload: Uploaded file /var/www/NOAA/NOAA-2015-01.txt to /NOAA/NOAA-2015-01.txt

Apr 10 12:33:05 weewx weewx[7372] DEBUG weeutil.ftpupload: 150 ./NOAA/NOAA-2014-12.txt 1e4d75393d91b17aa8b7d168425685557833940caab67028c4dd2958aecdf5c7

Apr 10 12:33:06 weewx weewx[7372] DEBUG weeutil.ftpupload: Uploaded file /var/www/NOAA/NOAA-2014-12.txt to /NOAA/NOAA-2014-12.txt

Apr 10 12:33:06 weewx weewx[7372] ERROR weewx.reportengine: ftpgenerator: (2): caught exception '<class 'ftplib.error_perm'>': 553 Prohibited directory name

Apr 10 12:33:06 weewx weewx[7372] ERROR weewx.reportengine: **** Traceback (most recent call last):

Apr 10 12:33:06 weewx weewx[7372] ERROR weewx.reportengine: **** File "/home/weewx/bin/weewx/reportengine.py", line 331, in run

Apr 10 12:33:06 weewx weewx[7372] ERROR weewx.reportengine: **** n = ftp_data.run()

Apr 10 12:33:06 weewx weewx[7372] ERROR weewx.reportengine: **** File "/home/weewx/bin/weeutil/ftpupload.py", line 154, in run

Apr 10 12:33:06 weewx weewx[7372] ERROR weewx.reportengine: **** _make_remote_dir(ftp_server, remote_dir_path)

Apr 10 12:33:06 weewx weewx[7372] ERROR weewx.reportengine: **** File "/home/weewx/bin/weeutil/ftpupload.py", line 269, in _make_remote_dir

Apr 10 12:33:06 weewx weewx[7372] ERROR weewx.reportengine: **** ftp_server.mkd(remote_dir_path)

Apr 10 12:33:06 weewx weewx[7372] ERROR weewx.reportengine: **** File "/usr/lib/python3.7/ftplib.py", line 643, in mkd

Apr 10 12:33:06 weewx weewx[7372] ERROR weewx.reportengine: **** resp = self.voidcmd('MKD ' + dirname)

Apr 10 12:33:06 weewx weewx[7372] ERROR weewx.reportengine: **** File "/usr/lib/python3.7/ftplib.py", line 278, in voidcmd

Apr 10 12:33:06 weewx weewx[7372] ERROR weewx.reportengine: **** return self.voidresp()

Apr 10 12:33:06 weewx weewx[7372] ERROR weewx.reportengine: **** File "/usr/lib/python3.7/ftplib.py", line 251, in voidresp

Apr 10 12:33:06 weewx weewx[7372] ERROR weewx.reportengine: **** resp = self.getresp()

Apr 10 12:33:06 weewx weewx[7372] ERROR weewx.reportengine: **** File "/usr/lib/python3.7/ftplib.py", line 246, in getresp

Apr 10 12:33:06 weewx weewx[7372] ERROR weewx.reportengine: **** raise error_perm(resp)

Apr 10 12:33:06 weewx weewx[7372] ERROR weewx.reportengine: **** ftplib.error_perm: 553 Prohibited directory name

Apr 10 12:33:06 weewx weewx[7372] ERROR weewx.reportengine: ftpgenerator: Upload failed

Tom Keffer

unread,

Apr 10, 2021, 7:53:42 AM4/10/21

to weewx-user

Too bad it doesn't tell us what the directory name is. Try this version of weeutil/ftpload.py. It will log the directory name.

-tk

--
You received this message because you are subscribed to the Google Groups "weewx-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to weewx-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/0203f602-132d-4d03-80de-c1b1b6c8e396n%40googlegroups.com.

ftpupload.py

Chris Thompstone

unread,

Apr 10, 2021, 8:02:44 AM4/10/21

to weewx-user

Thanks,

Looks like there is a . directory in there somehow it doesn't like

Apr 10 13:01:09 weewx weewx[7765] DEBUG weeutil.ftpupload: Uploaded file /var/www/NOAA/NOAA-2015-01.txt to /NOAA/NOAA-2015-01.txt

Apr 10 13:01:09 weewx weewx[7765] DEBUG weeutil.ftpupload: 150 ./NOAA/NOAA-2014-12.txt 1e4d75393d91b17aa8b7d168425685557833940caab67028c4dd2958aecdf5c7

Apr 10 13:01:10 weewx weewx[7765] DEBUG weeutil.ftpupload: Uploaded file /var/www/NOAA/NOAA-2014-12.txt to /NOAA/NOAA-2014-12.txt

Apr 10 13:01:10 weewx weewx[7765] ERROR weeutil.ftpupload: Error creating directory /.gnupg

Apr 10 13:01:10 weewx weewx[7765] ERROR weewx.reportengine: ftpgenerator: (0): caught exception '<class 'ftplib.error_perm'>': 553 Prohibited directory name

Apr 10 13:01:10 weewx weewx[7765] ERROR weewx.reportengine: **** Traceback (most recent call last):

Apr 10 13:01:10 weewx weewx[7765] ERROR weewx.reportengine: **** File "/home/weewx/bin/weewx/reportengine.py", line 331, in run

Apr 10 13:01:10 weewx weewx[7765] ERROR weewx.reportengine: **** n = ftp_data.run()

Apr 10 13:01:10 weewx weewx[7765] ERROR weewx.reportengine: **** File "/home/weewx/bin/weeutil/ftpupload.py", line 154, in run

Apr 10 13:01:10 weewx weewx[7765] ERROR weewx.reportengine: **** _make_remote_dir(ftp_server, remote_dir_path)

Apr 10 13:01:10 weewx weewx[7765] ERROR weewx.reportengine: **** File "/home/weewx/bin/weeutil/ftpupload.py", line 269, in _make_remote_dir

Apr 10 13:01:10 weewx weewx[7765] ERROR weewx.reportengine: **** ftp_server.mkd(remote_dir_path)

Apr 10 13:01:10 weewx weewx[7765] ERROR weewx.reportengine: **** File "/usr/lib/python3.7/ftplib.py", line 643, in mkd

Apr 10 13:01:10 weewx weewx[7765] ERROR weewx.reportengine: **** resp = self.voidcmd('MKD ' + dirname)

Apr 10 13:01:10 weewx weewx[7765] ERROR weewx.reportengine: **** File "/usr/lib/python3.7/ftplib.py", line 278, in voidcmd

Apr 10 13:01:10 weewx weewx[7765] ERROR weewx.reportengine: **** return self.voidresp()

Apr 10 13:01:10 weewx weewx[7765] ERROR weewx.reportengine: **** File "/usr/lib/python3.7/ftplib.py", line 251, in voidresp

Apr 10 13:01:10 weewx weewx[7765] ERROR weewx.reportengine: **** resp = self.getresp()

Apr 10 13:01:10 weewx weewx[7765] ERROR weewx.reportengine: **** File "/usr/lib/python3.7/ftplib.py", line 246, in getresp

Apr 10 13:01:10 weewx weewx[7765] ERROR weewx.reportengine: **** raise error_perm(resp)

Apr 10 13:01:10 weewx weewx[7765] ERROR weewx.reportengine: **** ftplib.error_perm: 553 Prohibited directory name

Tom Keffer

unread,

Apr 10, 2021, 8:07:36 AM4/10/21

to weewx-user

Somehow a directory name of ".gnupg" snuck into /var/www. Get rid of it, and all should be well.

To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/8980b7bb-2cdc-4e7f-abeb-4320177935fdn%40googlegroups.com.

Chris Thompstone

unread,

Apr 10, 2021, 8:13:44 AM4/10/21

to weewx-user

Just testing now, first loop after the restart went well, Just want to check how many files upload on the next.

No idea where that directory came from, but will it reappear again?

Will test the driver in a min, when sorted this...

Thanks

Chris

Chris Thompstone

unread,

Apr 10, 2021, 8:24:06 AM4/10/21

to weewx-user

Yeah all seems good. Can I suggest a check for . files and . directories and don't allow ftp upload on those. For a future version?

Thanks a pleasure as always.

Regards to all.

Tom Keffer

unread,

Apr 10, 2021, 8:55:01 AM4/10/21

to weewx-user

Whether to allow "dot" directories to be uploaded is a policy of the FTP server, not the client.

With the revised version of ftpupload.py it will at least tell you the directory name.

To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/aee86140-9240-4953-94c1-b23b98a3b3c8n%40googlegroups.com.

Reply all

Reply to author

Forward