Copying big size file, How I can know when file has finished completely?

[Manuel Jesús Parra Royón]

Hi, WatchDog give me this log:

2013-05-08 15:55:11 - Modified directory: /private/tmp/mw

2013-05-08 15:55:11 - Created file: /private/tmp/mw/ax.zip

2013-05-08 15:55:15 - Modified file: /private/tmp/mw/ax.zip

2013-05-08 15:55:15 - Modified file: /private/tmp/mw/ax.zip

.....

Two minutes after

.... 

2013-05-08 15:55:46 - Modified file: /private/tmp/mw/ax.zip

2013-05-08 15:55:47 - Modified file: /private/tmp/mw/ax.zip

I copy a file from random folder to folder watchdogg'ed is a long size file.

During the copy Watchdog Module in python always say me Modified file ... , until file is completely copied to the folder and stop giving me more messages, but, 

There are a event to catch that detect when file has finished?

Thanks in advance.

[Nik Kolev]

I just discovered watchdog, so I am not sure if watchdog has what you are asking for built-in. But you should be able to decide when the file finished copying by observing that the target file size is stable for a certain amount of time.

[Manuel Jesús Parra Royón]

Ok, thanks Nik, yes I solved it, by polling this event.

--
You received this message because you are subscribed to a topic in the Google Groups "watchdog-python" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/watchdog-python/qvwHNJK2PKI/unsubscribe?hl=en.
To unsubscribe from this group and all its topics, send an email to watchdog-pyth...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

[Laurent LAPORTE]

Hi,

This is a classic issue (it is worse in FTP).

IMO, the best way is to copy your big file to the watch directory using a temporary (and possibly hidden) name. Then to rename/move it when it is finished.

cp work_dir/my_big.zip watched_dir/.my_big_zip.tmp

mv watched_dir/.my_big_zip.tmp watched_dir/my_big.zip

Configure your watchdog to ignore .*.tmp files...

------- Laurent.

[John Graves]

Could you share your polling code Manuel?

[Manuel Jesús Parra Royón]

Yes, but give me just a few hours, and I can pass my code. on to you

To unsubscribe from this topic, visit https://groups.google.com/d/topic/watchdog-python/qvwHNJK2PKI/unsubscribe.

[John Graves]

We came up with this:

https://gist.github.com/JohnGravesDM/c7199d387f0d508feeac

[Thomas Amland]

Try opening the file for writing. If it fails then a different process is keeping it opened and is probably going to write more.

[Chris Nyland]

John I am interested what os are you on. I recently coding something up for a windows 2008 R2 where we are dumping sometimes large ish files 75MB compressed into a directory and I am using the on_modified event and haven't seen any problems. Is my definition of large to small or are you guys running a different os?

 

Chris