blocking io error

79 views
Skip to first unread message

Guy Herrmann

unread,
Jan 26, 2024, 6:16:33 AMJan 26
to idtracker.ai users group
Hi, 
After installation I am coming into the following error (on running indtrackerai_test). This is after the CNN has run. I have tried to reinstall idtracker and running as su without luck. I am on a mac. Just wondering if anyone has any ideas on what the problem might be. Thank you!
Guy
.
         "/opt/homebrew/anaconda3/envs/idtrackerai/lib/python3.11/site-packages/idtrackerai/list_of_fragments.p                  
         y", line 193, in update_id_images_dataset                                                                                
             with h5py.File(path, "r+") as file:                                                                                  
                  ^^^^^^^^^^^^^^^^^^^^^                                                                                          
           File "/opt/homebrew/anaconda3/envs/idtrackerai/lib/python3.11/site-packages/h5py/_hl/files.py", line                  
         562, in __init__                                                                                                        
             fid = make_fid(name, mode, userblock_size, fapl, fcpl, swmr=swmr)                                                    
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^                                                    
           File "/opt/homebrew/anaconda3/envs/idtrackerai/lib/python3.11/site-packages/h5py/_hl/files.py", line                  
         237, in make_fid                                                                                                        
             fid = h5f.open(name, h5f.ACC_RDWR, fapl=fapl)                                                                        
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^                                                                        
           File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper                                                  
           File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper                                                  
           File "h5py/h5f.pyx", line 102, in h5py.h5f.open                                                                        
         BlockingIOError: [Errno 35] Unable to open file (unable to lock file, errno = 35, error message =                        
         'Resource temporarily unavailable')j

idtrackerai

unread,
Jan 26, 2024, 6:37:27 AMJan 26
to idtracker.ai users group
Hi Guy,

Could you please send me the entire log file? You can send it to idtra...@gmail.com or attach it in this thread. Anyway, I haven't seen this error before and I suspect it's related to multiprocessing in MacOS. As a workaround you can disable multiprocessing by setting number_of_parallel_workers=1. You can do this when calling idtrackerai (idtrackerai [...] --number_of_parallel_workers 1) or by defining this parameter in a toml file and loading it with the --load argument. Tell me if this works.

Note: the command idtrackerai_test doesn't accept arguments, it runs as is. You'll have to try the workaround with a "real" tracking. You can use the test_B.avi video that appears when running idtrackerai_test.

Jordi

Guy Herrmann

unread,
Jan 26, 2024, 9:43:45 AMJan 26
to idtracker.ai users group
Hi,
Thanks for getting back to me.
I have tried specifying number of parallel workers, but still no luck. I have included the log file here.
Guy
idtrackerai.log

idtrackerai

unread,
Jan 26, 2024, 10:33:45 AMJan 26
to idtracker.ai users group
Hi Guy,
Thanks for sharing your issue. From your log file, I can see you are working in a "cloud" folder (/CloudStorage/OneDrive-CardiffUniversity). Reading/writting in these syncronized cloud folders can be tricky and idtrackerai does not support them. Try running "idtrackerai_test" in a local folder (not syncronized with any cloud service) and tell me if it works.
Jordi

Guy Herrmann

unread,
Jan 29, 2024, 4:39:52 AMJan 29
to idtracker.ai users group
Hi Jordi,
Unfortunately that doesn't appear to be the issue. I have tried running in a local folder and am recieving the same issue.
Guy
idtrackerai.log

Guy Herrmann

unread,
Jan 29, 2024, 5:08:31 AMJan 29
to idtracker.ai users group
Hi
Sorry, I have run idtrackerai_test and it has worked (above log file is for the video I am trying to track). I got the same error with my data for some reason, but will relook into this and try run it again. Thanks so much for your help!
Guy

--
You received this message because you are subscribed to the Google Groups "idtracker.ai users group" group.
To unsubscribe from this group and stop receiving emails from it, send an email to idtrackerai_us...@googlegroups.com.
To view this discussion on the web, visit https://groups.google.com/d/msgid/idtrackerai_users/89c679a1-fff0-49c8-b02c-41d15256845dn%40googlegroups.com.

idtrackerai

unread,
Feb 8, 2024, 9:34:17 AMFeb 8
to idtracker.ai users group
Hi Guy,

Do you have any update about your issue? Have you solved it? Apparently, there are more MacOS users having the same error you had.

Thanks in advance,
Jordi

Guy Herrmann

unread,
Feb 9, 2024, 6:43:12 AMFeb 9
to idtracker.ai users group
For reference to my previous post, I have a Macbook pro running sonama 14.1 and an M3 chip.
Thanks for you help.
Guy

Guy Herrmann

unread,
Feb 9, 2024, 6:43:27 AMFeb 9
to idtracker.ai users group
Hi Jordi,
Unfortunately I haven't managed to solve the issue. Sometimes when I run idtrackerai_test it works and sometimes not. I haven't worked out what distinguishes this. When I run it on my own video it does not work (I assume because it is longer).
Thank you
Guy

idtrackerai

unread,
Feb 12, 2024, 11:27:08 AMFeb 12
to idtracker.ai users group
Hi Guy and all,

I've been working a bit on this issue.
I don't have a complete solution but I made a patch to bypass the conflicting operations in case they fail. Since, after all, they are not critical operations, the tracking can succeed without them.

Only if you are dealing with this error, please update to the latest alpha version (not stable) of the software with:
        python -m pip install --upgrade --pre idtrackerai

This bypass will be included for the rest of the users in the next stable release.

Jordi

Guy Herrmann

unread,
Feb 19, 2024, 4:58:02 AMFeb 19
to idtracker.ai users group
Hi Jordi.
Thank you for your help!
I have done this and it is working for me now.

thanks
Guy
Reply all
Reply to author
Forward
0 new messages