Hi again,
I am aware that the package is not fully developed; I only want to let you know that there are some performance issues.
Task:
Reproduce UTFVP baseline experiments;
Installation method:
built locally, using commands:
[activate bdt]
cd ./bob.bio.vein
bdt create -vv VEINS_DEV
[activate VEINS_DEV]
buildout
Version
Indicated version in the ``version.txt``: 1.1.7b0
Issiues
Experiments for the NOM dataset took some 15 hours for each -- dev and eval subset, using the command:
% ./bin/bob bio pipelines vanilla-biometrics nom mc utfvp -g eval -l local-parallel -o NOM_EVAL -vv
There were plenty of error messages during the execution (about delayed process execution for a specific core), but eventually, experiments finished producing the combined score file.
However, for ALL protocol:
% ./bin/bob bio pipelines vanilla-biometrics full utfvp mc -l local-parallel -o ALL -vv
I had to stop execution after three days; eventually, the terminal was paralysed with messages like this:
distributed.worker - WARNING - Memory use is high but worker has no data to store to disk. Perhaps some other process is leaking memory? Process memory: 47.60 GB -- Worker memory limit: 67.36 GB
Hope this helps. Will proceed using the stable version. One of the main misunderstandings arises from the fact that if one google e.g. bob.bio.vein, more often than not the master branch version of the docs is the first result, instead of the stable version.
Hope this helps,
Teo
Some screenshots: