Trouble running DeepPixBiS testing code

35 views
Skip to first unread message

Vaibhav Sundharam

unread,
Aug 22, 2020, 7:20:04 PM8/22/20
to bob-devel
Hi all, 

I am trying to run the testing code for Deep Pixel-wise Binary Supervision for Face Presentation Attack Detection for Replay-attack dataset.  I went through the tutorial given on the webpage: https://www.idiap.ch/software/bob/docs/bob/bob.paper.deep_pix_bis_pad.icb2019/master/pix_bis.html . I am able to successfully run preprocessing and training codes as instructed in the link but when I run the the code for testing I am getting the following error:

<pre>(bob.paper.deep_pix_bis_pad.icb2019) <font color="#8AE234"><b>virtual@virtual-VirtualBox</b></font>:<font color="#729FCF"><b>~/Desktop/bob.paper.deep_pix_bis_pad.icb2019-master</b></font>$ bin/spoof.py replay-attack pix_bis --groups train dev eval --protocol grandtest --allow-missing-files --sub-directory /home/virtual/Desktop/Resultsclear
bob.pad.base@2020-08-22 19:02:35,767 -- ERROR: During the execution, an exception was raised: The specified path: `pix_bis&apos; resolved to: `&apos; is not a file, not a entry point name of `bob.bio.config&apos;, nor a module name
Traceback (most recent call last):
  File &quot;bin/spoof.py&quot;, line 34, in &lt;module&gt;
    sys.exit(bob.pad.base.script.spoof.main())
  File &quot;/home/virtual/anaconda3/envs/bob.paper.deep_pix_bis_pad.icb2019/lib/python3.6/site-packages/bob/pad/base/script/spoof.py&quot;, line 284, in main
    args = parse_arguments(command_line_parameters)
  File &quot;/home/virtual/anaconda3/envs/bob.paper.deep_pix_bis_pad.icb2019/lib/python3.6/site-packages/bob/pad/base/script/spoof.py&quot;, line 43, in parse_arguments
    &apos;projection&apos;, &apos;score-computation&apos;])
  File &quot;/home/virtual/anaconda3/envs/bob.paper.deep_pix_bis_pad.icb2019/lib/python3.6/site-packages/bob/pad/base/tools/command_line.py&quot;, line 236, in initialize
    args = tools.parse_config_file(parsers, args, args_dictionary, keywords, skips)
  File &quot;/home/virtual/Desktop/bob.paper.deep_pix_bis_pad.icb2019-master/src/bob.bio.base/bob/bio/base/tools/command_line.py&quot;, line 288, in parse_config_file
    config = utils.read_config_file(args.configuration_file) if args.configuration_file else None
  File &quot;/home/virtual/Desktop/bob.paper.deep_pix_bis_pad.icb2019-master/src/bob.bio.base/bob/bio/base/utils/resources.py&quot;, line 79, in read_config_file
    config = _collect_config(filenames)
  File &quot;/home/virtual/Desktop/bob.paper.deep_pix_bis_pad.icb2019-master/src/bob.bio.base/bob/bio/base/utils/resources.py&quot;, line 48, in _collect_config
    return bob.extension.config.load(paths, entry_point_group=&quot;bob.bio.config&quot;)
  File &quot;/home/virtual/Desktop/bob.paper.deep_pix_bis_pad.icb2019-master/src/bob.extension/bob/extension/config.py&quot;, line 208, in load
    paths, entry_point_group, attribute_name)
  File &quot;/home/virtual/Desktop/bob.paper.deep_pix_bis_pad.icb2019-master/src/bob.extension/bob/extension/config.py&quot;, line 148, in _resolve_entry_point_or_modules
    old_path, path, entry_point_group or &apos;&apos;))
ValueError: The specified path: `pix_bis&apos; resolved to: `&apos; is not a file, not a entry point name of `bob.bio.config&apos;, nor a module name</pre>

Can anyone please help me figure out the cause for this error.


anjit...@gmail.com

unread,
Aug 24, 2020, 3:47:51 AM8/24/20
to bob-devel
Hi, 

Could you run the experiments with other databases?

And can you test with bin/spoof.py replay-attack deep-pix-bis --groups train dev eval --protocol grandtest --allow-missing-files --sub-directory /home/virtual/Desktop/Resultsclear -vvv and report, 

Thanks, 
Anjith

Vaibhav Sundharam

unread,
Aug 25, 2020, 7:37:07 AM8/25/20
to bob-...@googlegroups.com
Hi, 

This method worked and the program preprocessed the test data and also extracted features from the test .hdf5 file but after that following was the traceback.

INFO:bob.pad.base:- Scoring: computing scores for group 'eval'
bob.pad.base@2020-08-25 05:57:04,418 -- INFO: - Scoring: len of current_objects: 80
INFO:bob.pad.base:- Scoring: len of current_objects: 80
bob.pad.base@2020-08-25 05:57:04,418 -- INFO: - Scoring: type of current_objects: real
INFO:bob.pad.base:- Scoring: type of current_objects: real
bob.pad.base@2020-08-25 05:57:04,668 -- INFO: - Scoring: len of current_objects: 400
INFO:bob.pad.base:- Scoring: len of current_objects: 400
bob.pad.base@2020-08-25 05:57:04,668 -- INFO: - Scoring: type of current_objects: attack
INFO:bob.pad.base:- Scoring: type of current_objects: attack
Exception ignored in: <bound method Database.__del__ of <bob.db.replay.query.Database object at 0x7f6f5602c828>>
Traceback (most recent call last):
  File "/home/virtual/anaconda3/envs/bob.paper.deep_pix_bis_pad.icb2019/lib/python3.6/site-packages/bob/db/replay/query.py", line 39, in __del__
  File "/home/virtual/anaconda3/envs/bob.paper.deep_pix_bis_pad.icb2019/lib/python3.6/site-packages/sqlalchemy/engine/base.py", line 1922, in dispose
  File "/home/virtual/anaconda3/envs/bob.paper.deep_pix_bis_pad.icb2019/lib/python3.6/site-packages/sqlalchemy/pool.py", line 1299, in recreate
  File "/home/virtual/anaconda3/envs/bob.paper.deep_pix_bis_pad.icb2019/lib/python3.6/site-packages/sqlalchemy/pool.py", line 265, in __init__
  File "/home/virtual/anaconda3/envs/bob.paper.deep_pix_bis_pad.icb2019/lib/python3.6/site-packages/sqlalchemy/event/base.py", line 142, in _update
  File "/home/virtual/anaconda3/envs/bob.paper.deep_pix_bis_pad.icb2019/lib/python3.6/site-packages/sqlalchemy/event/attr.py", line 347, in _update
  File "/home/virtual/anaconda3/envs/bob.paper.deep_pix_bis_pad.icb2019/lib/python3.6/site-packages/sqlalchemy/event/registry.py", line 113, in _stored_in_collection_multi
KeyError: <weakref at 0x7f6ed46f14a8; to 'function' at 0x7f6f2275d268 (go)>


--
-- You received this message because you are subscribed to the Google Groups bob-devel group. To post to this group, send email to bob-...@googlegroups.com. To unsubscribe from this group, send email to bob-devel+...@googlegroups.com. For more options, visit this group at https://groups.google.com/d/forum/bob-devel or directly the project website at http://idiap.github.com/bob/
---
You received this message because you are subscribed to a topic in the Google Groups "bob-devel" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/bob-devel/x9EEUfVJX5A/unsubscribe.
To unsubscribe from this group and all its topics, send an email to bob-devel+...@googlegroups.com.
To view this discussion on the web, visit https://groups.google.com/d/msgid/bob-devel/b19632c1-e00d-4b2c-9aa3-a38bc9251458n%40googlegroups.com.


--
Regards
Vaibhav Sundharam
Graduate Student 
The Bradley Department of Electrical and Computer Engineering.

Amir Mohammadi

unread,
Aug 31, 2020, 12:02:15 PM8/31/20
to bob-...@googlegroups.com, bob-...@googlegroups.com
That's not an error. That's an ignored exception. You don't need to worry about that. The program finished successfully.

Amir
You received this message because you are subscribed to the Google Groups "bob-devel" group.
To unsubscribe from this group and stop receiving emails from it, send an email to bob-devel+...@googlegroups.com.

Vaibhav Sundharam

unread,
Sep 2, 2020, 9:51:26 AM9/2/20
to bob-...@googlegroups.com
Thank you, but what about the traceback following the ignored exception? 

Amir Mohammadi

unread,
Sep 2, 2020, 11:07:59 AM9/2/20
to bob-...@googlegroups.com, bob-...@googlegroups.com
The tracback is for the ignored exception.

Vaibhav Sundharam

unread,
Sep 2, 2020, 11:16:42 AM9/2/20
to bob-...@googlegroups.com
Thank you for the clarification. So after running this, I just have to run the following command to get the performance matrix?
bob pad metrics \
<RM_FOLDER_TO_SAVE_THE_RESULTS>/grandtest/scores/scores-dev \
-ef <RM_FOLDER_TO_SAVE_THE_RESULTS>/grandtest/scores/scores-eval \
-e

Vaibhav Sundharam

unread,
Sep 10, 2020, 11:15:49 AM9/10/20
to bob-devel
Hi, 
I wanted to run the baseline model as mentioned in "https://www.idiap.ch/software/bob/docs/bob/bob.pad.face/master/baselines.html#bob-pad-face-baselines". I was able to run the "$ spoof.py replay-attack lbp-svm \ --sub-directory <PATH_TO_STORE_THE_RESULTS>" command and have extracted the features as well as the scores but I am not able to run 

evaluate.py \
--dev-files  <PATH_TO_STORE_THE_RESULTS>/grandtest/scores/scores-dev  \
--eval-files <PATH_TO_STORE_THE_RESULTS>/grandtest/scores/scores-eval \
--legends "LBP features of facial region + SVM classifier + REPLAY-ATTACK database" \
-F 7 \
--criterion EER \
--roc <PATH_TO_STORE_THE_RESULTS>/ROC.pdf

anjit...@gmail.com

unread,
Sep 15, 2020, 10:40:30 AM9/15/20
to bob-devel
Hi, 
The `evaluate.py`  script is deprecated . The documentation is updated now. 

Anjith
Reply all
Reply to author
Forward
0 new messages