Trouble running DeepPixBiS testing code

[Vaibhav Sundharam]

Hi all, 

I am trying to run the testing code for Deep Pixel-wise Binary Supervision for Face Presentation Attack Detection for Replay-attack dataset.  I went through the tutorial given on the webpage: https://www.idiap.ch/software/bob/docs/bob/bob.paper.deep_pix_bis_pad.icb2019/master/pix_bis.html . I am able to successfully run preprocessing and training codes as instructed in the link but when I run the the code for testing I am getting the following error:

<pre>(bob.paper.deep_pix_bis_pad.icb2019) <font color="#8AE234"><b>virtual@virtual-VirtualBox</b></font>:<font color="#729FCF"><b>~/Desktop/bob.paper.deep_pix_bis_pad.icb2019-master</b></font>$ bin/spoof.py replay-attack pix_bis --groups train dev eval --protocol grandtest --allow-missing-files --sub-directory /home/virtual/Desktop/Resultsclear

bob.pad.base@2020-08-22 19:02:35,767 -- ERROR: During the execution, an exception was raised: The specified path: `pix_bis&apos; resolved to: `&apos; is not a file, not a entry point name of `bob.bio.config&apos;, nor a module name

Traceback (most recent call last):

  File &quot;bin/spoof.py&quot;, line 34, in &lt;module&gt;

    sys.exit(bob.pad.base.script.spoof.main())

  File &quot;/home/virtual/anaconda3/envs/bob.paper.deep_pix_bis_pad.icb2019/lib/python3.6/site-packages/bob/pad/base/script/spoof.py&quot;, line 284, in main

    args = parse_arguments(command_line_parameters)

  File &quot;/home/virtual/anaconda3/envs/bob.paper.deep_pix_bis_pad.icb2019/lib/python3.6/site-packages/bob/pad/base/script/spoof.py&quot;, line 43, in parse_arguments

    &apos;projection&apos;, &apos;score-computation&apos;])

  File &quot;/home/virtual/anaconda3/envs/bob.paper.deep_pix_bis_pad.icb2019/lib/python3.6/site-packages/bob/pad/base/tools/command_line.py&quot;, line 236, in initialize

    args = tools.parse_config_file(parsers, args, args_dictionary, keywords, skips)

  File &quot;/home/virtual/Desktop/bob.paper.deep_pix_bis_pad.icb2019-master/src/bob.bio.base/bob/bio/base/tools/command_line.py&quot;, line 288, in parse_config_file

    config = utils.read_config_file(args.configuration_file) if args.configuration_file else None

  File &quot;/home/virtual/Desktop/bob.paper.deep_pix_bis_pad.icb2019-master/src/bob.bio.base/bob/bio/base/utils/resources.py&quot;, line 79, in read_config_file

    config = _collect_config(filenames)

  File &quot;/home/virtual/Desktop/bob.paper.deep_pix_bis_pad.icb2019-master/src/bob.bio.base/bob/bio/base/utils/resources.py&quot;, line 48, in _collect_config

    return bob.extension.config.load(paths, entry_point_group=&quot;bob.bio.config&quot;)

  File &quot;/home/virtual/Desktop/bob.paper.deep_pix_bis_pad.icb2019-master/src/bob.extension/bob/extension/config.py&quot;, line 208, in load

    paths, entry_point_group, attribute_name)

  File &quot;/home/virtual/Desktop/bob.paper.deep_pix_bis_pad.icb2019-master/src/bob.extension/bob/extension/config.py&quot;, line 148, in _resolve_entry_point_or_modules

    old_path, path, entry_point_group or &apos;&apos;))

ValueError: The specified path: `pix_bis&apos; resolved to: `&apos; is not a file, not a entry point name of `bob.bio.config&apos;, nor a module name</pre>

Can anyone please help me figure out the cause for this error.

[anjit...@gmail.com]

Hi, 

Could you run the experiments with other databases?

And can you test with bin/spoof.py replay-attack deep-pix-bis --groups train dev eval --protocol grandtest --allow-missing-files --sub-directory /home/virtual/Desktop/Resultsclear -vvv and report, 

Thanks, 

Anjith

[Vaibhav Sundharam]

Hi, 

This method worked and the program preprocessed the test data and also extracted features from the test .hdf5 file but after that following was the traceback.

INFO:bob.pad.base:- Scoring: computing scores for group 'eval'

bob.pad.base@2020-08-25 05:57:04,418 -- INFO: - Scoring: len of current_objects: 80

INFO:bob.pad.base:- Scoring: len of current_objects: 80

bob.pad.base@2020-08-25 05:57:04,418 -- INFO: - Scoring: type of current_objects: real

INFO:bob.pad.base:- Scoring: type of current_objects: real

bob.pad.base@2020-08-25 05:57:04,668 -- INFO: - Scoring: len of current_objects: 400

INFO:bob.pad.base:- Scoring: len of current_objects: 400

bob.pad.base@2020-08-25 05:57:04,668 -- INFO: - Scoring: type of current_objects: attack

INFO:bob.pad.base:- Scoring: type of current_objects: attack

Exception ignored in: <bound method Database.__del__ of <bob.db.replay.query.Database object at 0x7f6f5602c828>>

Traceback (most recent call last):

  File "/home/virtual/anaconda3/envs/bob.paper.deep_pix_bis_pad.icb2019/lib/python3.6/site-packages/bob/db/replay/query.py", line 39, in __del__

  File "/home/virtual/anaconda3/envs/bob.paper.deep_pix_bis_pad.icb2019/lib/python3.6/site-packages/sqlalchemy/engine/base.py", line 1922, in dispose

  File "/home/virtual/anaconda3/envs/bob.paper.deep_pix_bis_pad.icb2019/lib/python3.6/site-packages/sqlalchemy/pool.py", line 1299, in recreate

  File "/home/virtual/anaconda3/envs/bob.paper.deep_pix_bis_pad.icb2019/lib/python3.6/site-packages/sqlalchemy/pool.py", line 265, in __init__

  File "/home/virtual/anaconda3/envs/bob.paper.deep_pix_bis_pad.icb2019/lib/python3.6/site-packages/sqlalchemy/event/base.py", line 142, in _update

  File "/home/virtual/anaconda3/envs/bob.paper.deep_pix_bis_pad.icb2019/lib/python3.6/site-packages/sqlalchemy/event/attr.py", line 347, in _update

  File "/home/virtual/anaconda3/envs/bob.paper.deep_pix_bis_pad.icb2019/lib/python3.6/site-packages/sqlalchemy/event/registry.py", line 113, in _stored_in_collection_multi

KeyError: <weakref at 0x7f6ed46f14a8; to 'function' at 0x7f6f2275d268 (go)>

--
-- You received this message because you are subscribed to the Google Groups bob-devel group. To post to this group, send email to bob-...@googlegroups.com. To unsubscribe from this group, send email to bob-devel+...@googlegroups.com. For more options, visit this group at https://groups.google.com/d/forum/bob-devel or directly the project website at http://idiap.github.com/bob/
---
You received this message because you are subscribed to a topic in the Google Groups "bob-devel" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/bob-devel/x9EEUfVJX5A/unsubscribe.
To unsubscribe from this group and all its topics, send an email to bob-devel+...@googlegroups.com.
To view this discussion on the web, visit https://groups.google.com/d/msgid/bob-devel/b19632c1-e00d-4b2c-9aa3-a38bc9251458n%40googlegroups.com.

--

Regards

Vaibhav Sundharam

Graduate Student 

The Bradley Department of Electrical and Computer Engineering.

[Amir Mohammadi]

That's not an error. That's an ignored exception. You don't need to worry about that. The program finished successfully.

Amir

You received this message because you are subscribed to the Google Groups "bob-devel" group.

To unsubscribe from this group and stop receiving emails from it, send an email to bob-devel+...@googlegroups.com.

To view this discussion on the web, visit https://groups.google.com/d/msgid/bob-devel/CABSdJ815HGdwa5TURdT5WOfo%3DWNWqonLEWBjbg4fxAzuZLNRHw%40mail.gmail.com.

[Vaibhav Sundharam]

Thank you, but what about the traceback following the ignored exception? 

To view this discussion on the web, visit https://groups.google.com/d/msgid/bob-devel/B9C67AC3-5FA4-42B9-B9A0-565A0BFB703A%40getmailspring.com.

[Amir Mohammadi]

The tracback is for the ignored exception.

To view this discussion on the web, visit https://groups.google.com/d/msgid/bob-devel/CABSdJ82S06jSVWEFjR8K3C0yqXZtCr4fC8F2M-YJJQ6UX%3Dt%2Baw%40mail.gmail.com.

[Vaibhav Sundharam]

Thank you for the clarification. So after running this, I just have to run the following command to get the performance matrix?

bob pad metrics \
<RM_FOLDER_TO_SAVE_THE_RESULTS>/grandtest/scores/scores-dev \
-ef <RM_FOLDER_TO_SAVE_THE_RESULTS>/grandtest/scores/scores-eval \
-e

To view this discussion on the web, visit https://groups.google.com/d/msgid/bob-devel/1D2A1D25-AD58-4760-81F2-09CB5755E3B5%40getmailspring.com.

[Vaibhav Sundharam]

Hi, 

I wanted to run the baseline model as mentioned in "https://www.idiap.ch/software/bob/docs/bob/bob.pad.face/master/baselines.html#bob-pad-face-baselines". I was able to run the "$ spoof.py replay-attack lbp-svm \ --sub-directory <PATH_TO_STORE_THE_RESULTS>" command and have extracted the features as well as the scores but I am not able to run 

evaluate.py \

--dev-files  <PATH_TO_STORE_THE_RESULTS>/grandtest/scores/scores-dev  \

--eval-files <PATH_TO_STORE_THE_RESULTS>/grandtest/scores/scores-eval \

--legends "LBP features of facial region + SVM classifier + REPLAY-ATTACK database" \

-F 7 \

--criterion EER \

--roc <PATH_TO_STORE_THE_RESULTS>/ROC.pdf

[anjit...@gmail.com]

Hi, 

The `evaluate.py`  script is deprecated . The documentation is updated now. 

https://www.idiap.ch/software/bob/docs/bob/bob.pad.face/master/baselines.html#bob-pad-face-baselines

Anjith