Getting rid of "(Evaluation)" in ROC title

13 views
Skip to first unread message

Vedrana Krivokuca

unread,
Jun 4, 2018, 6:02:00 AM6/4/18
to bob-devel
Hi guys,

I am using "bob bio roc" to plot ROC curves for several systems on the same plot, separately for "dev" and "eval" sets.  I am just interested in the "eval" set, so I don't really need it to say "(Evaluation)" in the title of the ROC.  How can I get rid of this?  Alternatively, is there another command I can use to plot just the "eval" ROC curves and then fully specify my own title?

Thank you!

Vedrana

Amir Mohammadi

unread,
Jun 4, 2018, 6:15:52 AM6/4/18
to bob-...@googlegroups.com
Hi Vedrana,

The script provide a couple of options where I think providing `-t ' '` and `-la ' '` should help you.
In order to have just the eval set, look at the --no-evaluation option but provide eval scores instead of the requested dev scores.

Options:
  -t, --title TEXT                The title of the plots. Provide just a space
                                  (-t ' ') to remove the titles from figures.
  -lg, --legends TEXT             The title for each system comma separated.
                                  Example: --legends ISV,CNN
  -lc, --legend-loc [best|upper-right|upper-left|lower-left|lower-right|right|center-left|center-right|lower-center|upper-center|center]
                                  The legend location code
  -dl, --disp-legend / --no-disp-legend
                                  If set, no legend will be printed.
                                  [default: True]
  -s, --split / --no-split        If set, evaluation and dev curve in
                                  different plots  [default: True]
  -o, --output TEXT               The file to save the plots in.  [default:
                                  roc.pdf]
  -e, --evaluation / --no-evaluation
                                  If set, evaluation scores must be provided
                                  [default: True]
  -n, --points INTEGER            The number of points use to draw curves in
                                  plots  [default: 100]
  -G, --semilogx / --no-semilogx  If set, use semilog on X axis  [default:
                                  True]
  -L, --axlim TEXT                min/max axes values separated by commas
                                  (e.g. ``--axlim  0.1,100,0.1,100``) Provide
                                  just a space (' ') to cancel default values.
  -r, --x-rotation INTEGER        X axis labels ration  [default: 0]
  -la, --lines-at TEXT            If given, draw vertical lines at the given
                                  axis positions. Your values must be
                                  separated with a comma (,) without space.
                                  Provide just a space (' ') to cancel default
                                  values.  [default: 1e-3]
  -xl, --x-lable TEXT             Label for x-axis
  -yl, --y-lable TEXT             Label for y-axis
  -Y, --clayout / --no-clayout    (De)Activate constrained layout  [default:
                                  True]
  --style [Solarize_Light2|_classic_test|bmh|classic|dark_background|fast|fivethirtyeight|ggplot|grayscale|seaborn|seaborn-bright|seaborn-colorblind|seaborn-dark|seaborn-dark-palette|seaborn-darkgrid|seaborn-deep|seaborn-muted|seaborn-notebook|seaborn-paper|seaborn-pastel|seaborn-poster|seaborn-talk|seaborn-ticks|seaborn-white|seaborn-whitegrid|tableau-colorblind10]
                                  The matplotlib style to use for plotting.
                                  You can provide multiple styles by repeating
                                  this option
  -S, --line-linestyles / --no-line-linestyles
                                  If given, applies a different linestyles to
                                  each line.  [default: False]
  --figsize TEXT                  If given, will run
                                  ``plt.rcParams['figure.figsize']=figsize)``.
                                  Example: --fig-size 4,6  [default: 4,3]
  -M, --min-far-value FLOAT       Select the minimum FAR value used in ROC and
                                  DET plots; should be a power of 10.
                                  [default: 0.0001]
  -v, --verbose                   Increase the verbosity level from 0 (only
                                  error messages) to 1 (warnings), 2 (log
                                  messages), 3 (debug information) by adding
                                  the --verbose option as often as desired
                                  (e.g. '-vvv' for debug).
  --help                          Show this message and exit.


--
-- You received this message because you are subscribed to the Google Groups bob-devel group. To post to this group, send email to bob-...@googlegroups.com. To unsubscribe from this group, send email to bob-devel+...@googlegroups.com. For more options, visit this group at https://groups.google.com/d/forum/bob-devel or directly the project website at http://idiap.github.com/bob/
---
You received this message because you are subscribed to the Google Groups "bob-devel" group.
To unsubscribe from this group and stop receiving emails from it, send an email to bob-devel+...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Vedrana Krivokuca

unread,
Jun 4, 2018, 6:23:50 AM6/4/18
to bob-devel
Hi Amir,

Thanks for your reply.  In fact, I already tried this earlier, but "(Development)" was then added to the end of my title instead of "(Evaluation)", thereby not solving the problem ...

Amir Mohammadi

unread,
Jun 4, 2018, 6:29:13 AM6/4/18
to bob-...@googlegroups.com
Hi Vedrana,

I see. While
bin/bob bio roc -t ' ' -la ' ' --no-evaluation scores-eval
works but something like:
bin/bob bio roc -t 'something' -la ' ' --no-evaluation scores-eval
does not work.

IMO this is a bug which you can report at bob.bio.base.

Best,
Amir

Vedrana Krivokuca

unread,
Jun 4, 2018, 8:11:35 AM6/4/18
to bob-devel
OK, thank you, I will report it as an Issue in bob.bio.base.
Reply all
Reply to author
Forward
0 new messages