Query regarding Keystroke Biometrics Ongoing Competition on Beat platform

[Souraj Adhikary]

Hi,

I initially mailed to Dr. Sebastien Marcel about my queries. He pointed me to the Google group.

I want to participate in the KBOC on Beat platform. It is mentioned on https://sites.google.com/site/btas16kboc/home that there are two modes of participation- 

-online

-offline

Assuming I want to participate online, can I use any external machine learning library like XGboost on beat platform? Also can I use my own feature engineering for the dataset? 

I am also confused about the scoring mechanism on the online system. 

Now suppose, I want to participate offline. Suppose I have trained model on the training data. Now I test it on the test data. What scores do I actually send to get the result? The documentation is very unclear regarding this.

Thirdly,

I was testing out the platform and ran an experiment ( loginofdeath/robertodaza/competition_kboc16/2/Kboc16_Competition_Baseline_Modified_Scaled_Manhattan_Distance_neoeyed_experiment_1) . When I pressed the button for showing similar experiments, no other experiments showed up except mine. Is that expected?

I will appreciate any help regarding this.

Thanks in advance.

[André Anjos]

Hello,

Thanks for your interest. Answers inline.

On Tue, Aug 21, 2018 at 5:49 PM Souraj Adhikary <souraja...@gmail.com> wrote:

Hi,

I initially mailed to Dr. Sebastien Marcel about my queries. He pointed me to the Google group.

I want to participate in the KBOC on Beat platform. It is mentioned on https://sites.google.com/site/btas16kboc/home that there are two modes of participation- 

-online

-offline

Assuming I want to participate online, can I use any external machine learning library like XGboost on beat platform? Also can I use my own feature engineering for the dataset? 

I am also confused about the scoring mechanism on the online system.

Have you checked this user guide: https://www.beat-eu.org/platform/static/guide/index.html ?

In brief:

You can use whatever is installed on a compute environment. If XGboost is not installed on any of the existing public environments (https://www.beat-eu.org/platform/backend/environments/), then you should request through this list that it is included in the next iteration. It is relatively easy to accomodate this type of request, given time.

Scoring - I suggest you discuss with the competition chairs through their home page. They implemented the scoring as it is.

 

 

Now suppose, I want to participate offline. Suppose I have trained model on the training data. Now I test it on the test data. What scores do I actually send to get the result? The documentation is very unclear regarding this.

For offline participation, you don't use the platform at all.

 

Thirdly,

I was testing out the platform and ran an experiment ( loginofdeath/robertodaza/competition_kboc16/2/Kboc16_Competition_Baseline_Modified_Scaled_Manhattan_Distance_neoeyed_experiment_1) . When I pressed the button for showing similar experiments, no other experiments showed up except mine. Is that expected?

Please read the manual I indicated above, specially the session entitled "Search": https://www.beat-eu.org/platform/static/guide/search/guide.html

Best, A

 

I will appreciate any help regarding this.

Thanks in advance.

--
You received this message because you are subscribed to the Google Groups "beat-devel" group.
To unsubscribe from this group and stop receiving emails from it, send an email to beat-devel+...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Dr. André Anjos
Idiap Research Institute
Centre du Parc - rue Marconi 19
CH-1920 Martigny, Suisse
Phone: +41277217763
http://andreanjos.org