How can I see results of AUC, prec@5 after run item_recommendation.exe

[Ronald Perez]

Hello I am using MyMediaLite en windows 10, and run in cmd with command

 

item_recommendation.exe --training-file=datasetProyecto/ratings_transiciones_completers.csv --recommender=UserKNN --test-users=datasetProyecto/users_comp.csv --prediction-file=datasetProyecto/rankinCompleter2.csv --test-ratio=0.2   --predict-items-number=5 --file-format=ignore_first_line --online-evaluation

Then I get this output 

loading_time 0.14

memory 3

training data: 1586 users, 4136 items, 236601 events, sparsity 96.39311

test data:     1585 users, 2362 items, 59304 events, sparsity 98.41593

UserKNN k=80 correlation=Cosine q=1 weighted=False alpha=0.5 (only for BidirectionalConditionalProbability)

training_time 00:00:19.1814129 Wrote predictions for 1586 users to file datasetProyecto/rankinCompleter2.csv. prediction_time 00:01:13.4753576

memory 23

How can I see the results  the evaluations AUC, prec@5 in cmd.

Thanks.

[Zeno Gantner]

Hi,

Sorry for the late reply.

If you want to report metrics, you should use either --test-file or --test-ratio, plus optionally --test-users

If you want to make predictions, then provide the --prediction-file argument.

I do not think it makes sense to to both things at the same time, because for optimal predictions you want to use all available training data, and for getting metrics you need to leave out the test data out of the training data set.

I hope that helps.

Cheers,

   Z.

--
You received this message because you are subscribed to the Google Groups "MyMediaLite" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mymedialite+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.