Jan, would you please, elaborate more on this? I am getting confused .
I have used
this script to calculate the confusion matrix, this however, reports the accuracy as well, the problem is the accuracy reported by this script is way different thatn the one reported by caffe! .
for example caffe reports accuracy lets say for CIFAR10, as 92.34%, while, when the model is fed to the script to calculate confusion matrix and its accuracy, it results in for example something like 86.5% .!
which one of these accuracies are the correct one, and can be reported in papers or compared with the results of other papers such as those
here ?
I also saw something weird again, I trained two identical models, with only one difference, that being one used xavier, and the other used msra for initialization.
the first one reports an accuracy of 94.25 and the other reports 94.26 in caffe. when these models are fed to the script I linked above, for confusion matrix computations. their accuracies were 89.2% and 87.4% respectivly. !
Is this normal? what is the cause for this? msra?
I really dont know if the accuracies reported by caffe are truth-worthy. I'd be grateful if you could shed some light on the matter,
Best regards
Hossein