Clarification about the cross-entropy loss for ex12

51 views
Skip to first unread message

Maksym Andriushchenko

unread,
Jan 24, 2019, 5:24:45 AM1/24/19
to Machine Learning WS18/19
Hi all,

To clarify, in ex12 we assume the usage of the cross-entropy loss which includes the softmax function.
I.e. as the loss you should implement this:
image.png
In this particular formulation, y is a scalar in {1, 2, ..., K}. However, it might be a bit easier to work with the one-hot representation of the labels. It's up to you.

Best wishes,
Maksym
Reply all
Reply to author
Forward
0 new messages