The meaning of the average_loss in googlenet

1,768 views
Skip to first unread message

kaisi...@gmail.com

unread,
Apr 7, 2015, 12:24:49 PM4/7/15
to caffe...@googlegroups.com
Hi,everyone.

Do you know the meaning of the average_loss in googlenet? Could you tell me?

Thanks

Nikiforos Pittaras

unread,
Apr 15, 2015, 2:52:07 AM4/15/15
to caffe...@googlegroups.com
I'd also like to know that.

Beanfrog Green

unread,
Apr 15, 2015, 11:13:16 PM4/15/15
to caffe...@googlegroups.com
smooth the loss via average, average_loss is the size to calculate the average
see the code in caffe/src/caffe/solver.cpp

    if (losses.size() < average_loss) {
      losses.push_back(loss);
      int size = losses.size();
      smoothed_loss = (smoothed_loss * (size - 1) + loss) / size;
    } else {
      int idx = (iter_ - start_iter) % average_loss;
      smoothed_loss += (loss - losses[idx]) / average_loss;
      losses[idx] = loss;
    }

在 2015年4月8日星期三 UTC+8上午12:24:49,kaisi...@gmail.com写道:

Minh Hieu Nguyen

unread,
Jul 23, 2015, 10:17:53 PM7/23/15
to Caffe Users, been...@gmail.com
So is this average_loss parameter related to other parameters?
Reply all
Reply to author
Forward
0 new messages