a bandwidth related BUG in ristretto

[Farima Fatahi]

Hi everyone,

as I was reading the quantization.cpp codes I faced this part that is used to determine the integer length:

il_params_.push_back((int)ceil(log2(max_params_[i])+1));

if max_params_ that is holding the maximum value of the parameters in a layer is for example 1/4, then the il_params_ will be -1 and that means that fractional part that is:

fl_params_ = bw_out - GetIntegerLengthOut(param->layer(i).name())
would exceed the actual bandwidth. how should it be handled?

[barr...@gmail.com]

Hey,

The actual bandwidth (or memory footprint of a parameter) is bw_out bits. For example, if il_params happens to be -1, and bw_out is set to 8, then fl_params equals 9. This basically means that all numbers in the floating point group are scaled by 2^9.

Hope this helps you.