> When you have an important problem to solve, you'll still solve the same
> problem, not solving something irrelevant. Whether 3x speed up is
> impressive, it's subjective and dependent on the context. If the context is
> relevant to your salary, getting 3x salary is that sounds good? Given that a
> professor's salary is already quite good.
> When you see 20x speed up reported, do you really trust the experiments?
> There are tons of experiments with severe numerical errors.
> The professor made the point that he's comparing to a highly optimized
> implementation on CPU. If you are comparing to a slow CPU implementation, of
> course you'll get 20x speed up or more, any numbers you like.
I certainly agree with this. I've seen people getting 2000x
speedups(LOL). I recently helped a person to optimize part of an
algorithm for electrical grid simulation. Despite the final speedup of
17x, I bet that with some optimization of the CPU code that would have
been turned into less than 1x (the algorithm was too data-dependent).
Some people just love fancy numbers.