Firebug causes overhead in working with a website to some extent as it's analyzing the data coming from the page in real time, though it should definitely not be 5-7 times.
Does it make any difference when you disable the
Script panel? Do you have a URL, so this can be reproduced?
You may also want to try out the
Firebug 2.0 beta (requires Firefox 30+), which has some performance improvements, especially in regard of JavaScript debugging.
Sebastian