Hi,
yes I did some experiments with comapring screenshots, but (as you experienced yourself) its really not easy because of too many false alarms.
So my advice is (as strange as it might seem): Do not use screenshots for corss browser testing.
Well, that's not really helpful I guess. ;) So here is another advice, what you actually could do:
Use JavaScript to analyse the page: (x,y offesets as well as width and height properties of those DOM-Elements, propably some <div> elements with known ids and/or classes, that are important for the layout of your webpage). This can be done in multiple browsers and then all you need to do is to compare the offsets and dimensions of those elements gathered in different browsers.
By the way, when I started the FLB project I thought taking screenshots is a good idea to detect layout bugs (and maybe it was), but its also very problemtatic because of animations on websites. So I plan (when I have time) to follow my own advice and implement some layout bug detectors based on using JavaScript and DOM properties only ...
Kind regards, Michael