Ayende thanks for the tip, i never knew about it, but still any operation related to Raven will slow down the debugger, i have set a break into debugger on the web exception and found this is is the message:
The remote server returned an error: (304) Not Modified.
and why my app debugging is slow, it is because i inject Ravensession into the base controller like RacoonBlog, so basically any operation on my site will trigger this exception.