I was thinking I'd like to do this for Grails. We could possible usehttp://www.grails.org/plugin/feature-flipper as a starting point forthe A/B testing framework.
If there are others interested in this that would be awesome!
-warner