I found the answer by looking at the rhino source. Pass in the java class object, followed by a single implementation of all the abstract methods, followed by the constructor parameters:
var myObject = new JavaAdapter(MyObject, {
// override abstract methods
doSomething: function(){ ... }
}, param1, param2); // constructer params here