Thanks for the follow-up. I wasn't able to update to a later version so could not test. It might be a while before we upgrade. I ended up adding a location handler to the undertow default-server like:
<host name="default-host" alias="localhost">
<location name="/WEB-INF" handler="block"/>
<location name="/META-INF" handler="block"/>
</host>
Then the handler is just something silly that redirects me back to the app login page:
<handlers>
<file name="
block" path="${jboss.home.dir}/standalone/deployments/myapp.war/login.htm"/>
</handlers>
This did work. I don't know why the constraint did not work, unless maybe because the web-inf is not in my app path, perhaps it did not register the constraint since that's in my app web.xml. But this handler did the trick so we moved on. :-)
Thank you!