Got it working
Maybe this should have been obvious, but to me it wasn't...
application = web.application(urls, globals()).wsgifunc()
app = web.application(urls, locals())
session = web.session.Session(app,
web.session.DiskStore('/home/foob/wsgi_test/sessions'),
initializer={'count': 0})