We are using swagger in a RESTEasy environment, and not using Jersey.
Here is the tutorial that we used as an example to configure swagger with RESTEasy, and our configuration:
  <context-param>
    <param-name>resteasy.servlet.mapping.prefix</param-name>
    <param-value>/RESTServices</param-value>
  </context-param>
  <context-param>
    <param-name>resteasy.providers</param-name>
    <param-value>
      com.wordnik.swagger.jaxrs.listing.ApiDeclarationProvider,
      com.wordnik.swagger.jaxrs.listing.ResourceListingProvider,
      com.berbee.ipt.broadcastsystem.restservices.RESTExceptionHandler</param-value>
  </context-param>
  <context-param>
    <param-name>resteasy.resources</param-name>
    <param-value>com.wordnik.swagger.jaxrs.listing.ApiListingResourceJSON</param-value>
  </context-param>
  <servlet>
    <servlet-name>resteasy-servlet</servlet-name>
    <servlet-class>
      org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher
    </servlet-class>
    <init-param>
      <param-name>javax.ws.rs.Application</param-name>
      <param-value>com.berbee.ipt.broadcastsystem.restservices.RestApp</param-value>
    </init-param>
  </servlet>
  <servlet>
    <servlet-name>DefaultJaxrsConfig</servlet-name>
    <servlet-class>com.wordnik.swagger.jaxrs.config.DefaultJaxrsConfig</servlet-class>
    <init-param>
      <param-name>api.version</param-name>
      <param-value>1.0</param-value>
    </init-param>
    <init-param>
      <param-name>swagger.api.basepath</param-name>
      <param-value>/RESTServices</param-value>
    </init-param>
    <load-on-startup>2</load-on-startup>
  </servlet>
  <servlet-mapping>
    <servlet-name>resteasy-servlet</servlet-name>
    <url-pattern>/RESTServices/*</url-pattern>
    <url-pattern>/api-docs/*</url-pattern>
  </servlet-mapping>
Thanks for any input you can give.