The API call urlfetch.Fetch() was cancelled because the overall HTTP request deadline was reached

[Deepak Kumar]

I recently upgraded my app to java8 from java7 and seeing following error while making url fetch request.

Any help??

----- : exception traces : -----

javax.ws.rs.ProcessingException: The API call urlfetch.Fetch() was cancelled because the overall HTTP request deadline was reached while waiting for concurrent API calls.

at org.glassfish.jersey.client.ClientRuntime.invoke(ClientRuntime.java:261)

at org.glassfish.jersey.client.JerseyInvocation$2.call(JerseyInvocation.java:701)

at org.glassfish.jersey.internal.Errors.process(Errors.java:315)

at org.glassfish.jersey.internal.Errors.process(Errors.java:297)

at org.glassfish.jersey.internal.Errors.process(Errors.java:228)

at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:444)

at org.glassfish.jersey.client.JerseyInvocation.invoke(JerseyInvocation.java:697)

at org.glassfish.jersey.client.JerseyInvocation$Builder.method(JerseyInvocation.java:420)

at org.glassfish.jersey.client.JerseyInvocation$Builder.get(JerseyInvocation.java:316)

....

....

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.lang.reflect.Method.invoke(Method.java:498)

at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java:81)

at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:144)

at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:161)

at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:205)

at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:99)

at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:389)

at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:347)

at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:102)

at org.glassfish.jersey.server.ServerRuntime$2.run(ServerRuntime.java:326)

at org.glassfish.jersey.internal.Errors$1.call(Errors.java:271)

at org.glassfish.jersey.internal.Errors$1.call(Errors.java:267)

at org.glassfish.jersey.internal.Errors.process(Errors.java:315)

at org.glassfish.jersey.internal.Errors.process(Errors.java:297)

at org.glassfish.jersey.internal.Errors.process(Errors.java:267)

at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:317)

at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:305)

at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1154)

at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:473)

at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:427)

at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:388)

at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:341)

at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:228)

at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:848)

at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1772)

...

...

at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)

at com.google.apphosting.utils.servlet.ParseBlobUploadFilter.doFilter(ParseBlobUploadFilter.java:125)

at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)

at com.google.apphosting.runtime.jetty9.SaveSessionFilter.doFilter(SaveSessionFilter.java:37)

at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)

at com.google.apphosting.utils.servlet.JdbcMySqlConnectionCleanupFilter.doFilter(JdbcMySqlConnectionCleanupFilter.java:60)

at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)

at com.google.apphosting.utils.servlet.TransactionCleanupFilter.doFilter(TransactionCleanupFilter.java:48)

at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)

at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)

at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)

at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:524)

at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:226)

at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)

at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)

at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)

at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)

at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)

at com.google.apphosting.runtime.jetty9.AppVersionHandlerMap.handle(AppVersionHandlerMap.java:297)

at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)

at org.eclipse.jetty.server.Server.handle(Server.java:534)

at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)

at com.google.apphosting.runtime.jetty9.RpcConnection.handle(RpcConnection.java:202)

at com.google.apphosting.runtime.jetty9.RpcConnector.serviceRequest(RpcConnector.java:81)

at com.google.apphosting.runtime.jetty9.JettyServletEngineAdapter.serviceRequest(JettyServletEngineAdapter.java:108)

at com.google.apphosting.runtime.JavaRuntime$RequestRunnable.dispatchServletRequest(JavaRuntime.java:686)

at com.google.apphosting.runtime.JavaRuntime$RequestRunnable.dispatchRequest(JavaRuntime.java:648)

at com.google.apphosting.runtime.JavaRuntime$RequestRunnable.run(JavaRuntime.java:618)

at com.google.apphosting.runtime.JavaRuntime$NullSandboxRequestRunnable.run(JavaRuntime.java:812)

at com.google.apphosting.runtime.ThreadGroupPool$PoolEntry.run(ThreadGroupPool.java:274)

at java.lang.Thread.run(Thread.java:745)

Caused by: com.google.apphosting.api.ApiProxy$CancelledException: The API call urlfetch.Fetch() was cancelled because the overall HTTP request deadline was reached while waiting for concurrent API calls.

at com.google.apphosting.runtime.ApiProxyImpl$6.get(ApiProxyImpl.java:461)

at com.google.apphosting.runtime.ApiProxyImpl$6.get(ApiProxyImpl.java:453)

at com.google.apphosting.runtime.ApiProxyImpl.doSyncCall(ApiProxyImpl.java:247)

at com.google.apphosting.runtime.ApiProxyImpl.access$000(ApiProxyImpl.java:68)

at com.google.apphosting.runtime.ApiProxyImpl$1.run(ApiProxyImpl.java:218)

at com.google.apphosting.runtime.ApiProxyImpl$1.run(ApiProxyImpl.java:215)

at java.security.AccessController.doPrivileged(Native Method)

at com.google.apphosting.runtime.ApiProxyImpl.makeSyncCall(ApiProxyImpl.java:214)

at com.google.apphosting.runtime.ApiProxyImpl.makeSyncCall(ApiProxyImpl.java:68)

at com.google.apphosting.api.ApiProxy.makeSyncCall(ApiProxy.java:123)

at com.google.appengine.api.urlfetch.URLFetchServiceImpl.fetch(URLFetchServiceImpl.java:40)

at com.google.apphosting.utils.security.urlfetch.URLFetchServiceStreamHandler$Connection.fetchResponse(URLFetchServiceStreamHandler.java:543)

at com.google.apphosting.utils.security.urlfetch.URLFetchServiceStreamHandler$Connection.getInputStream(URLFetchServiceStreamHandler.java:422)

at com.google.apphosting.utils.security.urlfetch.URLFetchServiceStreamHandler$Connection.getResponseCode(URLFetchServiceStreamHandler.java:275)

at org.glassfish.jersey.client.internal.HttpUrlConnector._apply(HttpUrlConnector.java:399)

at org.glassfish.jersey.client.internal.HttpUrlConnector.apply(HttpUrlConnector.java:285)

at org.glassfish.jersey.client.ClientRuntime.invoke(ClientRuntime.java:252)

... 74 more

[George (Cloud Platform Support)]

How often is this call made? Does this happen for a certain URL in particular, or for any URL? Details on the code initiating the URLFetch request are needed. You can send us these details via private email, using the drop-down menu of the "reply" button, at the top right of the editing window. 

Such errors usually occur when your app reaches the serving deadline (60 seconds in case of the front end), while either a URLFetch or an API call is in progress. It may be worthwhile verifying how is this URLFetch call initiated, and then decide on the best way to reduce time to completion.

[Deepak Kumar]

For initial some time (when app is deployed) it works fine and after some time it's throwing this error.

I am using jersey client 2.21 libraries. 

---------- sample code ------------------

Client client = ClientBuilder.newClient();

client.register(GZipEncoder.class);

WebTarget webTarget = client.target(uri);

if(queryParams != null) {

Iterator<Entry<String, Object>> it = queryParams.entrySet().iterator();

while(it.hasNext()) {

Entry<String, Object> set = it.next();

webTarget = webTarget.queryParam(set.getKey(), set.getValue());

}

}

Invocation.Builder builder = webTarget.request();

if(headers != null) {

builder = webTarget.request().headers(new MultivaluedHashMap<>(headers));

}

return builder.accept("application/json").get(Response.class);

note: other detail are shared in private replace.

[George (Cloud Platform Support)]

Is your jersey client library fully compatible with Java 8? Your code does not seem to take into consideration the case of a request being delayed, and does not set a fetch deadline, in a way similar to urlfetch.set_default_fetch_deadline(). You should examine your app's behavior accordingly, and decide on the best way to reduce time to completion.