importing projects via cli fails

137 views
Skip to first unread message

Andrew Meyer

unread,
Aug 14, 2024, 2:48:43 PMAug 14
to rundeck-discuss
I'm having problems importing a few projects that I thought got imported previously.  Right now in order to make this work I have to change the grails.url (because of firewall issues most likely).  I've increased the http con timeout to a full day, but it still fails.

 rd projects archives import -p ITOPS -f rundeck-prod/ITOPS-20240423.jar
# Including extension: org.rundeck.client.tool.commands.repository.Plugins
# Including extension: org.rundeck.client.tool.commands.enterprise.license.License
# Including extension: org.rundeck.client.tool.commands.enterprise.cluster.Cluster
# Including extension: org.rundeck.client.ext.acl.Acl
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: --> GET http://10.244.44.103:4440/ http/1.1
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: User-Agent: rd-cli-tool/2.0.8 (rundeck-cli/2.0.8)
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Host: 10.244.44.103:4440
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Connection: Keep-Alive
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Accept-Encoding: gzip
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: --> END GET
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: <-- 302 Found http://10.244.44.103:4440/ (9ms)
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Date: Wed, 14 Aug 2024 18:41:43 GMT
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Vary: Origin
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Vary: Access-Control-Request-Method
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Vary: Access-Control-Request-Headers
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Set-Cookie: JSESSIONID=node01bfxcc1t1o6fzdt48b5xvbqwh18.node0; Path=/; HttpOnly; SameSite=Lax
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Expires: Thu, 01 Jan 1970 00:00:00 GMT
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Location: http://10.244.44.103:4440/user/login
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Content-Length: 0
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: <-- END HTTP
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: --> GET http://10.244.44.103:4440/user/login http/1.1
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: User-Agent: rd-cli-tool/2.0.8 (rundeck-cli/2.0.8)
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Host: 10.244.44.103:4440
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Connection: Keep-Alive
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Accept-Encoding: gzip
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Cookie: JSESSIONID=node01bfxcc1t1o6fzdt48b5xvbqwh18.node0
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: --> END GET
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: <-- 200 OK http://10.244.44.103:4440/user/login (15ms)
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Date: Wed, 14 Aug 2024 18:41:43 GMT
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Vary: Origin
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Vary: Access-Control-Request-Method
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Vary: Access-Control-Request-Headers
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: X-Frame-Options: deny
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: X-XSS-Protection: 0
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: X-Content-Type-Options: nosniff
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Content-Security-Policy: default-src 'none' ; script-src 'self' https://content.analytics.rundeck.com 'unsafe-inline' 'unsafe-eval' ; style-src 'self' 'unsafe-inline' ; img-src * data: ; font-src 'self' data: ; connect-src 'self' https://api.rundeck.com https://data.analytics.rundeck.com ; form-action 'self' ;
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Content-Language: en-US
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Content-Type: text/html;charset=utf-8
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Transfer-Encoding: chunked
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: <-- END HTTP
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: --> POST http://10.244.44.103:4440/j_security_check http/1.1
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: User-Agent: rd-cli-tool/2.0.8 (rundeck-cli/2.0.8)
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Content-Type: application/x-www-form-urlencoded
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Content-Length: 45
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Host: 10.244.44.103:4440
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Connection: Keep-Alive
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Accept-Encoding: gzip
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Cookie: JSESSIONID=node01bfxcc1t1o6fzdt48b5xvbqwh18.node0
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: --> END POST
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: <-- 302 Found http://10.244.44.103:4440/j_security_check (462ms)
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Date: Wed, 14 Aug 2024 18:41:43 GMT
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Vary: Origin
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Vary: Access-Control-Request-Method
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Vary: Access-Control-Request-Headers
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Set-Cookie: JSESSIONID=node0vxtjicd7g1x56iibu57w8eq219.node0; Path=/; HttpOnly; SameSite=Lax
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Expires: Thu, 01 Jan 1970 00:00:00 GMT
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Location: http://10.244.44.103:4440/
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Content-Length: 0
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: <-- END HTTP
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: --> GET http://10.244.44.103:4440/ http/1.1
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: User-Agent: rd-cli-tool/2.0.8 (rundeck-cli/2.0.8)
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Host: 10.244.44.103:4440
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Connection: Keep-Alive
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Accept-Encoding: gzip
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Cookie: JSESSIONID=node0vxtjicd7g1x56iibu57w8eq219.node0
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: --> END GET
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: <-- 302 Found http://10.244.44.103:4440/ (20ms)
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Date: Wed, 14 Aug 2024 18:41:43 GMT
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Vary: Origin
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Vary: Access-Control-Request-Method
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Vary: Access-Control-Request-Headers
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: X-Frame-Options: deny
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: X-XSS-Protection: 0
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: X-Content-Type-Options: nosniff
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Content-Security-Policy: default-src 'none' ; script-src 'self' https://content.analytics.rundeck.com 'unsafe-inline' 'unsafe-eval' ; style-src 'self' 'unsafe-inline' ; img-src * data: ; font-src 'self' data: ; connect-src 'self' https://api.rundeck.com https://data.analytics.rundeck.com ; form-action 'self' ;
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Set-Cookie: JSESSIONID=node019oyq38p1pypqxqoi4pqhcnz920.node0; Path=/; HttpOnly; SameSite=Lax
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Expires: Thu, 01 Jan 1970 00:00:00 GMT
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Location: http://10.244.44.103:4440/menu/home
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Content-Length: 0
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: <-- END HTTP
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: --> GET http://10.244.44.103:4440/menu/home http/1.1
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: User-Agent: rd-cli-tool/2.0.8 (rundeck-cli/2.0.8)
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Host: 10.244.44.103:4440
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Connection: Keep-Alive
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Accept-Encoding: gzip
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: Cookie: JSESSIONID=node019oyq38p1pypqxqoi4pqhcnz920.node0
Aug 14, 2024 1:41:43 PM okhttp3.internal.platform.Platform log
INFO: --> END GET
Aug 14, 2024 1:41:44 PM okhttp3.internal.platform.Platform log
INFO: <-- 200 OK http://10.244.44.103:4440/menu/home (134ms)
Aug 14, 2024 1:41:44 PM okhttp3.internal.platform.Platform log
INFO: Date: Wed, 14 Aug 2024 18:41:43 GMT
Aug 14, 2024 1:41:44 PM okhttp3.internal.platform.Platform log
INFO: Vary: Origin
Aug 14, 2024 1:41:44 PM okhttp3.internal.platform.Platform log
INFO: Vary: Access-Control-Request-Method
Aug 14, 2024 1:41:44 PM okhttp3.internal.platform.Platform log
INFO: Vary: Access-Control-Request-Headers
Aug 14, 2024 1:41:44 PM okhttp3.internal.platform.Platform log
INFO: X-Frame-Options: deny
Aug 14, 2024 1:41:44 PM okhttp3.internal.platform.Platform log
INFO: X-XSS-Protection: 0
Aug 14, 2024 1:41:44 PM okhttp3.internal.platform.Platform log
INFO: X-Content-Type-Options: nosniff
Aug 14, 2024 1:41:44 PM okhttp3.internal.platform.Platform log
INFO: Content-Security-Policy: default-src 'none' ; script-src 'self' https://content.analytics.rundeck.com 'unsafe-inline' 'unsafe-eval' ; style-src 'self' 'unsafe-inline' ; img-src * data: ; font-src 'self' data: ; connect-src 'self' https://api.rundeck.com https://data.analytics.rundeck.com ; form-action 'self' ;
Aug 14, 2024 1:41:44 PM okhttp3.internal.platform.Platform log
INFO: Content-Language: en-US
Aug 14, 2024 1:41:44 PM okhttp3.internal.platform.Platform log
INFO: Content-Type: text/html;charset=utf-8
Aug 14, 2024 1:41:44 PM okhttp3.internal.platform.Platform log
INFO: Transfer-Encoding: chunked
Aug 14, 2024 1:41:44 PM okhttp3.internal.platform.Platform log
INFO: <-- END HTTP
Aug 14, 2024 1:41:44 PM okhttp3.internal.platform.Platform log
INFO: --> PUT http://10.244.44.103:4440/api/29/project/ITOPS/import?jobUuidOption=preserve&importExecutions=true&importConfig=false&importACL=false&importScm=false&importWebhooks=false&whkRegenAuthTokens=false&importNodesSources=false http/1.1
Aug 14, 2024 1:41:44 PM okhttp3.internal.platform.Platform log
INFO: Accept: application/json
Aug 14, 2024 1:41:44 PM okhttp3.internal.platform.Platform log
INFO: User-Agent: rd-cli-tool/2.0.8 (rundeck-cli/2.0.8)
Aug 14, 2024 1:41:44 PM okhttp3.internal.platform.Platform log
INFO: Content-Type: application/zip
Aug 14, 2024 1:41:44 PM okhttp3.internal.platform.Platform log
INFO: Content-Length: 753955017
Aug 14, 2024 1:41:44 PM okhttp3.internal.platform.Platform log
INFO: Host: 10.244.44.103:4440
Aug 14, 2024 1:41:44 PM okhttp3.internal.platform.Platform log
INFO: Connection: Keep-Alive
Aug 14, 2024 1:41:44 PM okhttp3.internal.platform.Platform log
INFO: Accept-Encoding: gzip
Aug 14, 2024 1:41:44 PM okhttp3.internal.platform.Platform log
INFO: Cookie: JSESSIONID=node019oyq38p1pypqxqoi4pqhcnz920.node0
Aug 14, 2024 1:41:44 PM okhttp3.internal.platform.Platform log
INFO: --> END PUT
Aug 14, 2024 1:41:45 PM okhttp3.internal.platform.Platform log
INFO: <-- 500 Server Error http://10.244.44.103:4440/api/29/project/ITOPS/import?jobUuidOption=preserve&importExecutions=true&importConfig=false&importACL=false&importScm=false&importWebhooks=false&whkRegenAuthTokens=false&importNodesSources=false (1356ms)
Aug 14, 2024 1:41:45 PM okhttp3.internal.platform.Platform log
INFO: Date: Wed, 14 Aug 2024 18:41:44 GMT
Aug 14, 2024 1:41:45 PM okhttp3.internal.platform.Platform log
INFO: Vary: Origin
Aug 14, 2024 1:41:45 PM okhttp3.internal.platform.Platform log
INFO: Vary: Access-Control-Request-Method
Aug 14, 2024 1:41:45 PM okhttp3.internal.platform.Platform log
INFO: Vary: Access-Control-Request-Headers
Aug 14, 2024 1:41:45 PM okhttp3.internal.platform.Platform log
INFO: X-Frame-Options: deny
Aug 14, 2024 1:41:45 PM okhttp3.internal.platform.Platform log
INFO: X-XSS-Protection: 0
Aug 14, 2024 1:41:45 PM okhttp3.internal.platform.Platform log
INFO: X-Content-Type-Options: nosniff
Aug 14, 2024 1:41:45 PM okhttp3.internal.platform.Platform log
INFO: Content-Security-Policy: default-src 'none' ; script-src 'self' https://content.analytics.rundeck.com 'unsafe-inline' 'unsafe-eval' ; style-src 'self' 'unsafe-inline' ; img-src * data: ; font-src 'self' data: ; connect-src 'self' https://api.rundeck.com https://data.analytics.rundeck.com ; form-action 'self' ;
Aug 14, 2024 1:41:45 PM okhttp3.internal.platform.Platform log
INFO: Content-Type: application/json
Aug 14, 2024 1:41:45 PM okhttp3.internal.platform.Platform log
INFO: Transfer-Encoding: chunked
Aug 14, 2024 1:41:45 PM okhttp3.internal.platform.Platform log
INFO: <-- END HTTP
Error: (no message)

Request failed: 500 Server Error
org.rundeck.client.api.RequestFailed: Request failed: 500 Server Error
        at org.rundeck.client.util.Client.makeErrorThrowable(Client.java:389)
        at org.rundeck.client.util.Client.handleError(Client.java:353)
        at org.rundeck.client.util.Client.checkErrorDowngradable(Client.java:308)
        at org.rundeck.client.util.Client.checkErrorDowngradable(Client.java:167)
        at org.rundeck.client.util.Client.apiCallDowngradable(Client.java:606)
        at org.rundeck.client.tool.commands.RdToolImpl.apiCallDowngradable(RdToolImpl.java:107)
        at org.rundeck.client.tool.commands.RdToolImpl.apiCall(RdToolImpl.java:78)
        at org.rundeck.client.tool.extension.BaseCommand.apiCall(BaseCommand.java:24)
        at org.rundeck.client.tool.commands.projects.Archives.importArchive(Archives.java:142)
        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:566)
        at picocli.CommandLine.executeUserObject(CommandLine.java:1972)
        at picocli.CommandLine.access$1300(CommandLine.java:145)
        at picocli.CommandLine$RunLast.executeUserObjectOfLastSubcommandWithSameParent(CommandLine.java:2358)
        at picocli.CommandLine$RunLast.handle(CommandLine.java:2352)
        at picocli.CommandLine$RunLast.handle(CommandLine.java:2314)
        at picocli.CommandLine$AbstractParseResultHandler.execute(CommandLine.java:2179)
        at picocli.CommandLine$RunLast.execute(CommandLine.java:2316)
        at picocli.CommandLine.execute(CommandLine.java:2078)
        at org.rundeck.client.tool.Main.main(Main.java:155)

rac...@rundeck.com

unread,
Aug 14, 2024, 5:33:22 PMAug 14
to rundeck-discuss
Hi Andrew,

Similar to this, a 500 error means a rundeck instance error.

When importing your projects via RD CLI, do you see any clue in the rundeck instance service.log  file? (I mean on the rundeck instance server service.log file, not the RD CLI error output).

Regards!

Andrew Meyer

unread,
Aug 15, 2024, 11:46:19 AMAug 15
to rundeck-discuss
I tried this again this morning, it has been going for about 2.5 hours with no error.  Not sure if that is good or bad.

Andrew Meyer

unread,
Aug 15, 2024, 4:03:07 PMAug 15
to rundeck-discuss
It took me a while to get the logs:

[2024-08-15T15:00:00,012] ERROR quartzjobs.ExecutionJob - Unable to start Job execution: failed to lookup scheduledException object from job data map: id: f84afd03-663b-4325-880c-ac1766e24994
java.lang.RuntimeException: failed to lookup scheduledException object from job data map: id: f84afd03-663b-4325-880c-ac1766e24994
        at jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[?:?]
        at jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) ~[?:?]
        at jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) ~[?:?]
        at java.lang.reflect.Constructor.newInstance(Constructor.java:490) ~[?:?]
        at org.codehaus.groovy.reflection.CachedConstructor.invoke(CachedConstructor.java:72) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.reflection.CachedConstructor.doConstructorInvoke(CachedConstructor.java:59) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.ConstructorSite$ConstructorSiteNoUnwrap.callConstructor(ConstructorSite.java:84) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallConstructor(CallSiteArray.java:59) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:263) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:277) [groovy-3.0.9.jar!/:3.0.9]
        at rundeck.quartzjobs.ExecutionJob.fetchScheduledExecution(ExecutionJob.groovy:657) ~[classes!/:?]
        at rundeck.quartzjobs.ExecutionJob.initialize(ExecutionJob.groovy:226) ~[classes!/:?]
        at rundeck.quartzjobs.ExecutionJob$initialize.callCurrent(Unknown Source) ~[?:?]
        at rundeck.quartzjobs.ExecutionJob.execute_internal(ExecutionJob.groovy:121) [classes!/:?]
        at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
        at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
        at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
        at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
        at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:107) [groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:323) [groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:362) [groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.PogoMetaClassSite.callCurrent(PogoMetaClassSite.java:61) [groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:185) [groovy-3.0.9.jar!/:3.0.9]
        at rundeck.quartzjobs.ExecutionJob$_execute_closure1.doCall(ExecutionJob.groovy:100) [classes!/:?]
        at rundeck.quartzjobs.ExecutionJob$_execute_closure1.doCall(ExecutionJob.groovy) [classes!/:?]
        at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
        at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
        at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
        at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
        at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:107) [groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:323) [groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:274) [groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1035) [groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.Closure.call(Closure.java:412) [groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.Closure.call(Closure.java:406) [groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.Closure.run(Closure.java:493) [groovy-3.0.9.jar!/:3.0.9]
        at com.codahale.metrics.Timer.time(Timer.java:151) [metrics-core-4.2.18.jar!/:4.2.18]
        at com.codahale.metrics.Timer$time.call(Unknown Source) [metrics-core-4.2.18.jar!/:?]
        at rundeck.quartzjobs.ExecutionJob.execute(ExecutionJob.groovy:99) [classes!/:?]
        at org.quartz.core.JobRunShell.run(JobRunShell.java:202) [quartz-2.3.2.jar!/:?]
        at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:573) [quartz-2.3.2.jar!/:?]
[2024-08-15T15:00:00,012] ERROR quartzjobs.ExecutionJob - Unable to start Job execution: failed to lookup scheduledException object from job data map: id: f84afd03-663b-4325-880c-ac1766e24994
java.lang.RuntimeException: failed to lookup scheduledException object from job data map: id: f84afd03-663b-4325-880c-ac1766e24994
        at jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[?:?]
        at jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) ~[?:?]
        at jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) ~[?:?]
        at java.lang.reflect.Constructor.newInstance(Constructor.java:490) ~[?:?]
        at org.codehaus.groovy.reflection.CachedConstructor.invoke(CachedConstructor.java:72) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.reflection.CachedConstructor.doConstructorInvoke(CachedConstructor.java:59) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.ConstructorSite$ConstructorSiteNoUnwrap.callConstructor(ConstructorSite.java:84) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallConstructor(CallSiteArray.java:59) [groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:263) [groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:277) [groovy-3.0.9.jar!/:3.0.9]
        at rundeck.quartzjobs.ExecutionJob.fetchScheduledExecution(ExecutionJob.groovy:657) ~[classes!/:?]
        at rundeck.quartzjobs.ExecutionJob.initialize(ExecutionJob.groovy:226) ~[classes!/:?]
        at rundeck.quartzjobs.ExecutionJob$initialize.callCurrent(Unknown Source) ~[?:?]
        at rundeck.quartzjobs.ExecutionJob.execute_internal(ExecutionJob.groovy:121) [classes!/:?]
        at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
        at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
        at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
        at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
        at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:107) [groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:323) [groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:362) [groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.PogoMetaClassSite.callCurrent(PogoMetaClassSite.java:61) [groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:185) [groovy-3.0.9.jar!/:3.0.9]
        at rundeck.quartzjobs.ExecutionJob$_execute_closure1.doCall(ExecutionJob.groovy:100) [classes!/:?]
        at rundeck.quartzjobs.ExecutionJob$_execute_closure1.doCall(ExecutionJob.groovy) [classes!/:?]
        at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
        at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
        at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
        at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
        at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:107) [groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:323) [groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:274) [groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1035) [groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.Closure.call(Closure.java:412) [groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.Closure.call(Closure.java:406) [groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.Closure.run(Closure.java:493) [groovy-3.0.9.jar!/:3.0.9]
        at com.codahale.metrics.Timer.time(Timer.java:151) [metrics-core-4.2.18.jar!/:4.2.18]
        at com.codahale.metrics.Timer$time.call(Unknown Source) [metrics-core-4.2.18.jar!/:?]
        at rundeck.quartzjobs.ExecutionJob.execute(ExecutionJob.groovy:99) [classes!/:?]
        at org.quartz.core.JobRunShell.run(JobRunShell.java:202) [quartz-2.3.2.jar!/:?]
        at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:573) [quartz-2.3.2.jar!/:?]
[2024-08-15T15:00:00,017] ERROR core.JobRunShell - Job ITOPS:Dynamic Pricing Service Cache Refresh:ECOM Cache Refresh.563912:Dynamic Pricing Service Cache Refresh threw an unhandled Exception:
java.lang.RuntimeException: failed to lookup scheduledException object from job data map: id: f84afd03-663b-4325-880c-ac1766e24994
        at jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[?:?]
        at jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) ~[?:?]
        at jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) ~[?:?]
        at java.lang.reflect.Constructor.newInstance(Constructor.java:490) ~[?:?]
        at org.codehaus.groovy.reflection.CachedConstructor.invoke(CachedConstructor.java:72) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.reflection.CachedConstructor.doConstructorInvoke(CachedConstructor.java:59) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.ConstructorSite$ConstructorSiteNoUnwrap.callConstructor(ConstructorSite.java:84) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallConstructor(CallSiteArray.java:59) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:263) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:277) ~[groovy-3.0.9.jar!/:3.0.9]
        at rundeck.quartzjobs.ExecutionJob.fetchScheduledExecution(ExecutionJob.groovy:657) ~[classes!/:?]
        at rundeck.quartzjobs.ExecutionJob.initialize(ExecutionJob.groovy:226) ~[classes!/:?]
        at rundeck.quartzjobs.ExecutionJob$initialize.callCurrent(Unknown Source) ~[?:?]
        at rundeck.quartzjobs.ExecutionJob.execute_internal(ExecutionJob.groovy:121) ~[classes!/:?]
        at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
        at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
        at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
        at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
        at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:107) ~[groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:323) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:362) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.PogoMetaClassSite.callCurrent(PogoMetaClassSite.java:61) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:185) ~[groovy-3.0.9.jar!/:3.0.9]
        at rundeck.quartzjobs.ExecutionJob$_execute_closure1.doCall(ExecutionJob.groovy:100) ~[classes!/:?]
        at rundeck.quartzjobs.ExecutionJob$_execute_closure1.doCall(ExecutionJob.groovy) ~[classes!/:?]
        at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
        at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
        at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
        at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
        at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:107) ~[groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:323) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:274) ~[groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1035) ~[groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.Closure.call(Closure.java:412) ~[groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.Closure.call(Closure.java:406) ~[groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.Closure.run(Closure.java:493) ~[groovy-3.0.9.jar!/:3.0.9]
        at com.codahale.metrics.Timer.time(Timer.java:151) ~[metrics-core-4.2.18.jar!/:4.2.18]
        at com.codahale.metrics.Timer$time.call(Unknown Source) ~[?:?]
        at rundeck.quartzjobs.ExecutionJob.execute(ExecutionJob.groovy:99) ~[classes!/:?]
        at org.quartz.core.JobRunShell.run(JobRunShell.java:202) [quartz-2.3.2.jar!/:?]
        at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:573) [quartz-2.3.2.jar!/:?]
[2024-08-15T15:00:00,018] ERROR core.JobRunShell - Job ITOPS:Dynamic Pricing Service Cache Refresh:ECOM Cache Refresh.578592:Dynamic Pricing Service Cache Refresh threw an unhandled Exception:
java.lang.RuntimeException: failed to lookup scheduledException object from job data map: id: f84afd03-663b-4325-880c-ac1766e24994
        at jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[?:?]
        at jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) ~[?:?]
        at jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) ~[?:?]
        at java.lang.reflect.Constructor.newInstance(Constructor.java:490) ~[?:?]
        at org.codehaus.groovy.reflection.CachedConstructor.invoke(CachedConstructor.java:72) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.reflection.CachedConstructor.doConstructorInvoke(CachedConstructor.java:59) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.ConstructorSite$ConstructorSiteNoUnwrap.callConstructor(ConstructorSite.java:84) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallConstructor(CallSiteArray.java:59) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:263) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:277) ~[groovy-3.0.9.jar!/:3.0.9]
        at rundeck.quartzjobs.ExecutionJob.fetchScheduledExecution(ExecutionJob.groovy:657) ~[classes!/:?]
        at rundeck.quartzjobs.ExecutionJob.initialize(ExecutionJob.groovy:226) ~[classes!/:?]
        at rundeck.quartzjobs.ExecutionJob$initialize.callCurrent(Unknown Source) ~[?:?]
        at rundeck.quartzjobs.ExecutionJob.execute_internal(ExecutionJob.groovy:121) ~[classes!/:?]
        at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
        at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
        at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
        at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
        at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:107) ~[groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:323) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:362) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.PogoMetaClassSite.callCurrent(PogoMetaClassSite.java:61) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:185) ~[groovy-3.0.9.jar!/:3.0.9]
        at rundeck.quartzjobs.ExecutionJob$_execute_closure1.doCall(ExecutionJob.groovy:100) ~[classes!/:?]
        at rundeck.quartzjobs.ExecutionJob$_execute_closure1.doCall(ExecutionJob.groovy) ~[classes!/:?]
        at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
        at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
        at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
        at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
        at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:107) ~[groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:323) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:274) ~[groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1035) ~[groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.Closure.call(Closure.java:412) ~[groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.Closure.call(Closure.java:406) ~[groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.Closure.run(Closure.java:493) ~[groovy-3.0.9.jar!/:3.0.9]
        at com.codahale.metrics.Timer.time(Timer.java:151) ~[metrics-core-4.2.18.jar!/:4.2.18]
        at com.codahale.metrics.Timer$time.call(Unknown Source) ~[?:?]
        at rundeck.quartzjobs.ExecutionJob.execute(ExecutionJob.groovy:99) ~[classes!/:?]
        at org.quartz.core.JobRunShell.run(JobRunShell.java:202) [quartz-2.3.2.jar!/:?]
        at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:573) [quartz-2.3.2.jar!/:?]
[2024-08-15T15:00:00,023] ERROR core.ErrorLogger - Job (ITOPS:Dynamic Pricing Service Cache Refresh:ECOM Cache Refresh.563912:Dynamic Pricing Service Cache Refresh threw an exception.
org.quartz.SchedulerException: Job threw an unhandled exception.
        at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz-2.3.2.jar!/:?]
        at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:573) [quartz-2.3.2.jar!/:?]
Caused by: java.lang.RuntimeException: failed to lookup scheduledException object from job data map: id: f84afd03-663b-4325-880c-ac1766e24994
        at jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[?:?]
        at jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) ~[?:?]
        at jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) ~[?:?]
        at java.lang.reflect.Constructor.newInstance(Constructor.java:490) ~[?:?]
        at org.codehaus.groovy.reflection.CachedConstructor.invoke(CachedConstructor.java:72) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.reflection.CachedConstructor.doConstructorInvoke(CachedConstructor.java:59) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.ConstructorSite$ConstructorSiteNoUnwrap.callConstructor(ConstructorSite.java:84) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallConstructor(CallSiteArray.java:59) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:263) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:277) ~[groovy-3.0.9.jar!/:3.0.9]
        at rundeck.quartzjobs.ExecutionJob.fetchScheduledExecution(ExecutionJob.groovy:657) ~[classes!/:?]
        at rundeck.quartzjobs.ExecutionJob.initialize(ExecutionJob.groovy:226) ~[classes!/:?]
        at rundeck.quartzjobs.ExecutionJob$initialize.callCurrent(Unknown Source) ~[?:?]
        at rundeck.quartzjobs.ExecutionJob.execute_internal(ExecutionJob.groovy:121) ~[classes!/:?]
        at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
        at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
        at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
        at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
        at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:107) ~[groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:323) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:362) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.PogoMetaClassSite.callCurrent(PogoMetaClassSite.java:61) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:185) ~[groovy-3.0.9.jar!/:3.0.9]
        at rundeck.quartzjobs.ExecutionJob$_execute_closure1.doCall(ExecutionJob.groovy:100) ~[classes!/:?]
        at rundeck.quartzjobs.ExecutionJob$_execute_closure1.doCall(ExecutionJob.groovy) ~[classes!/:?]
        at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
        at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
        at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
        at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
        at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:107) ~[groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:323) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:274) ~[groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1035) ~[groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.Closure.call(Closure.java:412) ~[groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.Closure.call(Closure.java:406) ~[groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.Closure.run(Closure.java:493) ~[groovy-3.0.9.jar!/:3.0.9]
        at com.codahale.metrics.Timer.time(Timer.java:151) ~[metrics-core-4.2.18.jar!/:4.2.18]
        at com.codahale.metrics.Timer$time.call(Unknown Source) ~[?:?]
        at rundeck.quartzjobs.ExecutionJob.execute(ExecutionJob.groovy:99) ~[classes!/:?]
        at org.quartz.core.JobRunShell.run(JobRunShell.java:202) ~[quartz-2.3.2.jar!/:?]
        ... 1 more
[2024-08-15T15:00:00,026] ERROR core.ErrorLogger - Job (ITOPS:Dynamic Pricing Service Cache Refresh:ECOM Cache Refresh.578592:Dynamic Pricing Service Cache Refresh threw an exception.
org.quartz.SchedulerException: Job threw an unhandled exception.
        at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz-2.3.2.jar!/:?]
        at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:573) [quartz-2.3.2.jar!/:?]
Caused by: java.lang.RuntimeException: failed to lookup scheduledException object from job data map: id: f84afd03-663b-4325-880c-ac1766e24994
        at jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[?:?]
        at jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) ~[?:?]
        at jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) ~[?:?]
        at java.lang.reflect.Constructor.newInstance(Constructor.java:490) ~[?:?]
        at org.codehaus.groovy.reflection.CachedConstructor.invoke(CachedConstructor.java:72) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.reflection.CachedConstructor.doConstructorInvoke(CachedConstructor.java:59) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.ConstructorSite$ConstructorSiteNoUnwrap.callConstructor(ConstructorSite.java:84) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallConstructor(CallSiteArray.java:59) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:263) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:277) ~[groovy-3.0.9.jar!/:3.0.9]
        at rundeck.quartzjobs.ExecutionJob.fetchScheduledExecution(ExecutionJob.groovy:657) ~[classes!/:?]
        at rundeck.quartzjobs.ExecutionJob.initialize(ExecutionJob.groovy:226) ~[classes!/:?]
        at rundeck.quartzjobs.ExecutionJob$initialize.callCurrent(Unknown Source) ~[?:?]
        at rundeck.quartzjobs.ExecutionJob.execute_internal(ExecutionJob.groovy:121) ~[classes!/:?]
        at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
        at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
        at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
        at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
        at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:107) ~[groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:323) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:362) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.PogoMetaClassSite.callCurrent(PogoMetaClassSite.java:61) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:185) ~[groovy-3.0.9.jar!/:3.0.9]
        at rundeck.quartzjobs.ExecutionJob$_execute_closure1.doCall(ExecutionJob.groovy:100) ~[classes!/:?]
        at rundeck.quartzjobs.ExecutionJob$_execute_closure1.doCall(ExecutionJob.groovy) ~[classes!/:?]
        at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
        at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
        at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
        at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
        at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:107) ~[groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:323) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:274) ~[groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1035) ~[groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.Closure.call(Closure.java:412) ~[groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.Closure.call(Closure.java:406) ~[groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.Closure.run(Closure.java:493) ~[groovy-3.0.9.jar!/:3.0.9]
        at com.codahale.metrics.Timer.time(Timer.java:151) ~[metrics-core-4.2.18.jar!/:4.2.18]
        at com.codahale.metrics.Timer$time.call(Unknown Source) ~[?:?]
        at rundeck.quartzjobs.ExecutionJob.execute(ExecutionJob.groovy:99) ~[classes!/:?]
        at org.quartz.core.JobRunShell.run(JobRunShell.java:202) ~[quartz-2.3.2.jar!/:?]
        ... 1 more
[2024-08-15T15:00:00,028] ERROR listeners.ExceptionPrinterJobListener - Exception occurred in job: Runs Dynamic Pricing Service Cache Refresh Command
org.quartz.JobExecutionException: org.quartz.SchedulerException: Job threw an unhandled exception. [See nested exception: java.lang.RuntimeException: failed to lookup scheduledException object from job data map: id: f84afd03-663b-4325-880c-ac1766e24994]
        at org.quartz.core.JobRunShell.run(JobRunShell.java:218) [quartz-2.3.2.jar!/:?]
        at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:573) [quartz-2.3.2.jar!/:?]
Caused by: org.quartz.SchedulerException: Job threw an unhandled exception.
        at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz-2.3.2.jar!/:?]
        ... 1 more
Caused by: java.lang.RuntimeException: failed to lookup scheduledException object from job data map: id: f84afd03-663b-4325-880c-ac1766e24994
        at jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[?:?]
        at jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) ~[?:?]
        at jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) ~[?:?]
        at java.lang.reflect.Constructor.newInstance(Constructor.java:490) ~[?:?]
        at org.codehaus.groovy.reflection.CachedConstructor.invoke(CachedConstructor.java:72) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.reflection.CachedConstructor.doConstructorInvoke(CachedConstructor.java:59) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.ConstructorSite$ConstructorSiteNoUnwrap.callConstructor(ConstructorSite.java:84) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallConstructor(CallSiteArray.java:59) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:263) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:277) ~[groovy-3.0.9.jar!/:3.0.9]
        at rundeck.quartzjobs.ExecutionJob.fetchScheduledExecution(ExecutionJob.groovy:657) ~[classes!/:?]
        at rundeck.quartzjobs.ExecutionJob.initialize(ExecutionJob.groovy:226) ~[classes!/:?]
        at rundeck.quartzjobs.ExecutionJob$initialize.callCurrent(Unknown Source) ~[?:?]
        at rundeck.quartzjobs.ExecutionJob.execute_internal(ExecutionJob.groovy:121) ~[classes!/:?]
        at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
        at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
        at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
        at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
        at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:107) ~[groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:323) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:362) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.PogoMetaClassSite.callCurrent(PogoMetaClassSite.java:61) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:185) ~[groovy-3.0.9.jar!/:3.0.9]
        at rundeck.quartzjobs.ExecutionJob$_execute_closure1.doCall(ExecutionJob.groovy:100) ~[classes!/:?]
        at rundeck.quartzjobs.ExecutionJob$_execute_closure1.doCall(ExecutionJob.groovy) ~[classes!/:?]
        at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
        at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
        at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
        at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
        at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:107) ~[groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:323) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:274) ~[groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1035) ~[groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.Closure.call(Closure.java:412) ~[groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.Closure.call(Closure.java:406) ~[groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.Closure.run(Closure.java:493) ~[groovy-3.0.9.jar!/:3.0.9]
        at com.codahale.metrics.Timer.time(Timer.java:151) ~[metrics-core-4.2.18.jar!/:4.2.18]
        at com.codahale.metrics.Timer$time.call(Unknown Source) ~[?:?]
        at rundeck.quartzjobs.ExecutionJob.execute(ExecutionJob.groovy:99) ~[classes!/:?]
        at org.quartz.core.JobRunShell.run(JobRunShell.java:202) ~[quartz-2.3.2.jar!/:?]
        ... 1 more
[2024-08-15T15:00:00,031] ERROR listeners.ExceptionPrinterJobListener - Exception occurred in job: Runs Dynamic Pricing Service Cache Refresh Command
org.quartz.JobExecutionException: org.quartz.SchedulerException: Job threw an unhandled exception. [See nested exception: java.lang.RuntimeException: failed to lookup scheduledException object from job data map: id: f84afd03-663b-4325-880c-ac1766e24994]
        at org.quartz.core.JobRunShell.run(JobRunShell.java:218) [quartz-2.3.2.jar!/:?]
        at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:573) [quartz-2.3.2.jar!/:?]
Caused by: org.quartz.SchedulerException: Job threw an unhandled exception.
        at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz-2.3.2.jar!/:?]
        ... 1 more
Caused by: java.lang.RuntimeException: failed to lookup scheduledException object from job data map: id: f84afd03-663b-4325-880c-ac1766e24994
        at jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[?:?]
        at jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) ~[?:?]
        at jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) ~[?:?]
        at java.lang.reflect.Constructor.newInstance(Constructor.java:490) ~[?:?]
        at org.codehaus.groovy.reflection.CachedConstructor.invoke(CachedConstructor.java:72) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.reflection.CachedConstructor.doConstructorInvoke(CachedConstructor.java:59) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.ConstructorSite$ConstructorSiteNoUnwrap.callConstructor(ConstructorSite.java:84) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallConstructor(CallSiteArray.java:59) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:263) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:277) ~[groovy-3.0.9.jar!/:3.0.9]
        at rundeck.quartzjobs.ExecutionJob.fetchScheduledExecution(ExecutionJob.groovy:657) ~[classes!/:?]
        at rundeck.quartzjobs.ExecutionJob.initialize(ExecutionJob.groovy:226) ~[classes!/:?]
        at rundeck.quartzjobs.ExecutionJob$initialize.callCurrent(Unknown Source) ~[?:?]
        at rundeck.quartzjobs.ExecutionJob.execute_internal(ExecutionJob.groovy:121) ~[classes!/:?]
        at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
        at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
        at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
        at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
        at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:107) ~[groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:323) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:362) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.PogoMetaClassSite.callCurrent(PogoMetaClassSite.java:61) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:185) ~[groovy-3.0.9.jar!/:3.0.9]
        at rundeck.quartzjobs.ExecutionJob$_execute_closure1.doCall(ExecutionJob.groovy:100) ~[classes!/:?]
        at rundeck.quartzjobs.ExecutionJob$_execute_closure1.doCall(ExecutionJob.groovy) ~[classes!/:?]
        at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
        at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
        at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
        at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
        at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:107) ~[groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:323) ~[groovy-3.0.9.jar!/:3.0.9]
        at org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:274) ~[groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1035) ~[groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.Closure.call(Closure.java:412) ~[groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.Closure.call(Closure.java:406) ~[groovy-3.0.9.jar!/:3.0.9]
        at groovy.lang.Closure.run(Closure.java:493) ~[groovy-3.0.9.jar!/:3.0.9]
        at com.codahale.metrics.Timer.time(Timer.java:151) ~[metrics-core-4.2.18.jar!/:4.2.18]
        at com.codahale.metrics.Timer$time.call(Unknown Source) ~[?:?]
        at rundeck.quartzjobs.ExecutionJob.execute(ExecutionJob.groovy:99) ~[classes!/:?]
        at org.quartz.core.JobRunShell.run(JobRunShell.java:202) ~[quartz-2.3.2.jar!/:?]
        ... 1 more

Andrew Meyer

unread,
Aug 16, 2024, 10:04:04 AMAug 16
to rundeck-discuss
Any help?

rac...@rundeck.com

unread,
Aug 16, 2024, 10:30:52 AMAug 16
to rundeck-discuss
Hi Andrew,

Ok, it seems that your project is full of scheduled jobs (and rundeck tries to launch them before the project is fully exported).

I think the best approach is to disable all scheduled executions in the original instance (to do so, you can go to the jobs page, click the "Bulk Edit", select the jobs, click the "Perform Actions" and then "Disable Schedule" ), and then export and import into the new instance. Now, in the new instance, enable all schedules.

Regards.

Andrew Meyer

unread,
Aug 16, 2024, 12:03:41 PMAug 16
to rundeck-discuss
ok, thank you!

Andrew Meyer

unread,
Aug 16, 2024, 2:58:11 PMAug 16
to rundeck-discuss
Can I disable the scheduled jobs upon import?

rac...@rundeck.com

unread,
Aug 16, 2024, 5:43:22 PMAug 16
to rundeck-discuss
Hi Andrew,

No, but you may write a script to disable them first via API/RD CLI, and then export them (the opposite for importing them).

Andrew Meyer

unread,
Aug 19, 2024, 11:54:37 AMAug 19
to rundeck-discuss
I was able to pull the project from another server and disable all the scheduled jobs in there for now.  But I can't import them into the other server.  Still getting 500 error using the RD cli.  I'm even doing this AS the rundeck user.


~]$ rd projects archives import -p ITOPS -f ITOPS-20240819-094230.rdproject.jar

# Including extension: org.rundeck.client.tool.commands.repository.Plugins
# Including extension: org.rundeck.client.tool.commands.enterprise.license.License
# Including extension: org.rundeck.client.tool.commands.enterprise.cluster.Cluster
# Including extension: org.rundeck.client.ext.acl.Acl
Aug 19, 2024 10:52:53 AM okhttp3.internal.platform.Platform log

INFO: --> GET http://10.244.44.103:4440/ http/1.1
Aug 19, 2024 10:52:53 AM okhttp3.internal.platform.Platform log
INFO: User-Agent: rd-cli-tool/2.0.8 (rundeck-cli/2.0.8)
Aug 19, 2024 10:52:53 AM okhttp3.internal.platform.Platform log
INFO: Host: 10.244.44.103:4440
Aug 19, 2024 10:52:53 AM okhttp3.internal.platform.Platform log
INFO: Connection: Keep-Alive
Aug 19, 2024 10:52:53 AM okhttp3.internal.platform.Platform log
INFO: Accept-Encoding: gzip
Aug 19, 2024 10:52:53 AM okhttp3.internal.platform.Platform log
INFO: --> END GET
Aug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform log
INFO: <-- 302 Found http://10.244.44.103:4440/ (150ms)
Aug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform log
INFO: Date: Mon, 19 Aug 2024 15:52:53 GMT
Aug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform log
INFO: Vary: Origin
Aug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform log
INFO: Vary: Access-Control-Request-Method
Aug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform log
INFO: Vary: Access-Control-Request-Headers
Aug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform log
INFO: Set-Cookie: JSESSIONID=node01reh3m87u8aqdezo0koub228q0.node0; Path=/; HttpOnly; SameSite=Lax
Aug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform log

INFO: Expires: Thu, 01 Jan 1970 00:00:00 GMT
Aug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform logAug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform log
INFO: Content-Length: 0
Aug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform log
INFO: <-- END HTTP
Aug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform logAug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform log
INFO: User-Agent: rd-cli-tool/2.0.8 (rundeck-cli/2.0.8)
Aug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform log
INFO: Host: 10.244.44.103:4440
Aug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform log
INFO: Connection: Keep-Alive
Aug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform log
INFO: Accept-Encoding: gzip
Aug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform log
INFO: Cookie: JSESSIONID=node01reh3m87u8aqdezo0koub228q0.node0
Aug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform log
INFO: --> END GET
Aug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform log
INFO: <-- 200 OK http://10.244.44.103:4440/user/login (832ms)
Aug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform log
INFO: Date: Mon, 19 Aug 2024 15:52:54 GMT
Aug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform log
INFO: Vary: Origin
Aug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform log
INFO: Vary: Access-Control-Request-Method
Aug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform log
INFO: Vary: Access-Control-Request-Headers
Aug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform log
INFO: X-Frame-Options: deny
Aug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform log
INFO: X-XSS-Protection: 0
Aug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform log
INFO: X-Content-Type-Options: nosniff
Aug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform log

INFO: Content-Security-Policy: default-src 'none' ; script-src 'self' https://content.analytics.rundeck.com 'unsafe-inline' 'unsafe-eval' ; style-src 'self' 'unsafe-inline' ; img-src * data: ; font-src 'self' data: ; connect-src 'self' https://api.rundeck.com https://data.analytics.rundeck.com ; form-action 'self' ;
Aug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform log
INFO: Content-Language: en-US
Aug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform log
INFO: Content-Type: text/html;charset=utf-8
Aug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform log
INFO: Transfer-Encoding: chunked
Aug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform log
INFO: <-- END HTTP
Aug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform logAug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform log
INFO: User-Agent: rd-cli-tool/2.0.8 (rundeck-cli/2.0.8)
Aug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform log
INFO: Content-Type: application/x-www-form-urlencoded
Aug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform log
INFO: Content-Length: 45
Aug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform log
INFO: Host: 10.244.44.103:4440
Aug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform log
INFO: Connection: Keep-Alive
Aug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform log
INFO: Accept-Encoding: gzip
Aug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform log
INFO: Cookie: JSESSIONID=node01reh3m87u8aqdezo0koub228q0.node0
Aug 19, 2024 10:52:54 AM okhttp3.internal.platform.Platform log
INFO: --> END POST
Aug 19, 2024 10:52:55 AM okhttp3.internal.platform.Platform log
INFO: <-- 302 Found http://10.244.44.103:4440/j_security_check (1045ms)
Aug 19, 2024 10:52:55 AM okhttp3.internal.platform.Platform log
INFO: Date: Mon, 19 Aug 2024 15:52:54 GMT
Aug 19, 2024 10:52:55 AM okhttp3.internal.platform.Platform log
INFO: Vary: Origin
Aug 19, 2024 10:52:55 AM okhttp3.internal.platform.Platform log
INFO: Vary: Access-Control-Request-Method
Aug 19, 2024 10:52:55 AM okhttp3.internal.platform.Platform log
INFO: Vary: Access-Control-Request-Headers
Aug 19, 2024 10:52:55 AM okhttp3.internal.platform.Platform log
INFO: Set-Cookie: JSESSIONID=node0hhwiw5131oec6xb0rtdvpg5p1.node0; Path=/; HttpOnly; SameSite=Lax
Aug 19, 2024 10:52:55 AM okhttp3.internal.platform.Platform log

INFO: Expires: Thu, 01 Jan 1970 00:00:00 GMT
Aug 19, 2024 10:52:55 AM okhttp3.internal.platform.Platform logAug 19, 2024 10:52:55 AM okhttp3.internal.platform.Platform log
INFO: Content-Length: 0
Aug 19, 2024 10:52:55 AM okhttp3.internal.platform.Platform log
INFO: <-- END HTTP
Aug 19, 2024 10:52:55 AM okhttp3.internal.platform.Platform log

INFO: --> GET http://10.244.44.103:4440/ http/1.1
Aug 19, 2024 10:52:55 AM okhttp3.internal.platform.Platform log
INFO: User-Agent: rd-cli-tool/2.0.8 (rundeck-cli/2.0.8)
Aug 19, 2024 10:52:55 AM okhttp3.internal.platform.Platform log
INFO: Host: 10.244.44.103:4440
Aug 19, 2024 10:52:55 AM okhttp3.internal.platform.Platform log
INFO: Connection: Keep-Alive
Aug 19, 2024 10:52:55 AM okhttp3.internal.platform.Platform log
INFO: Accept-Encoding: gzip
Aug 19, 2024 10:52:55 AM okhttp3.internal.platform.Platform log
INFO: Cookie: JSESSIONID=node0hhwiw5131oec6xb0rtdvpg5p1.node0
Aug 19, 2024 10:52:55 AM okhttp3.internal.platform.Platform log
INFO: --> END GET
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: <-- 302 Found http://10.244.44.103:4440/ (378ms)
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: Date: Mon, 19 Aug 2024 15:52:55 GMT
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: Vary: Origin
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: Vary: Access-Control-Request-Method
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: Vary: Access-Control-Request-Headers
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: X-Frame-Options: deny
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: X-XSS-Protection: 0
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: X-Content-Type-Options: nosniff
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log

INFO: Content-Security-Policy: default-src 'none' ; script-src 'self' https://content.analytics.rundeck.com 'unsafe-inline' 'unsafe-eval' ; style-src 'self' 'unsafe-inline' ; img-src * data: ; font-src 'self' data: ; connect-src 'self' https://api.rundeck.com https://data.analytics.rundeck.com ; form-action 'self' ;
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: Set-Cookie: JSESSIONID=node010v3w8ah1dkb01lx704je0v5ar2.node0; Path=/; HttpOnly; SameSite=Lax
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log

INFO: Expires: Thu, 01 Jan 1970 00:00:00 GMT
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: Location: https://rundeck-preprod.paneracloud.com/menu/home
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: Content-Length: 0
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: <-- END HTTP
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: --> GET https://rundeck-preprod.paneracloud.com/menu/home http/1.1
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: User-Agent: rd-cli-tool/2.0.8 (rundeck-cli/2.0.8)
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: Host: rundeck-preprod.paneracloud.com
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: Connection: Keep-Alive
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: Accept-Encoding: gzip
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: --> END GET
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: <-- 302 Found https://rundeck-preprod.paneracloud.com/menu/home (7ms)
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: Date: Mon, 19 Aug 2024 15:52:56 GMT
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: Vary: Origin
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: Vary: Access-Control-Request-Method
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: Vary: Access-Control-Request-Headers
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: Set-Cookie: JSESSIONID=node01o34pns88kf3myuchx1czcps33.node0; Path=/; Secure; HttpOnly; SameSite=Lax
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log

INFO: Expires: Thu, 01 Jan 1970 00:00:00 GMT
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: Location: https://rundeck-preprod.paneracloud.com/user/login
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: Content-Length: 0
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: <-- END HTTP
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: --> GET https://rundeck-preprod.paneracloud.com/user/login http/1.1
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: User-Agent: rd-cli-tool/2.0.8 (rundeck-cli/2.0.8)
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: Host: rundeck-preprod.paneracloud.com
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: Connection: Keep-Alive
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: Accept-Encoding: gzip
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: Cookie: JSESSIONID=node01o34pns88kf3myuchx1czcps33.node0
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: --> END GET
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: <-- 200 OK https://rundeck-preprod.paneracloud.com/user/login (33ms)
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: Date: Mon, 19 Aug 2024 15:52:56 GMT
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: Vary: Origin
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: Vary: Access-Control-Request-Method
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: Vary: Access-Control-Request-Headers
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: X-Frame-Options: deny
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: X-XSS-Protection: 0
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: X-Content-Type-Options: nosniff
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log

INFO: Content-Security-Policy: default-src 'none' ; script-src 'self' https://content.analytics.rundeck.com 'unsafe-inline' 'unsafe-eval' ; style-src 'self' 'unsafe-inline' ; img-src * data: ; font-src 'self' data: ; connect-src 'self' https://api.rundeck.com https://data.analytics.rundeck.com ; form-action 'self' ;
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: Content-Language: en-US
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: Content-Type: text/html;charset=utf-8
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: Transfer-Encoding: chunked
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: <-- END HTTP
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform logAug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: Accept: application/json
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: User-Agent: rd-cli-tool/2.0.8 (rundeck-cli/2.0.8)
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: Content-Type: application/zip
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: Content-Length: 769590829
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: Host: 10.244.44.103:4440
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: Connection: Keep-Alive
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: Accept-Encoding: gzip
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: Cookie: JSESSIONID=node010v3w8ah1dkb01lx704je0v5ar2.node0
Aug 19, 2024 10:52:56 AM okhttp3.internal.platform.Platform log
INFO: --> END PUT
Aug 19, 2024 10:52:58 AM okhttp3.internal.platform.Platform log
INFO: <-- 500 Server Error http://10.244.44.103:4440/api/29/project/ITOPS/import?jobUuidOption=preserve&importExecutions=true&importConfig=false&importACL=false&importScm=false&importWebhooks=false&whkRegenAuthTokens=false&importNodesSources=false (1980ms)
Aug 19, 2024 10:52:58 AM okhttp3.internal.platform.Platform log
INFO: Date: Mon, 19 Aug 2024 15:52:56 GMT
Aug 19, 2024 10:52:58 AM okhttp3.internal.platform.Platform log
INFO: Vary: Origin
Aug 19, 2024 10:52:58 AM okhttp3.internal.platform.Platform log
INFO: Vary: Access-Control-Request-Method
Aug 19, 2024 10:52:58 AM okhttp3.internal.platform.Platform log
INFO: Vary: Access-Control-Request-Headers
Aug 19, 2024 10:52:58 AM okhttp3.internal.platform.Platform log
INFO: X-Frame-Options: deny
Aug 19, 2024 10:52:58 AM okhttp3.internal.platform.Platform log
INFO: X-XSS-Protection: 0
Aug 19, 2024 10:52:58 AM okhttp3.internal.platform.Platform log
INFO: X-Content-Type-Options: nosniff
Aug 19, 2024 10:52:58 AM okhttp3.internal.platform.Platform log

INFO: Content-Security-Policy: default-src 'none' ; script-src 'self' https://content.analytics.rundeck.com 'unsafe-inline' 'unsafe-eval' ; style-src 'self' 'unsafe-inline' ; img-src * data: ; font-src 'self' data: ; connect-src 'self' https://api.rundeck.com https://data.analytics.rundeck.com ; form-action 'self' ;
Aug 19, 2024 10:52:58 AM okhttp3.internal.platform.Platform log
INFO: Content-Type: application/json
Aug 19, 2024 10:52:58 AM okhttp3.internal.platform.Platform log
INFO: Transfer-Encoding: chunked
Aug 19, 2024 10:52:58 AM okhttp3.internal.platform.Platform log

rac...@rundeck.com

unread,
Aug 19, 2024, 1:15:29 PMAug 19
to rundeck-discuss

Hi Andrew,

Similar to this. Could you double-check the rundeck instance logs when doing that rd-cli action? (now, I’m not sure if the latest service.log output corresponds to the specific rd-cli call).

Also, could you share the server rundeck-config.properties config? What happens if you try to upload that file via Webgui?

Does this happen with all projects? Could you try with another mockup/basic project?

Regards.

Andrew Meyer

unread,
Aug 19, 2024, 1:24:18 PMAug 19
to rundeck-discuss
I have only been working on stuff as it comes up.  I don't know if this happens for all of them.

~]$ sudo cat /etc/rundeck/rundeck-config.properties
#loglevel.default is the default log level for jobs: ERROR,WARN,INFO,VERBOSE,DEBUG
loglevel.default=DEBUG
rdeck.base=/var/lib/rundeck

#rss.enabled if set to true enables RSS feeds that are public (non-authenticated)
rss.enabled=false
# change hostname here
grails.serverURL=https://rundeck-preprod.domain.com
#grails.serverURL=http://INT.IP.ADDR:4440
server.useForwardHeaders=true
dataSource.driverClassName = oracle.jdbc.OracleDriver

dataSource.dialect = org.rundeck.hibernate.RundeckOracleDialect
dataSource.properties.validationQuery = SELECT 1 FROM DUAL
grails.plugin.databasemigration.updateOnStart=true

# Encryption for key storage
rundeck.storage.provider.1.type=db
rundeck.storage.provider.1.path=keys

rundeck.storage.converter.1.type=jasypt-encryption
rundeck.storage.converter.1.path=keys
rundeck.storage.converter.1.config.encryptorType=custom
rundeck.storage.converter.1.config.password=
rundeck.storage.converter.1.config.algorithm=
rundeck.storage.converter.1.config.provider=BC

# Encryption for project config storage
rundeck.projectsStorageType=db

rundeck.config.storage.converter.1.type=jasypt-encryption
rundeck.config.storage.converter.1.path=projects
rundeck.config.storage.converter.1.config.password=
rundeck.config.storage.converter.1.config.encryptorType=custom
rundeck.config.storage.converter.1.config.algorithm=
rundeck.config.storage.converter.1.config.provider=BC

rundeck.feature.repository.enabled=true

It looks like my tmp folder keep filling up.  I was hoping to keep this at 10GB....

This was in the service.log
        ... 109 more
[2024-08-19T10:52:58,262] ERROR errors.GrailsExceptionResolver - IOException occurred when processing request: [PUT] /api/29/project/ITOPS/import
No space left on device. Stacktrace follows:
java.lang.reflect.UndeclaredThrowableException: null
        at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:780) ~[spring-aop-5.3.27.jar!/:5.3.27]
        at org.rundeck.app.authorization.RdAuthorizeInterceptor.invoke(RdAuthorizeInterceptor.groovy:72) ~[classes!/:?]
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) ~[spring-aop-5.3.27.jar!/:5.3.27]
        at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) ~[spring-aop-5.3.27.jar!/:5.3.27]
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338) [jetty-util-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315) [jetty-util-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173) [jetty-util-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131) [jetty-util-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409) [jetty-util-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883) [jetty-util-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034) [jetty-util-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: java.io.IOException: No space left on device
        at java.io.File.createTempFile(File.java:2129) ~[?:?]
        at java.io.File.createTempFile(File.java:2175) ~[?:?]
        at com.dtolabs.rundeck.util.ZipReader.copyToTemp(ZipReader.groovy:140) ~[classes!/:?]

        at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
        at rundeck.services.ProjectService$__tt__importToProject_closure72$_closure113$_closure115$_closure123.doCall(ProjectService.groovy:1068) ~[classes!/:?]
        at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:
[2024-08-19T10:52:58,389] WARN  config.NavigableMap - Accessing config key '[errorpage]' through dot notation is deprecated, and it will be removed in a future release. Use 'config.getProperty(key, targetClass)' instead.
[2024-08-19T10:52:58,390] WARN  config.NavigableMap - Accessing config key '[errorpage, hidestacktrace]' through dot notation is deprecated, and it will be removed in a future release. Use 'config.getProperty(key, targetClass)' inst
ead.
[2024-08-19T10:52:58,398] ERROR StackTrace - Full Stack Trace:
java.lang.NullPointerException: null
        at org.grails.plugins.web.interceptors.GrailsInterceptorHandlerInterceptorAdapter.postHandle(GrailsInterceptorHandlerInterceptorAdapter.groovy:100) ~[grails-plugin-interceptors-5.3.2.jar!/:5.3.2]
        at org.springframework.web.servlet.HandlerExecutionChain.applyPostHandle(HandlerExecutionChain.java:165) ~[spring-webmvc-5.3.27.jar!/:5.3.27]
        at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1079) ~[spring-webmvc-5.3.27.jar!/:5.3.27]
        at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:965) ~[spring-webmvc-5.3.27.jar!/:5.3.27]
        at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006) ~[spring-webmvc-5.3.27.jar!/:5.3.27]
        at org.springframework.web.servlet.FrameworkServlet.doPut(FrameworkServlet.java:920) ~[spring-webmvc-5.3.27.jar!/:5.3.27]
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:668) ~[javax.servlet-api-4.0.1.jar!/:4.0.1]
        at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883) ~[spring-webmvc-5.3.27.jar!/:5.3.27]
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:750) ~[javax.servlet-api-4.0.1.jar!/:4.0.1]
        at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1656) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:111) ~[spring-web-5.3.27.jar!/:5.3.27]
        at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:111) ~[spring-web-5.3.27.jar!/:5.3.27]
        at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.grails.web.servlet.mvc.GrailsWebRequestFilter.doFilterInternal(GrailsWebRequestFilter.java:77) ~[grails-web-mvc-5.3.2.jar!/:5.3.2]
        at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) ~[spring-web-5.3.27.jar!/:5.3.27]
        at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:111) ~[spring-web-5.3.27.jar!/:5.3.27]
        at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:111) ~[spring-web-5.3.27.jar!/:5.3.27]
        at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:111) ~[spring-web-5.3.27.jar!/:5.3.27]
        at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:552) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
[2024-08-19T10:52:58,401] ERROR StackTrace - Full Stack Trace:
java.lang.NullPointerException: null
        at org.grails.plugins.web.interceptors.GrailsInterceptorHandlerInterceptorAdapter.postHandle(GrailsInterceptorHandlerInterceptorAdapter.groovy:100) ~[grails-plugin-interceptors-5.3.2.jar!/:5.3.2]
        at org.springframework.web.servlet.HandlerExecutionChain.applyPostHandle(HandlerExecutionChain.java:165) ~[spring-webmvc-5.3.27.jar!/:5.3.27]
        at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1079) ~[spring-webmvc-5.3.27.jar!/:5.3.27]
        at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:965) ~[spring-webmvc-5.3.27.jar!/:5.3.27]
        at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006) ~[spring-webmvc-5.3.27.jar!/:5.3.27]
        at org.springframework.web.servlet.FrameworkServlet.doPut(FrameworkServlet.java:920) ~[spring-webmvc-5.3.27.jar!/:5.3.27]
        at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883) ~[spring-webmvc-5.3.27.jar!/:5.3.27]
        at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1656) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.grails.web.servlet.mvc.GrailsWebRequestFilter.doFilterInternal(GrailsWebRequestFilter.java:77) ~[grails-web-mvc-5.3.2.jar!/:5.3.2]
        at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:552) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) ~[jetty-server-9.4.48.v20220622.jar!/:9.4.48.v20220622]
[2024-08-19T10:52:58,404] ERROR errors.GrailsExceptionResolver - NullPointerException occurred when processing request: [PUT] /api/29/project/ITOPS/import
Stacktrace follows:
java.lang.NullPointerException: null
        at org.grails.plugins.web.interceptors.GrailsInterceptorHandlerInterceptorAdapter.postHandle(GrailsInterceptorHandlerInterceptorAdapter.groovy:100) ~[grails-plugin-interceptors-5.3.2.jar!/:5.3.2]
        at org.springframework.web.servlet.HandlerExecutionChain.applyPostHandle(HandlerExecutionChain.java:165) ~[spring-webmvc-5.3.27.jar!/:5.3.27]
        at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1079) ~[spring-webmvc-5.3.27.jar!/:5.3.27]
        at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:965) ~[spring-webmvc-5.3.27.jar!/:5.3.27]
        at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006) ~[spring-webmvc-5.3.27.jar!/:5.3.27]
        at org.springframework.web.servlet.FrameworkServlet.doPut(FrameworkServlet.java:920) ~[spring-webmvc-5.3.27.jar!/:5.3.27]
        at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883) ~[spring-webmvc-5.3.27.jar!/:5.3.27]
        at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1656) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.grails.web.servlet.mvc.GrailsWebRequestFilter.doFilterInternal(GrailsWebRequestFilter.java:77) ~[grails-web-mvc-5.3.2.jar!/:5.3.2]
        at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:552) ~[jetty-servlet-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) ~[jetty-server-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:618) ~[jetty-security-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) ~[jetty-server-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) ~[jetty-server-9.4.48.v20220622.jar!/:9.4.48.v20220622]
        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1624) ~[jetty-server-9.4.48.v20220622.jar!/:9.4.48.v20220622]

Andrew Meyer

unread,
Aug 20, 2024, 10:36:25 AMAug 20
to rundeck-discuss
This is also happening on my new prod server.  It is NOT in use.   But I can't import anything.  I exported the same project and disabled all execution and schedules.  But it fails w/ a 500 error.

rac...@rundeck.com

unread,
Aug 20, 2024, 10:58:42 AMAug 20
to rundeck-discuss

Hi Andrew,

Regarding this:

Caused by: java.io.IOException: No space left on device

The root cause is clear.

Could you check the server filesystem? (not only the tmp directory) do you see the same behavior after cleaning your /tmp directory?

Also (and after double checking that you’ve enough space in your server), what about importing the project via Webgui? do you see the same error 500? Did you try with a basic/mockup project? What do you see on the logs?

Another alternative way is to import your projects via Transfering Rundeck Jobs, take a look at this.

Regards.

Andrew Meyer

unread,
Aug 20, 2024, 12:16:12 PMAug 20
to rundeck-discuss
I have cronjobs clearing out /opt/rundecktmp filesystem.  I have 10G dedicated and can increase it.

The web gui does error out as well.  I will get you a screenshot.

Transferring jobs from host to host:  I was able to do previously but can't due to network restrictions on this last host.  I'm trying this again from the current prod host.


Andrew Meyer

unread,
Aug 20, 2024, 12:55:48 PMAug 20
to rundeck-discuss
I keep getting this from the web ui

There was an error exporting the Project Archive
Project export request failed: Broken pipe (Write failed)

Andrew Meyer

unread,
Aug 21, 2024, 10:04:50 AMAug 21
to rundeck-discuss
Is there a way to increase the timeout value without changing the production server?  I tried that from RD cli and set it to 24 hours or something ridiculous and it didn't help.

rac...@rundeck.com

unread,
Aug 21, 2024, 11:19:25 AMAug 21
to rundeck-discuss

Hi Andrew,

Following the service.log output and the WebGUI error, I am unsure if the root cause is a timeout (check the detailed explanation here). Pretty sure that is a network traffic issue.

Now regarding this:

Is there a way to increase the timeout value without changing the production server? I tried that from RD cli and set it to 24 hours or something ridiculous and it didn’t help.

Any change on the Rundeck instance (like: -Dserver.servlet.session.timeout=3200 as an init parameter on the rundeckd file) needs to restart the service.

As an extreme way to solve this, did you try exporting the jobs instead of the whole project? You can automate that process using a loop in a script.

Regards.

Andrew Meyer

unread,
Aug 21, 2024, 11:25:36 AMAug 21
to rundeck-discuss
Well I'm having problems with using the RD cli, it times out, runs out of space or gives a 500 HTTP error.

I did not export the jobs instead of the whole project...I guess I could piece it together.  But is a bit frustrating.

James F.

unread,
Aug 24, 2024, 11:36:01 PMAug 24
to rundeck-discuss
Double check your Grails IP - Your logs show 10.244.44.103, but your rundeck-config.properties (which it looks like you attempted to obfuscate) are showing the grails URL as rundeck-prepod.domain.com (paneracloud.com?). You could be getting a timeout because you have a mismatch in the grails URL and what's defined in framework.properties. [ My guess? rundeck-config.properties has an IP an the framework.properties is using fqdn].

I'm super curious on the 'dynamic pricing service cache update' job does :D What time should I buy my sandwiches

Reply all
Reply to author
Forward
0 new messages