GoCD server crashes and won't start if use private Github repository

527 views

Skip to first unread message

Lawrence Spear

unread,

Jun 15, 2022, 4:57:32 PM6/15/22

to go-cd

I seem to be unable to get GoCD to use a private repo on Github without it completely crashing the server and putting it into a continuous restart/crash loop.

I've set up a simple example GoCD docker instance using gocd/gocd-server:v22.1.0 and gocd/gocd-agent-docker-dind:v22.1.0 with only 1 pipeline with a material that points a github repo that only contains a ReadMe.md and execute the ls command.

if the repo is public everything is fine. Even with or without username/password included.

if the repo is switched to private GoCD server will crash and get stuck in a restart/crash loop till I switch the repo back to public.

One bad material shouldn't be able to crash GoCD Server like this. I'd guess I've got the correct username/password since it works fine when public. The log file only contains two errors:

2022-06-15 20:50:08,040 ERROR [Thread-78] DefaultPluginManager:136 - This is an invalid request type :go.plugin-settings.get-configuration

2022-06-15 20:50:08,320 ERROR [Thread-78] PluginInfoBuilder:54 - Failed to fetch Plugin Settings metadata for plugin yum. Maybe the plugin does not implement plugin settings and view?

The only errors in the log file for the agent seems to get be not being able to find the server, so I'm guessing the agent isn't even being assigned the job before the crash.

Any ideas what is causing this?

Chad Wilson

unread,

Jun 16, 2022, 6:57:57 AM6/16/22

to go...@googlegroups.com

Hi Lawrence

That sounds odd - but there isn't really enough information below to tell anything. Those errors aren't of concern, or related.

Can you check what is contained within other log files in your log dir (/go-working-dir/logs by default) and /go-working-dir/wrapper.log?
Can you describe what you mean by "crashing"? Does the container die or get killed or just the Java process inside the container gets automatically restarted?
Can you include the rest of the logs (redacted if necessary) immediately before it "crashes"?
What external config settings are you starting the server or container with?

-Chad

--
You received this message because you are subscribed to the Google Groups "go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email to go-cd+un...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/go-cd/e78e96db-8b1d-48aa-a617-66f8fff422cfn%40googlegroups.com.

Lawrence Spear

unread,

Jun 16, 2022, 12:35:00 PM6/16/22

to go-cd

Hi Chad,

Thanks for the reply. Totally forgot about wrapper.log. This is my first time to setup GoCD in a few years and it's a little different now and using docker I sort of glossed over the actual running of wrapper since docker "magically" did it for me.

As for what I mean by crashing, when going to the GoCD site it gives you the GoCD server is starting please wait message after a while it will complete and a few moments after that it will go back to starting please wait. Looking in the wrapper.log it looks like the JVM is being killed and restarted after a timeout. Oddly the only errors are around the LDAP plugin, which is really strange since I don't use that. Only the file password plugin. When I have the repo set to public and I start the server I still get the ldap errors, but GoCD starts fine, so I'd assume the LDAP error can be ignored.

As for external config settings I'm just setting the port and volumes (/home/go and /godata). I'd copy/paste the command line here, but I use Synology NAS's docker GUI to launch this container, since I'm lazy and also still a docker newbie.

Here's the config.xml:

<?xml version="1.0" encoding="utf-8"?>
<cruise xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:noNamespaceSchemaLocation="cruise-config.xsd" schemaVersion="139">
<server agentAutoRegisterKey=" redacted " webhookSecret=" redacted " serverId=" redacted " tokenGenerationKey=" redacted ">
<security>
<authConfigs>
<authConfig id="users" pluginId="cd.go.authentication.passwordfile">
<property>
<key>PasswordFilePath</key>
<value>/home/go/users</value>
</property>
</authConfig>
</authConfigs>
</security>
<backup emailOnSuccess="true" emailOnFailure="true" />
<artifacts>
<artifactsDir>artifacts</artifactsDir>
</artifacts>
</server>
<pipelines group="defaultGroup">
<pipeline name="Test">
<materials>
<git url="https://github.com/mtmg-li/Pipeline-Test.git" branch="main" username="redacted" encryptedPassword="AES: redacted" />
</materials>
<stage name="Test">
<jobs>
<job name="Test">
<tasks>
<exec command="ls" />
</tasks>
</job>
</jobs>
</stage>
</pipeline>
</pipelines>
</cruise>

The config is really as simple as it gets, since I'd just started configuring the server.

Here's what's in the other logs:

go-server-perf.log - empty

plugin-cd.go.authentication.ldap.log:

2022-06-16 15:06:29,024 INFO [Thread-78] LdapPlugin:72 - Loading plugin null version 2.2.0-144

2022-06-16 15:06:29,103 ERROR [Thread-78] LdapPlugin:127 - Error while executing request go.plugin-settings.get-configuration

com.thoughtworks.go.plugin.api.exceptions.UnhandledRequestTypeException: This is an invalid request type :go.plugin-settings.get-configuration

at cd.go.plugin.base.dispatcher.RequestDispatcher.dispatch(RequestDispatcher.java:45)

at cd.go.authentication.ldap.LdapPlugin.handle(LdapPlugin.java:68)

at com.thoughtworks.go.plugin.infra.DefaultPluginManager.lambda$submitTo$0(DefaultPluginManager.java:134)

at com.thoughtworks.go.plugin.infra.FelixGoPluginOSGiFramework.executeActionOnTheService(FelixGoPluginOSGiFramework.java:208)

at com.thoughtworks.go.plugin.infra.FelixGoPluginOSGiFramework.doOn(FelixGoPluginOSGiFramework.java:164)

at com.thoughtworks.go.plugin.infra.DefaultPluginManager.submitTo(DefaultPluginManager.java:131)

at com.thoughtworks.go.plugin.access.PluginRequestHelper.submitRequest(PluginRequestHelper.java:49)

at com.thoughtworks.go.plugin.access.common.AbstractExtension.getPluginSettingsConfiguration(AbstractExtension.java:56)

at com.thoughtworks.go.plugin.access.common.settings.PluginSettingsMetadataLoader.lambda$findSettingsAndViewOfAllExtensionsIn$2(PluginSettingsMetadataLoader.java:84)

at java.base/java.util.stream.ReferencePipeline$3$1.accept(Unknown Source)

at java.base/java.util.stream.ReferencePipeline$2$1.accept(Unknown Source)

at java.base/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(Unknown Source)

at java.base/java.util.stream.AbstractPipeline.copyInto(Unknown Source)

at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(Unknown Source)

at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(Unknown Source)

at java.base/java.util.stream.AbstractPipeline.evaluate(Unknown Source)

at java.base/java.util.stream.ReferencePipeline.collect(Unknown Source)

at com.thoughtworks.go.plugin.access.common.settings.PluginSettingsMetadataLoader.findSettingsAndViewOfAllExtensionsIn(PluginSettingsMetadataLoader.java:89)

at com.thoughtworks.go.plugin.access.common.settings.PluginSettingsMetadataLoader.fetchPluginSettingsMetaData(PluginSettingsMetadataLoader.java:59)

at com.thoughtworks.go.plugin.access.common.settings.PluginSettingsMetadataLoader.pluginLoaded(PluginSettingsMetadataLoader.java:49)

at com.thoughtworks.go.plugin.infra.PluginLoader.lambda$doPostBundleInstallActivities$0(PluginLoader.java:113)

at org.apache.commons.collections4.IteratorUtils.forEach(IteratorUtils.java:1224)

at org.apache.commons.collections4.IterableUtils.forEach(IterableUtils.java:585)

at com.thoughtworks.go.plugin.infra.PluginLoader.lambda$doPostBundleInstallActivities$1(PluginLoader.java:113)

at org.apache.commons.collections4.IteratorUtils.forEach(IteratorUtils.java:1224)

at org.apache.commons.collections4.IterableUtils.forEach(IterableUtils.java:585)

at com.thoughtworks.go.plugin.infra.PluginLoader.doPostBundleInstallActivities(PluginLoader.java:112)

at com.thoughtworks.go.plugin.infra.PluginLoader.loadPlugin(PluginLoader.java:70)

at com.thoughtworks.go.plugin.infra.listeners.DefaultPluginJarChangeListener.refreshBundle(DefaultPluginJarChangeListener.java:180)

at com.thoughtworks.go.plugin.infra.listeners.DefaultPluginJarChangeListener.addPlugin(DefaultPluginJarChangeListener.java:123)

at com.thoughtworks.go.plugin.infra.listeners.DefaultPluginJarChangeListener.pluginJarAdded(DefaultPluginJarChangeListener.java:72)

at com.thoughtworks.go.plugin.infra.monitor.DefaultPluginJarLocationMonitor$PluginLocationMonitorThread$DoOnAllListeners.lambda$pluginJarAdded$0(DefaultPluginJarLocationMonitor.java:237)

at com.thoughtworks.go.plugin.infra.monitor.DefaultPluginJarLocationMonitor$PluginLocationMonitorThread$DoOnAllListeners.doOnAllPluginJarChangeListener(DefaultPluginJarLocationMonitor.java:258)

at com.thoughtworks.go.plugin.infra.monitor.DefaultPluginJarLocationMonitor$PluginLocationMonitorThread$DoOnAllListeners.pluginJarAdded(DefaultPluginJarLocationMonitor.java:237)

at com.thoughtworks.go.plugin.infra.monitor.PluginChangeNotifier.lambda$notify$0(PluginChangeNotifier.java:33)

at java.base/java.lang.Iterable.forEach(Unknown Source)

at com.thoughtworks.go.plugin.infra.monitor.PluginChangeNotifier.notify(PluginChangeNotifier.java:30)

at com.thoughtworks.go.plugin.infra.monitor.DefaultPluginJarLocationMonitor$PluginLocationMonitorThread.loadAndNotifyPluginsFrom(DefaultPluginJarLocationMonitor.java:204)

at com.thoughtworks.go.plugin.infra.monitor.DefaultPluginJarLocationMonitor$PluginLocationMonitorThread.oneShot(DefaultPluginJarLocationMonitor.java:191)

at com.thoughtworks.go.plugin.infra.monitor.DefaultPluginJarLocationMonitor$PluginLocationMonitorThread.run(DefaultPluginJarLocationMonitor.java:177)

plugin-cd.go.authentication.passwordfile.log:

2022-06-16 15:06:30,609 INFO [Thread-78] PasswordFilePlugin:72 - Loading plugin null version 2.1.0-123

2022-06-16 15:06:30,629 WARN [Thread-78] PasswordFilePlugin:97 - Request go.plugin-settings.get-configuration is not supported by plugin.

web-requests.log - empty

wrapper.log:

WARN | wrapper | 2022/06/16 15:06:09 | The "wrapper.java.additional.100" property was redefined on line #41 of configuration file: /go-server/wrapper-config/wrapper-properties.conf

WARN | wrapper | 2022/06/16 15:06:09 | Old Value wrapper.java.additional.100=-Dgo.console.stdout=true

WARN | wrapper | 2022/06/16 15:06:09 | New Value wrapper.java.additional.100=-Dgo.console.stdout=true

WARN | wrapper | 2022/06/16 15:06:09 | The "wrapper.java.additional.100" property was redefined on line #42 of configuration file: /go-server/wrapper-config/wrapper-properties.conf

WARN | wrapper | 2022/06/16 15:06:09 | Old Value wrapper.java.additional.100=-Dgo.console.stdout=true

WARN | wrapper | 2022/06/16 15:06:09 | New Value wrapper.java.additional.100=-Dgo.console.stdout=true

WARN | wrapper | 2022/06/16 15:06:09 | The "wrapper.java.additional.100" property was redefined on line #43 of configuration file: /go-server/wrapper-config/wrapper-properties.conf

WARN | wrapper | 2022/06/16 15:06:09 | Old Value wrapper.java.additional.100=-Dgo.console.stdout=true

WARN | wrapper | 2022/06/16 15:06:09 | New Value wrapper.java.additional.100=-Dgo.console.stdout=true

WARN | wrapper | 2022/06/16 15:06:09 | The "wrapper.java.additional.100" property was redefined on line #44 of configuration file: /go-server/wrapper-config/wrapper-properties.conf

WARN | wrapper | 2022/06/16 15:06:09 | Old Value wrapper.java.additional.100=-Dgo.console.stdout=true

WARN | wrapper | 2022/06/16 15:06:09 | New Value wrapper.java.additional.100=-Dgo.console.stdout=true

WARN | wrapper | 2022/06/16 15:06:09 | The "wrapper.java.additional.100" property was redefined on line #45 of configuration file: /go-server/wrapper-config/wrapper-properties.conf

WARN | wrapper | 2022/06/16 15:06:09 | Old Value wrapper.java.additional.100=-Dgo.console.stdout=true

WARN | wrapper | 2022/06/16 15:06:09 | New Value wrapper.java.additional.100=-Dgo.console.stdout=true

WARN | wrapper | 2022/06/16 15:06:09 | The "wrapper.java.additional.100" property was redefined on line #46 of configuration file: /go-server/wrapper-config/wrapper-properties.conf

WARN | wrapper | 2022/06/16 15:06:09 | Old Value wrapper.java.additional.100=-Dgo.console.stdout=true

WARN | wrapper | 2022/06/16 15:06:09 | New Value wrapper.java.additional.100=-Dgo.console.stdout=true

WARN | wrapper | 2022/06/16 15:06:09 | The "wrapper.java.additional.100" property was redefined on line #47 of configuration file: /go-server/wrapper-config/wrapper-properties.conf

WARN | wrapper | 2022/06/16 15:06:09 | Old Value wrapper.java.additional.100=-Dgo.console.stdout=true

WARN | wrapper | 2022/06/16 15:06:09 | New Value wrapper.java.additional.100=-Dgo.console.stdout=true

STATUS | wrapper | 2022/06/16 15:06:09 | --> Wrapper Started as Console

STATUS | wrapper | 2022/06/16 15:06:09 | Java Service Wrapper Standard Edition 64-bit 3.5.49

STATUS | wrapper | 2022/06/16 15:06:09 | http://wrapper.tanukisoftware.com

STATUS | wrapper | 2022/06/16 15:06:09 | Licensed to ThoughtWorks for GoCD Server

STATUS | wrapper | 2022/06/16 15:06:09 |

STATUS | wrapper | 2022/06/16 15:06:09 | Launching a JVM...

INFO | jvm 1 | 2022/06/16 15:06:10 | WrapperManager: Initializing...

INFO | jvm 1 | 2022/06/16 15:06:10 | [Thu Jun 16 15:06:10 GMT 2022] Starting process:

INFO | jvm 1 | 2022/06/16 15:06:10 | [Thu Jun 16 15:06:10 GMT 2022] Working directory : /go-working-dir

INFO | jvm 1 | 2022/06/16 15:06:10 | [Thu Jun 16 15:06:10 GMT 2022] Application arguments: []

INFO | jvm 1 | 2022/06/16 15:06:10 | [Thu Jun 16 15:06:10 GMT 2022] GoCD Version: 22.1.0-13913

INFO | jvm 1 | 2022/06/16 15:06:10 | [Thu Jun 16 15:06:10 GMT 2022] Java Version: 17.0.2

INFO | jvm 1 | 2022/06/16 15:06:10 | [Thu Jun 16 15:06:10 GMT 2022] Operating System: Linux(4.4.180+)

INFO | jvm 1 | 2022/06/16 15:06:11 | Could not find file `config/logback.xml'. Attempting to load from classpath.

INFO | jvm 1 | 2022/06/16 15:06:11 | Using classpath resource `jar:onejar:lib/server-launcher-22.1.0-13913-main.jar!/config/logback.xml'.

INFO | jvm 1 | 2022/06/16 15:06:13 | 2022-06-16 15:06:13,280 INFO [WrapperJarAppMain] Jetty9Server:199 - Configuring Jetty using /go-working-dir/config/jetty.xml

INFO | jvm 1 | 2022/06/16 15:06:13 | 2022-06-16 15:06:13,350 WARN [WrapperJarAppMain] Server:357 - ErrorPageMapper not supported for Server level Error Handling

INFO | jvm 1 | 2022/06/16 15:06:13 | 2022-06-16 15:06:13,446 WARN [WrapperJarAppMain] AbstractHandler:96 - No Server set for ResourceHandler@e06552b{STOPPED}

INFO | jvm 1 | 2022/06/16 15:06:18 | 2022-06-16 15:06:18,900 WARN [WrapperJarAppMain] ConnectionManager:117 - The file config/db.properties specified by `go.db.config` does not exist.

INFO | jvm 1 | 2022/06/16 15:06:19 | 2022-06-16 15:06:19,373 INFO [WrapperJarAppMain] DatabaseMigrator:40 - Upgrading database, this might take a while depending on the size of the database.

INFO | jvm 1 | 2022/06/16 15:06:19 | ************************************************************************

INFO | jvm 1 | 2022/06/16 15:06:19 | 2022-06-16 15:06:19,374 INFO [WrapperJarAppMain] DatabaseMigrator:49 - ************************************************************************

INFO | jvm 1 | 2022/06/16 15:06:19 | WARNING: Shutting down your server at this point will lead to a database corruption. Please wait until the database upgrade completes.

INFO | jvm 1 | 2022/06/16 15:06:19 | 2022-06-16 15:06:19,374 INFO [WrapperJarAppMain] DatabaseMigrator:49 - WARNING: Shutting down your server at this point will lead to a database corruption. Please wait until the database upgrade completes.

INFO | jvm 1 | 2022/06/16 15:06:19 | ************************************************************************

INFO | jvm 1 | 2022/06/16 15:06:19 | 2022-06-16 15:06:19,374 INFO [WrapperJarAppMain] DatabaseMigrator:49 - ************************************************************************

INFO | jvm 1 | 2022/06/16 15:06:19 | Jun 16, 2022 3:06:19 PM liquibase.database

INFO | jvm 1 | 2022/06/16 15:06:19 | INFO: Set default schema name to PUBLIC

INFO | jvm 1 | 2022/06/16 15:06:20 | Jun 16, 2022 3:06:19 PM liquibase.lockservice

INFO | jvm 1 | 2022/06/16 15:06:20 | INFO: Successfully acquired change log lock

INFO | jvm 1 | 2022/06/16 15:06:20 | Jun 16, 2022 3:06:20 PM liquibase.servicelocator

INFO | jvm 1 | 2022/06/16 15:06:20 | INFO: Cannot load service: liquibase.parser.ChangeLogParser: liquibase.parser.core.json.JsonChangeLogParser Unable to get public no-arg constructor

INFO | jvm 1 | 2022/06/16 15:06:20 | Jun 16, 2022 3:06:20 PM liquibase.servicelocator

INFO | jvm 1 | 2022/06/16 15:06:20 | INFO: Cannot load service: liquibase.parser.ChangeLogParser: liquibase.parser.core.yaml.YamlChangeLogParser Unable to get public no-arg constructor