Move Rundeck from H2 to MySQL - Rundeck fails to connect to MySQL

Charles Pippin

unread,

Nov 23, 2020, 3:28:28 PM11/23/20

to rundeck-discuss

My Ansible/Rundeck host is an Ubuntu 20.04 LTS system. I installed Ansible to tinker and then installed Rundeck. Once I was able to get the two talking and working properly (in my mind), I thought it would be best to move Rundeck to a production level DB engine instead of H2. I installed MySQL on the same host and setup the DB and the DB user as directed in the Rundeck docs. I then modified the RD properties file as the same document instructs but I keep getting a failure to connect to the database.

First it was this error:

WARN internal.JdbcEnvironmentInitiator - HHH000341: Could not obtain connection metadata : Could not connect to address=(host=10.10.140.23)(port=3306)(type=master) : Socket fail to connect to host:10.10.140.23, port:3306. Connection refused (Connection refused)

So then I researched the issue and it suggested to validate the user account in MySQL, grants, access, etc. - It all works from a command line testing in MySQL.

I read in one of my searches that some people had luck with removing the useSSL=false or setting it to true. That led to my next error of:

WARN internal.JdbcEnvironmentInitiator - HHH000341: Could not obtain connection metadata : Could not connect to address=(host=localhost)(port=3306)(type=master) : RSA public key is not available client side (option serverRsaPublicKeyFile)

During my research on this error, I read that I needed to add a property to allow the retrieval of the RSA keys, and I did but it didn't change a thing.

I then downloaded the Oracle MySQL jdbc driver and placed it in the var/lib/rundeck/lib folder and changed the driver class name in the properties file and then I received my but that could not connect. I was able to detect in the system.log output: ' Unable to load class: com.mysql.jc.jdbc.Driver from ClassLoader:org.springframework.boot.loader.'. Obviously the MySQL jdbc driver is not being loaded or possibly found at all. I placed the file in /var/lib/rundeck/lib. Do I need to give the file any special permissions or should it be named something specific. I used wget to download it while in Ubuntu. The file name is mysql-connector-java-8.0.22.jar and it transferred without any issue.

It was pointed out to me that perhaps it was a password problem and I was directed to this link: github.com/gitbucket/gitbucket/issues/…. I made the change to the MySQL account to change the password to use the native password authentication method. Unfortunately that did not help.

At this point I am back on H2 and I am too much of a Linux novice to understand what the issue may be. Can anyone kindly point me in a direction that helps as the Rundeck docks for using a MySQL DB seem to either be old or missing some content as a lot of the searches I have made on trying to resolve the issue directs me to perform things slight differently or all new commands that the Rundeck docs don't even mention.

Thank you in advance for any assistance.

Xavier Humbert

unread,

Nov 23, 2020, 4:05:52 PM11/23/20

to rundeck...@googlegroups.com, Charles Pippin

Hi, Charles,

Which driver do you use ? And which RD version ? There were a change between 3.2.x and 3.3.x. You probably need mariadb driver.

Cheers

Xavier

--
You received this message because you are subscribed to the Google Groups "rundeck-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to rundeck-discu...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/rundeck-discuss/93fd0876-c0c0-4d46-9612-d28ccaa77286n%40googlegroups.com.

-- 
Xavier Humbert
CRT Supervision et Exploitation de Niveau 1
Rectorat de Nancy-Metz
03 83 86 27 39

OpenPGP_0x90B78A89BCC49C10.asc

OpenPGP_signature

rac...@rundeck.com

unread,

Nov 23, 2020, 4:13:59 PM11/23/20

to rundeck-discuss

Hi Charles.

I tested on Ubuntu 20.10 and MySQL 8 (on a remote Centos 7 machine using the Oracle drive as you want) following these steps:

1- Install Rundeck.

2- Download the JDBC driver from here.

3- Create /var/lib/rundeck/lib directory and extract there the mysql-connector-java-8.0.22.jar file (from mysql-connector-java-8.0.22.tar.gz file)

4- Make sure that rundeck user owns the /var/lib/rundeck/lib directory and mysql-connector-java-8.0.22.jar file. I have the following permissions:

root@ubuntu2004:/var/lib/rundeck# ls -ll
total 36
drwxr-x--- 2 rundeck rundeck 4096 Nov 23 20:44 bootstrap
drwxr-x--- 2 rundeck rundeck 4096 Nov 11 20:00 data
drwxr-xr-x 2 rundeck rundeck 4096 Nov 23 20:49 lib
drwxr-x--- 3 rundeck rundeck 4096 Nov 23 20:54 libext
drwxr-s--x 2 rundeck adm     4096 Nov 11 20:00 logs
drwxrwxr-x 2 rundeck rundeck 4096 Nov 23 20:54 projects
drwxrwxr-x 4 rundeck rundeck 4096 Nov 23 20:54 repository
drwxr-x--- 3 rundeck rundeck 4096 Nov 23 20:54 var
drwxr-x--- 2 rundeck rundeck 4096 Nov 11 20:00 work

and the file inside lib directory:

root@ubuntu2004:/var/lib/rundeck/lib# ls -ll
total 2336
-rw-r--r-- 1 rundeck rundeck 2389216 Sep 10 21:42 mysql-connector-java-8.0.22.jar

5- Edit the rundeck.config properties file to reference your MySQL 8 instance in this way:

dataSource.url = jdbc:mysql://192.168.33.33/rundeck?autoReconnect=true&useSSL=false&allowPublicKeyRetrieval=true
dataSource.username=rundeckuser
dataSource.password=password
dataSource.driverClassName=com.mysql.cj.jdbc.Driver

# to store projects on backend
rundeck.projectsStorageType=db

Now save the file.

6- Start the Rundeck instance checking the service log: systemctl start rundeckd; tail -f /var/log/rundeck/service.log.

[2020-11-23T20:54:07,936] INFO  rundeckapp.Application - The following profiles are active: production

Configuring Spring Security Core ...
... finished configuring Spring Security Core

[2020-11-23T20:54:26,214] WARN  beans.GenericTypeAwarePropertyDescriptor - Invalid JavaBean property 'exceptionMappings' being accessed! Ambiguous write methods found next to actually used [public void grails.plugin.springsecurity.web.authentication.AjaxAwareAuthenticationFailureHandler.setExceptionMappings(java.util.List)]: [public void org.springframework.security.web.authentication.ExceptionMappingAuthenticationFailureHandler.setExceptionMappings(java.util.Map)]
[2020-11-23T20:54:33,063] INFO  rundeckapp.BootStrap - Starting Rundeck 3.3.6-20201111 (2020-11-11) ...
[2020-11-23T20:54:33,066] INFO  rundeckapp.BootStrap - using rdeck.base config property: /var/lib/rundeck
[2020-11-23T20:54:33,077] INFO  rundeckapp.BootStrap - loaded configuration: /etc/rundeck/framework.properties
[2020-11-23T20:54:33,159] INFO  rundeckapp.BootStrap - RSS feeds disabled
[2020-11-23T20:54:33,159] INFO  rundeckapp.BootStrap - Using jaas authentication
[2020-11-23T20:54:33,164] INFO  rundeckapp.BootStrap - Preauthentication is disabled
[2020-11-23T20:54:33,232] INFO  rundeckapp.BootStrap - Rundeck is ACTIVE: executions can be run.
[2020-11-23T20:54:33,634] INFO  rundeckapp.BootStrap - workflowConfigFix973: applying... 
[2020-11-23T20:54:33,647] INFO  rundeckapp.BootStrap - workflowConfigFix973: No fix was needed. Storing fix application state.
[2020-11-23T20:54:33,913] INFO  rundeckapp.BootStrap - Rundeck startup finished in 930ms
[2020-11-23T20:54:34,081] INFO  rundeckapp.Application - Started Application in 28.538 seconds (JVM running for 31.546)
Grails application running at http://localhost:4440 in environment: production

Also, you can check the data source from GUI.

Hope it helps!

Charles Pippin

unread,

Nov 23, 2020, 6:44:53 PM11/23/20

to rundeck-discuss

To the suggestion that I need the MariaDB driver. I did initially use the supplied MariaDB driver but it fails to connect as well to the local MySQL server on the same machine as Rundeck. When I try to connect to the database with the MariaDB driver, I receive this type of error.

[2020-11-23T23:29:22,474] WARN internal.JdbcEnvironmentInitiator - HHH000341: Could not obtain connection metadata : Could not connect to address=(host=10.10.140.23)(port=3306)(type=master) : Socket fail to connect to host:10.10.140.23, port:3306. Connection refused (Connection refused)

I tried all of the settings all of you have given me. I set the owner and group of the /var/lib/rundeck/lib folder and the mysql driver inside of it to rundeck as recommended.

I tested my user again using mysql, and the user was able to login and see the grants which showed the rundeckdb.

mysql> SHOW GRANTS;

+-------------------------------------------------------------+

| Grants for rduser@localhost |

+-------------------------------------------------------------+

| GRANT USAGE ON *.* TO `rduser`@`localhost` |

| GRANT ALL PRIVILEGES ON `rundeck`.* TO `rduser`@`localhost` |

+-------------------------------------------------------------+

2 rows in set (0.00 sec)

mysql> SHOW DATABASES;

+--------------------+

| Database |

+--------------------+

| information_schema |

| rundeck |

+--------------------+

2 rows in set (0.01 sec)

I changed the name of the driver from com.mysql.jdbc.Driver to com.mysql.cj.jdbc.Driver. I then started the service and watched the system log file. Unfortunately it fails to load and there is soo much scrolling on the screen I cant tell where the issue is. Below is what I was able to capture from the output.

at org.springframework.boot.loader.WarLauncher.main(WarLauncher.java:58) [rundeck-3.3.6-20201111.war:?]

Caused by: com.mysql.cj.exceptions.CJCommunicationsException: Communications link failure

and

at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:744) [spring-boot-2.1.13.RELEASE.jar!/:2.1.13.RELEASE]

at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:391) [spring-boot-2.1.13.RELEASE.jar!/:2.1.13.RELEASE]

at org.springframework.boot.SpringApplication.run(SpringApplication.java:312) [spring-boot-2.1.13.RELEASE.jar!/:2.1.13.RELEASE]

at grails.boot.GrailsApp.run(GrailsApp.groovy:96) [grails-core-4.0.3.jar!/:4.0.3]

at grails.boot.GrailsApp.run(GrailsApp.groovy:456) [grails-core-4.0.3.jar!/:4.0.3]

at grails.boot.GrailsApp.run(GrailsApp.groovy:443) [grails-core-4.0.3.jar!/:4.0.3]

at grails.boot.GrailsApp$run.call(Unknown Source) [grails-core-4.0.3.jar!/:4.0.3]

at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:47) [groovy-2.5.6.jar!/:2.5.6]

at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:115) [groovy-2.5.6.jar!/:2.5.6]

at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:135) [groovy-2.5.6.jar!/:2.5.6]

at rundeckapp.Application.main(Application.groovy:32) [classes!/:?]

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_275]

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_275]

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_275]

at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_275]

at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48) [rundeck-3.3.6-20201111.war:?]

at org.springframework.boot.loader.Launcher.launch(Launcher.java:87) [rundeck-3.3.6-20201111.war:?]

at org.springframework.boot.loader.Launcher.launch(Launcher.java:51) [rundeck-3.3.6-20201111.war:?]

at org.springframework.boot.loader.WarLauncher.main(WarLauncher.java:58) [rundeck-3.3.6-20201111.war:?]

Caused by: com.mysql.cj.exceptions.CJException: Access denied for user 'sa'@'localhost' (using password: YES)

at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[?:1.8.0_275]

at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) ~[?:1.8.0_275]

at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) ~[?:1.8.0_275]

at java.lang.reflect.Constructor.newInstance(Constructor.java:423) ~[?:1.8.0_275]

at com.mysql.cj.exceptions.ExceptionFactory.createException(ExceptionFactory.java:61) ~[mysql-connector-java-8.0.22.jar:8.0.22]

at com.mysql.cj.exceptions.ExceptionFactory.createException(ExceptionFactory.java:105) ~[mysql-connector-java-8.0.22.jar:8.0.22]

at com.mysql.cj.exceptions.ExceptionFactory.createException(ExceptionFactory.java:151) ~[mysql-connector-java-8.0.22.jar:8.0.22]

at com.mysql.cj.exceptions.ExceptionFactory.createException(ExceptionFactory.java:129) ~[mysql-connector-java-8.0.22.jar:8.0.22]

at com.mysql.cj.protocol.a.NativeProtocol.checkErrorMessage(NativeProtocol.java:792) ~[mysql-connector-java-8.0.22.jar:8.0.22]

at com.mysql.cj.protocol.a.NativeProtocol.checkErrorMessage(NativeProtocol.java:717) ~[mysql-connector-java-8.0.22.jar:8.0.22]

at com.mysql.cj.protocol.a.NativeProtocol.checkErrorMessage(NativeProtocol.java:685) ~[mysql-connector-java-8.0.22.jar:8.0.22]

at com.mysql.cj.protocol.a.NativeProtocol.checkErrorMessage(NativeProtocol.java:134) ~[mysql-connector-java-8.0.22.jar:8.0.22]

at com.mysql.cj.protocol.a.NativeAuthenticationProvider.proceedHandshakeWithPluggableAuthentication(NativeAuthenticationProvider.java:469) ~[mysql-connector-java-8.0.22.jar:8.0.22]

at com.mysql.cj.protocol.a.NativeAuthenticationProvider.connect(NativeAuthenticationProvider.java:174) ~[mysql-connector-java-8.0.22.jar:8.0.22]

at com.mysql.cj.protocol.a.NativeProtocol.connect(NativeProtocol.java:1348) ~[mysql-connector-java-8.0.22.jar:8.0.22]

at com.mysql.cj.NativeSession.connect(NativeSession.java:157) ~[mysql-connector-java-8.0.22.jar:8.0.22]

at com.mysql.cj.jdbc.ConnectionImpl.connectWithRetries(ConnectionImpl.java:850) ~[mysql-connector-java-8.0.22.jar:8.0.22]

... 111 more

[2020-11-23T23:19:37,233] WARN internal.JdbcEnvironmentInitiator - HHH000341: Could not obtain connection metadata : Could not create connection to database server. Attempted reconnect 3 times. Giving up.

I did change the driver name back and was able to get some information. I don't know if any of it is useful but here it is below. I was told when it loaded the driver by the com.mysql.jdbc.Driver name that this was deprecated.

at org.springframework.boot.loader.Launcher.launch(Launcher.java:87) [rundeck-3.3.6-20201111.war:?]

at org.springframework.boot.loader.Launcher.launch(Launcher.java:51) [rundeck-3.3.6-20201111.war:?]

at org.springframework.boot.loader.WarLauncher.main(WarLauncher.java:58) [rundeck-3.3.6-20201111.war:?]

Caused by: com.mysql.cj.exceptions.CJException: Access denied for user 'sa'@'localhost' (using password: YES)

at sun.reflect.GeneratedConstructorAccessor84.newInstance(Unknown Source) ~[?:?]