dotcms startup errors - Kubernetes

58 views
Skip to first unread message

Kamal Ramakrishnan

unread,
May 2, 2022, 3:57:47 PM5/2/22
to dotCMS User Group
Hello,
I've tried the kubernetes setup for dotCMS using the github project below setting the trial license on the volume mount path


I've modified some of the params in the project to use postgres database and elastic search instance from the k8s services.

The deployment POD for dotCMS failed to start with the stack trace error below. I'm not sure where from the assets files are located.

can someone assist me with the error below? Thanks in advance.

pod/dotcms-79688bb65-r9x56/dotcms] 16:04:02.936  WARN  runalways.Task00002LoadClusterLicenses - licPackFiles is NULL - this usually means something is wrong with the assets folder
[pod/dotcms-79688bb65-r9x56/dotcms] 16:04:02.937  INFO  startup.StartupTasksExecutor - Not Running Startup Tasks: Task00002LoadClusterLicenses
[pod/dotcms-79688bb65-r9x56/dotcms] 16:04:02.945  INFO  startup.StartupTasksExecutor - Running Startup Tasks : Task00003CreateSystemRoles
[pod/dotcms-79688bb65-r9x56/dotcms] 16:04:03.023  INFO  startup.StartupTasksExecutor - Running Startup Tasks : Task00004LoadStarter
[pod/dotcms-79688bb65-r9x56/dotcms] 16:04:03.043  INFO  db.DotCMSInitDb - There are no inodes - initializing db with starter site
[pod/dotcms-79688bb65-r9x56/dotcms] 16:04:03.120  INFO  util.ImportStarterUtil - Found 22 files to import
[pod/dotcms-79688bb65-r9x56/dotcms] com.dotmarketing.exception.DotRuntimeException: /data/shared/assets/b/7/b7f3efc0-3ddb-4173-a4d8-518baf712ebf/fileAsset/dotasset.vtl
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotmarketing.db.DotCMSInitDb.lambda$1(DotCMSInitDb.java:45)
[pod/dotcms-79688bb65-r9x56/dotcms]     at io.vavr.control.Try.getOrElseThrow(Try.java:748)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotmarketing.db.DotCMSInitDb.InitializeDb_aroundBody2(DotCMSInitDb.java:45)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotmarketing.db.DotCMSInitDb$AjcClosure3.run(DotCMSInitDb.java:1)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotcms.aspects.aspectj.AspectJDelegateMethodInvocation.proceed(AspectJDelegateMethodInvocation.java:42)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotcms.aspects.interceptors.CloseDBIfOpenedMethodInterceptor.invoke(CloseDBIfOpenedMethodInterceptor.java:29)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotcms.aspects.aspectj.CloseDBIfOpenedAspect.invoke(CloseDBIfOpenedAspect.java:41)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotmarketing.db.DotCMSInitDb.InitializeDb(DotCMSInitDb.java:37)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotmarketing.startup.runalways.Task00004LoadStarter.executeUpgrade(Task00004LoadStarter.java:14)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotmarketing.startup.StartupTasksExecutor.executeStartUpTasks(StartupTasksExecutor.java:133)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.liferay.portal.servlet.MainServlet.init_aroundBody0(MainServlet.java:121)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.liferay.portal.servlet.MainServlet$AjcClosure1.run(MainServlet.java:1)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotcms.aspects.aspectj.AspectJDelegateMethodInvocation.proceed(AspectJDelegateMethodInvocation.java:42)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotcms.aspects.interceptors.CloseDBIfOpenedMethodInterceptor.invoke(CloseDBIfOpenedMethodInterceptor.java:29)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotcms.aspects.aspectj.CloseDBIfOpenedAspect.invoke(CloseDBIfOpenedAspect.java:41)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.liferay.portal.servlet.MainServlet.init(MainServlet.java:100)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.apache.catalina.core.StandardWrapper.initServlet(StandardWrapper.java:1134)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.apache.catalina.core.StandardWrapper.loadServlet(StandardWrapper.java:1089)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.apache.catalina.core.StandardWrapper.load(StandardWrapper.java:983)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.apache.catalina.core.StandardContext.loadOnStartup(StandardContext.java:4902)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5211)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:717)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:690)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:706)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.apache.catalina.startup.HostConfig.deployDirectory(HostConfig.java:1133)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.apache.catalina.startup.HostConfig$DeployDirectory.run(HostConfig.java:1866)
[pod/dotcms-79688bb65-r9x56/dotcms]     at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
[pod/dotcms-79688bb65-r9x56/dotcms]     at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.apache.tomcat.util.threads.InlineExecutorService.execute(InlineExecutorService.java:75)
[pod/dotcms-79688bb65-r9x56/dotcms]     at java.base/java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:118)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.apache.catalina.startup.HostConfig.deployDirectories(HostConfig.java:1045)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:429)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.apache.catalina.startup.HostConfig.start(HostConfig.java:1576)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:309)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.apache.catalina.util.LifecycleBase.fireLifecycleEvent(LifecycleBase.java:123)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.apache.catalina.util.LifecycleBase.setStateInternal(LifecycleBase.java:423)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.apache.catalina.util.LifecycleBase.setState(LifecycleBase.java:366)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.apache.catalina.core.ContainerBase.startInternal(ContainerBase.java:936)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.apache.catalina.core.StandardHost.startInternal(StandardHost.java:843)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1384)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1374)
[pod/dotcms-79688bb65-r9x56/dotcms]     at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.apache.tomcat.util.threads.InlineExecutorService.execute(InlineExecutorService.java:75)
[pod/dotcms-79688bb65-r9x56/dotcms]     at java.base/java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:140)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.apache.catalina.core.ContainerBase.startInternal(ContainerBase.java:909)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.apache.catalina.core.StandardEngine.startInternal(StandardEngine.java:262)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.apache.catalina.core.StandardService.startInternal(StandardService.java:434)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.apache.catalina.core.StandardServer.startInternal(StandardServer.java:930)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.apache.catalina.startup.Catalina.start(Catalina.java:772)
[pod/dotcms-79688bb65-r9x56/dotcms]     at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[pod/dotcms-79688bb65-r9x56/dotcms]     at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[pod/dotcms-79688bb65-r9x56/dotcms]     at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[pod/dotcms-79688bb65-r9x56/dotcms]     at java.base/java.lang.reflect.Method.invoke(Method.java:566)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:342)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:473)
[pod/dotcms-79688bb65-r9x56/dotcms] Caused by: java.nio.file.NoSuchFileException: /data/shared/assets/b/7/b7f3efc0-3ddb-4173-a4d8-518baf712ebf/fileAsset/dotasset.vtl
[pod/dotcms-79688bb65-r9x56/dotcms]     at java.base/sun.nio.fs.UnixException.translateToIOException(UnixException.java:92)
[pod/dotcms-79688bb65-r9x56/dotcms]     at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111)
[pod/dotcms-79688bb65-r9x56/dotcms]     at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:116)
[pod/dotcms-79688bb65-r9x56/dotcms]     at java.base/sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:219)
[pod/dotcms-79688bb65-r9x56/dotcms]     at java.base/java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:478)
[pod/dotcms-79688bb65-r9x56/dotcms]     at java.base/java.nio.file.Files.newOutputStream(Files.java:220)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.liferay.util.FileUtil.copyFile(FileUtil.java:234)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.liferay.util.FileUtil.copyFile(FileUtil.java:167)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.liferay.util.FileUtil.copyDirectory(FileUtil.java:129)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.liferay.util.FileUtil.copyDirectory(FileUtil.java:123)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.liferay.util.FileUtil.copyDirectory(FileUtil.java:123)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.liferay.util.FileUtil.copyDirectory(FileUtil.java:123)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.liferay.util.FileUtil.copyDirectory(FileUtil.java:105)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.liferay.util.FileUtil.copyDirectory(FileUtil.java:139)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.liferay.util.FileUtil.copyDirectory(FileUtil.java:92)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotmarketing.util.ImportStarterUtil.copyAssetDir(ImportStarterUtil.java:490)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotmarketing.util.ImportStarterUtil.doImport_aroundBody0(ImportStarterUtil.java:163)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotmarketing.util.ImportStarterUtil$AjcClosure1.run(ImportStarterUtil.java:1)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotcms.aspects.aspectj.AspectJDelegateMethodInvocation.proceed(AspectJDelegateMethodInvocation.java:42)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotmarketing.db.LocalTransaction.wrapReturnWithListeners(LocalTransaction.java:119)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotcms.aspects.interceptors.WrapInTransactionMethodInterceptor.invoke(WrapInTransactionMethodInterceptor.java:30)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotcms.aspects.aspectj.WrapInTransactionAspect.invoke(WrapInTransactionAspect.java:41)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotmarketing.util.ImportStarterUtil.doImport(ImportStarterUtil.java:160)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotmarketing.db.DotCMSInitDb.loadStarterSiteData_aroundBody4(DotCMSInitDb.java:78)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotmarketing.db.DotCMSInitDb$AjcClosure5.run(DotCMSInitDb.java:1)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotcms.aspects.aspectj.AspectJDelegateMethodInvocation.proceed(AspectJDelegateMethodInvocation.java:42)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotmarketing.db.LocalTransaction.wrapReturnWithListeners(LocalTransaction.java:119)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotcms.aspects.interceptors.WrapInTransactionMethodInterceptor.invoke(WrapInTransactionMethodInterceptor.java:30)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotcms.aspects.aspectj.WrapInTransactionAspect.invoke(WrapInTransactionAspect.java:41)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotmarketing.db.DotCMSInitDb.loadStarterSiteData(DotCMSInitDb.java:55)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotmarketing.db.DotCMSInitDb.loadStarterSite_aroundBody6(DotCMSInitDb.java:84)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotmarketing.db.DotCMSInitDb$AjcClosure7.run(DotCMSInitDb.java:1)
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotcms.aspects.aspectj.AspectJDelegateMethodInvocation.proceed(AspectJDelegateMethodInvocation.java:42)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotcms.aspects.interceptors.CloseDBIfOpenedMethodInterceptor.invoke(CloseDBIfOpenedMethodInterceptor.java:29)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotcms.aspects.aspectj.CloseDBIfOpenedAspect.invoke(CloseDBIfOpenedAspect.java:41)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotmarketing.db.DotCMSInitDb.loadStarterSite(DotCMSInitDb.java:82)
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotmarketing.db.DotCMSInitDb.lambda$0(DotCMSInitDb.java:45)
[pod/dotcms-79688bb65-r9x56/dotcms]     at io.vavr.control.Try.run(Try.java:118)
[pod/dotcms-79688bb65-r9x56/dotcms]     ... 60 more
[pod/dotcms-79688bb65-r9x56/dotcms] 16:04:03.135  ERROR startup.StartupTasksExecutor - FATAL: Unable to execute the upgrade task : Task00004LoadStarter
[pod/dotcms-79688bb65-r9x56/dotcms] com.dotmarketing.exception.DotRuntimeException: /data/shared/assets/b/7/b7f3efc0-3ddb-4173-a4d8-518baf712ebf/fileAsset/dotasset.vtl
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotmarketing.db.DotCMSInitDb.lambda$1(DotCMSInitDb.java:45) ~[dotcms_22.03_999999.jar:?]
[pod/dotcms-79688bb65-r9x56/dotcms]     at io.vavr.control.Try.getOrElseThrow(Try.java:748) ~[vavr-0.10.3.jar:?]
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotmarketing.db.DotCMSInitDb.InitializeDb_aroundBody2(DotCMSInitDb.java:45) ~[dotcms_22.03_999999.jar:?]
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotmarketing.db.DotCMSInitDb$AjcClosure3.run(DotCMSInitDb.java:1) ~[dotcms_22.03_999999.jar:?]
[pod/dotcms-79688bb65-r9x56/dotcms]     at org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149) ~[aspectjrt-1.9.2.jar:?]
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotcms.aspects.aspectj.AspectJDelegateMethodInvocation.proceed(AspectJDelegateMethodInvocation.java:42) ~[dotcms_22.03_999999.jar:?]
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotcms.aspects.interceptors.CloseDBIfOpenedMethodInterceptor.invoke(CloseDBIfOpenedMethodInterceptor.java:29) ~[dotcms_22.03_999999.jar:?]
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotcms.aspects.aspectj.CloseDBIfOpenedAspect.invoke(CloseDBIfOpenedAspect.java:41) ~[dotcms_22.03_999999.jar:?]
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotmarketing.db.DotCMSInitDb.InitializeDb(DotCMSInitDb.java:37) ~[dotcms_22.03_999999.jar:?]
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotmarketing.startup.runalways.Task00004LoadStarter.executeUpgrade(Task00004LoadStarter.java:14) ~[dotcms_22.03_999999.jar:?]
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.dotmarketing.startup.StartupTasksExecutor.executeStartUpTasks(StartupTasksExecutor.java:133) ~[dotcms_22.03_999999.jar:?]
[pod/dotcms-79688bb65-r9x56/dotcms]     at com.liferay.portal.servlet.MainServlet.init_aroundBody0(MainServlet.java:121) ~[dotcms_22.03_999999.jar:?]
40-dotcms.yaml

Will Ezell

unread,
May 2, 2022, 4:33:36 PM5/2/22
to dot...@googlegroups.com
I think you will need to map a read-writable volume for the /data/shared directory of dotCMS.  This is generally where we recommend using a ReadWriteMany pvc backed by some flavor of NFS so it can be shared across dotCMS nodes.



--
http://dotcms.com - Open Source Java Content Management
---
You received this message because you are subscribed to the Google Groups "dotCMS User Group" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dotcms+un...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/dotcms/28e74857-447a-40c2-8f34-d5ee908746b3n%40googlegroups.com.


--



382 NE 191st St #92150
Miami, Florida 33179-3899
Main: 
305-900-2001 | Direct: 978.294.9429

Kamal Ramakrishnan

unread,
May 17, 2022, 1:58:19 PM5/17/22
to dotCMS User Group
Thank you for your response. The read/write many volume has resolved the issue mentioned.
Reply all
Reply to author
Forward
0 new messages