Ensure the Druid Overlord and Coordinator logs are kept for 7 days

[Jennifer Burga]

Hi

I'm new on Druid

I need to increase the log retention for the Overlord and Coordinator

As of today, the Druid Overlord and Coordinator logs only appear to be kept for about an hour. Update this so that logs are available for 7 days.

Can anyone help me?

Regards

[Gian Merlino]

Hi Jennifer,

In the default configuration, logs are written to standard out. If you have a 7 day retention it is likely due to something you have implemented on your end so I would try double-checking that. There may be some clues in conf/_common/log4j2.xml or conf/druid/_common/log4j2.xml.

Gian

--
You received this message because you are subscribed to the Google Groups "Druid User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-user+unsubscribe@googlegroups.com.
To post to this group, send email to druid...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/druid-user/bea8c0e7-87d2-4bc3-9976-e41f116909b4%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Jennifer Burga]

Hi Gian 

only register for one hour and would like to keep it for 7 days

To view this discussion on the web visit https://groups.google.com/d/msgid/druid-user/CACZNdYAZLDfhCShfA89HhMqLexA-mQn1sBES_1Of_8A5r8PQxA%40mail.gmail.com.

For more options, visit https://groups.google.com/d/optout.

--

----------   ------------
Jennifer Burga

CEO & Founder

Humanos Trabajando S.A

Mobile: 965335464

Web: www.lazonageek.com

www.facebook.com/zonageek

www.twitter.com/lazonageek

[Jennifer Burga]

Hello Gian 

I have this on my druid-playbooks/files/configs/_common/log4j2.xml

	<?xml version="1.0" encoding="UTF-8" ?>
	<Configuration status="WARN">
	<Appenders>
	<Console name="Console" target="SYSTEM_OUT">
	<PatternLayout pattern="%d{ISO8601} %p [%t] %c - %m%n"/>
	</Console>
	</Appenders>
	<Loggers>
	<Root level="info">
	<AppenderRef ref="Console"/>
	</Root>
	</Loggers>
	</Configuration> And my druid-playbooks/files/configs/_common/common.runtime.properties.j2 have this

druid.extensions.loadList=["druid-avro-extensions", "druid-kafka-eight", "druid-kafka-indexing-service", "druid-s3-extensions", "druid-histogram", "druid-datasketches", "druid-lookups-cached-global", "mysql-metadata-storage"]

druid.startup.logging.logProperties=true

druid.exhibitor.service.hosts=["{{ zk_address }}"]

druid.exhibitor.service.port=8181

druid.zk.service.host={{ zk_address }}

druid.zk.paths.base=/druid

druid.metadata.storage.type=mysql

druid.metadata.storage.connector.connectURI=jdbc:mysql://{{ db_address }}:3306/druid

druid.metadata.storage.connector.user={{ db_user }}

druid.metadata.storage.connector.password={{ db_password }}

druid.storage.type=s3

druid.storage.bucket={{ s3_bucket }}

druid.storage.baseKey=druid/segments

druid.indexer.logs.type=file

druid.indexer.logs.directory=/var/druid/indexing-logs

druid.indexer.logs.type=s3

druid.indexer.logs.s3Bucket={{ s3_bucket }}

druid.indexer.logs.s3Prefix=druid/indexing-logs

druid.selectors.indexing.serviceName=druid/overlord

druid.selectors.coordinator.serviceName=druid/coordinator

druid.monitoring.monitors=["com.metamx.metrics.JvmMonitor"]

druid.emitter=logging

druid.emitter.logging.logLevel=info

druid.javascript.enabled=true