Not able to Ingest nested JSON payload

69 views

Skip to first unread message

Kaustubh

unread,

May 4, 2024, 4:00:41 AMMay 4

to Druid User

Hi all,

Trying to ingest a file containing 100 JSON payloads, where each payload is 100KB and has nested JSON structure.

Ingestion works successfully when ingesting the big nested JSON array column("Rows") as string
But getting OutOfMemory : Direct memory space Error when trying to ingest as Complex JSON

Is Complex JSON ingestion not possible for such big payloads? If its possible, can someone suggest tuning changes

Ingestion Spec:

{

"type": "index_parallel",

"spec": {

"ioConfig": {

"type": "index_parallel",

"inputSource": {

"type": "local",

"baseDir": "/home/npeauto/",

"filter": "output1.json"

"inputFormat": {

"type": "json"

}

"tuningConfig": {

"type": "index_parallel",

"partitionsSpec": {

"type": "dynamic",

"maxRowsPerSegment": 50,

"maxTotalRows": 200

"maxRowsInMemory": 1000

"dataSchema": {

"dataSource": "output1-json",

"timestampSpec": {

"column": "@timestamp",

"format": "iso"

"dimensionsSpec": {

"dimensions": [

"Source",

{

"type": "json",

"name": "Telemetry"

{

"type": "json",

"name": "Rows"

}

]

"granularitySpec": {

"queryGranularity": "none",

"rollup": false,

"segmentGranularity": "hour"

}

"context": {

"useConcurrentLocks": true

}

Kaustubh

unread,

May 4, 2024, 4:01:08 AMMay 4

to Druid User

Example payload:

{"Source": "192.168.57.78:34974","Telemetry": {"node_id_str": "MRUTDNTLCCR001","subscription_id_str": "telemetrycollection_INTERFACESTATS","encoding_path": "Cisco-IOS-XR-pfi-im-cmd-oper:interfaces/interface-briefs/interface-brief","collection_id": 363718,"collection_start_time": 1711514734786,"msg_timestamp": 1711514734786,"collection_end_time": 0},"Rows": [{"Timestamp": 1711514734793,"Keys": {"interface-name": "Bundle-Ether1"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 800000000,"bandwidth64-bit": 800000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "Bundle-Ether1","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_ETHERBUNDLE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "Bundle-Ether1.1551"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 800000000,"bandwidth64-bit": 800000000,"encapsulation": "dot1q","encapsulation-type-string": "802.1Q","interface": "Bundle-Ether1.1551","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"parent-interface": "Bundle-Ether1","state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_VLAN_SUBIF"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "Bundle-Ether10"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 600000000,"bandwidth64-bit": 600000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "Bundle-Ether10","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_ETHERBUNDLE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "Bundle-Ether10.1552"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 600000000,"bandwidth64-bit": 600000000,"encapsulation": "dot1q","encapsulation-type-string": "802.1Q","interface": "Bundle-Ether10.1552","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"parent-interface": "Bundle-Ether10","state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_VLAN_SUBIF"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "Bundle-Ether10.1775"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 600000000,"bandwidth64-bit": 600000000,"encapsulation": "dot1q","encapsulation-type-string": "802.1Q","interface": "Bundle-Ether10.1775","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"parent-interface": "Bundle-Ether10","state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_VLAN_SUBIF"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "Bundle-Ether10.1777"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 600000000,"bandwidth64-bit": 600000000,"encapsulation": "dot1q","encapsulation-type-string": "802.1Q","interface": "Bundle-Ether10.1777","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"parent-interface": "Bundle-Ether10","state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_VLAN_SUBIF"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "Bundle-Ether1501"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 130000000,"bandwidth64-bit": 130000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "Bundle-Ether1501","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_ETHERBUNDLE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "Bundle-Ether1504"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "Bundle-Ether1504","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_ETHERBUNDLE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "Bundle-Ether1505"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 40000000,"bandwidth64-bit": 40000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "Bundle-Ether1505","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_ETHERBUNDLE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "Bundle-Ether1506"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "Bundle-Ether1506","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_ETHERBUNDLE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "Bundle-Ether1507"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "Bundle-Ether1507","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_ETHERBUNDLE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "Bundle-Ether1600"},"Content": {"actual-line-state": "im-state-down","actual-state": "im-state-down","bandwidth": 0,"bandwidth64-bit": 0,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "Bundle-Ether1600","l2-transport": "false","line-state": "im-state-down","mtu": 9216,"state": "im-state-down","sub-interface-mtu-overhead": 0,"type": "IFT_ETHERBUNDLE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "Bundle-Ether2"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 800000000,"bandwidth64-bit": 800000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "Bundle-Ether2","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_ETHERBUNDLE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "Bundle-Ether2.1551"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 800000000,"bandwidth64-bit": 800000000,"encapsulation": "dot1q","encapsulation-type-string": "802.1Q","interface": "Bundle-Ether2.1551","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"parent-interface": "Bundle-Ether2","state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_VLAN_SUBIF"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "Bundle-Ether351"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 300000000,"bandwidth64-bit": 300000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "Bundle-Ether351","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_ETHERBUNDLE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "Bundle-Ether351.1552"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 300000000,"bandwidth64-bit": 300000000,"encapsulation": "dot1q","encapsulation-type-string": "802.1Q","interface": "Bundle-Ether351.1552","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"parent-interface": "Bundle-Ether351","state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_VLAN_SUBIF"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "Bundle-Ether351.1776"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 300000000,"bandwidth64-bit": 300000000,"encapsulation": "dot1q","encapsulation-type-string": "802.1Q","interface": "Bundle-Ether351.1776","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"parent-interface": "Bundle-Ether351","state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_VLAN_SUBIF"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "Bundle-Ether351.1777"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 300000000,"bandwidth64-bit": 300000000,"encapsulation": "dot1q","encapsulation-type-string": "802.1Q","interface": "Bundle-Ether351.1777","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"parent-interface": "Bundle-Ether351","state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_VLAN_SUBIF"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "Bundle-Ether401"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 1100000000,"bandwidth64-bit": 1100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "Bundle-Ether401","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_ETHERBUNDLE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "Bundle-Ether401.1776"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 1100000000,"bandwidth64-bit": 1100000000,"encapsulation": "dot1q","encapsulation-type-string": "802.1Q","interface": "Bundle-Ether401.1776","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"parent-interface": "Bundle-Ether401","state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_VLAN_SUBIF"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "Bundle-Ether401.1777"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 1100000000,"bandwidth64-bit": 1100000000,"encapsulation": "dot1q","encapsulation-type-string": "802.1Q","interface": "Bundle-Ether401.1777","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"parent-interface": "Bundle-Ether401","state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_VLAN_SUBIF"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "Bundle-Ether701"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "Bundle-Ether701","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_ETHERBUNDLE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "Bundle-Ether702"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 160000000,"bandwidth64-bit": 160000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "Bundle-Ether702","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_ETHERBUNDLE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "Bundle-Ether703"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "Bundle-Ether703","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_ETHERBUNDLE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "Bundle-Ether851"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 300000000,"bandwidth64-bit": 300000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "Bundle-Ether851","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_ETHERBUNDLE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "Bundle-Ether852"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 200000000,"bandwidth64-bit": 200000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "Bundle-Ether852","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_ETHERBUNDLE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "Bundle-Ether853"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 200000000,"bandwidth64-bit": 200000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "Bundle-Ether853","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_ETHERBUNDLE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "Bundle-Ether854"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 200000000,"bandwidth64-bit": 200000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "Bundle-Ether854","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_ETHERBUNDLE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "Bundle-Ether855"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 200000000,"bandwidth64-bit": 200000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "Bundle-Ether855","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_ETHERBUNDLE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "Bundle-Ether856"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 200000000,"bandwidth64-bit": 200000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "Bundle-Ether856","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_ETHERBUNDLE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/2/0/0"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/2/0/0","l2-transport": "false","line-state": "im-state-up","mtu": 9220,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/2/0/1"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/2/0/1","l2-transport": "false","line-state": "im-state-up","mtu": 9220,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/2/0/2"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/2/0/2","l2-transport": "false","line-state": "im-state-up","mtu": 9220,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/2/0/3"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/2/0/3","l2-transport": "false","line-state": "im-state-up","mtu": 9220,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/2/0/4"},"Content": {"actual-line-state": "im-state-admin-down","actual-state": "im-state-admin-down","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/2/0/4","l2-transport": "false","line-state": "im-state-admin-down","mtu": 1514,"state": "im-state-admin-down","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/2/0/5"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/2/0/5","l2-transport": "false","line-state": "im-state-up","mtu": 9220,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/2/0/6"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/2/0/6","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/2/0/7"},"Content": {"actual-line-state": "im-state-admin-down","actual-state": "im-state-admin-down","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/2/0/7","l2-transport": "false","line-state": "im-state-admin-down","mtu": 1514,"state": "im-state-admin-down","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/3/1/0"},"Content": {"actual-line-state": "im-state-admin-down","actual-state": "im-state-admin-down","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/3/1/0","l2-transport": "false","line-state": "im-state-admin-down","mtu": 1514,"state": "im-state-admin-down","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/3/1/1"},"Content": {"actual-line-state": "im-state-admin-down","actual-state": "im-state-admin-down","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/3/1/1","l2-transport": "false","line-state": "im-state-admin-down","mtu": 1514,"state": "im-state-admin-down","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/4/0/0"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/4/0/0","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/4/0/1"},"Content": {"actual-line-state": "im-state-admin-down","actual-state": "im-state-admin-down","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/4/0/1","l2-transport": "false","line-state": "im-state-admin-down","mtu": 1514,"state": "im-state-admin-down","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/4/0/2"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/4/0/2","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/4/0/3"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/4/0/3","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/4/0/4"},"Content": {"actual-line-state": "im-state-admin-down","actual-state": "im-state-admin-down","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/4/0/4","l2-transport": "false","line-state": "im-state-admin-down","mtu": 1514,"state": "im-state-admin-down","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/4/0/5"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/4/0/5","l2-transport": "false","line-state": "im-state-up","mtu": 9220,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/4/0/6"},"Content": {"actual-line-state": "im-state-admin-down","actual-state": "im-state-admin-down","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/4/0/6","l2-transport": "false","line-state": "im-state-admin-down","mtu": 1514,"state": "im-state-admin-down","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/4/0/7"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/4/0/7","l2-transport": "false","line-state": "im-state-up","mtu": 9220,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/5/0/0"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/5/0/0","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/5/0/1"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/5/0/1","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/5/0/10"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/5/0/10","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/5/0/11"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/5/0/11","l2-transport": "false","line-state": "im-state-up","mtu": 9220,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/5/0/12"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/5/0/12","l2-transport": "false","line-state": "im-state-up","mtu": 9220,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/5/0/13"},"Content": {"actual-line-state": "im-state-admin-down","actual-state": "im-state-admin-down","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/5/0/13","l2-transport": "false","line-state": "im-state-admin-down","mtu": 1514,"state": "im-state-admin-down","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/5/0/14"},"Content": {"actual-line-state": "im-state-admin-down","actual-state": "im-state-admin-down","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/5/0/14","l2-transport": "false","line-state": "im-state-admin-down","mtu": 1514,"state": "im-state-admin-down","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/5/0/15"},"Content": {"actual-line-state": "im-state-admin-down","actual-state": "im-state-admin-down","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/5/0/15","l2-transport": "false","line-state": "im-state-admin-down","mtu": 1514,"state": "im-state-admin-down","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/5/0/16"},"Content": {"actual-line-state": "im-state-admin-down","actual-state": "im-state-admin-down","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/5/0/16","l2-transport": "false","line-state": "im-state-admin-down","mtu": 1514,"state": "im-state-admin-down","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/5/0/17"},"Content": {"actual-line-state": "im-state-admin-down","actual-state": "im-state-admin-down","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/5/0/17","l2-transport": "false","line-state": "im-state-admin-down","mtu": 1514,"state": "im-state-admin-down","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/5/0/18"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/5/0/18","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/5/0/19"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/5/0/19","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/5/0/2"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/5/0/2","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/5/0/3"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/5/0/3","l2-transport": "false","line-state": "im-state-up","mtu": 9220,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/5/0/4"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/5/0/4","l2-transport": "false","line-state": "im-state-up","mtu": 9220,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/5/0/5"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/5/0/5","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/5/0/6"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/5/0/6","l2-transport": "false","line-state": "im-state-up","mtu": 9220,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/5/0/7"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/5/0/7","l2-transport": "false","line-state": "im-state-up","mtu": 9220,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/5/0/8"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/5/0/8","l2-transport": "false","line-state": "im-state-up","mtu": 9220,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/5/0/9"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/5/0/9","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/6/0/0"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/6/0/0","l2-transport": "false","line-state": "im-state-up","mtu": 9220,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/6/0/1"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/6/0/1","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/6/0/10"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/6/0/10","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/6/0/11"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/6/0/11","l2-transport": "false","line-state": "im-state-up","mtu": 9220,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/6/0/12"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/6/0/12","l2-transport": "false","line-state": "im-state-up","mtu": 9220,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/6/0/13"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/6/0/13","l2-transport": "false","line-state": "im-state-up","mtu": 9220,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/6/0/14"},"Content": {"actual-line-state": "im-state-admin-down","actual-state": "im-state-admin-down","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/6/0/14","l2-transport": "false","line-state": "im-state-admin-down","mtu": 1514,"state": "im-state-admin-down","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/6/0/15"},"Content": {"actual-line-state": "im-state-admin-down","actual-state": "im-state-admin-down","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/6/0/15","l2-transport": "false","line-state": "im-state-admin-down","mtu": 1514,"state": "im-state-admin-down","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/6/0/16"},"Content": {"actual-line-state": "im-state-admin-down","actual-state": "im-state-admin-down","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/6/0/16","l2-transport": "false","line-state": "im-state-admin-down","mtu": 1514,"state": "im-state-admin-down","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/6/0/17"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/6/0/17","l2-transport": "false","line-state": "im-state-up","mtu": 9220,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/6/0/18"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/6/0/18","l2-transport": "false","line-state": "im-state-up","mtu": 9220,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/6/0/19"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/6/0/19","l2-transport": "false","line-state": "im-state-up","mtu": 9220,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/6/0/2"},"Content": {"actual-line-state": "im-state-admin-down","actual-state": "im-state-admin-down","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/6/0/2","l2-transport": "false","line-state": "im-state-admin-down","mtu": 1514,"state": "im-state-admin-down","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/6/0/3"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/6/0/3","l2-transport": "false","line-state": "im-state-up","mtu": 9220,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/6/0/4"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/6/0/4","l2-transport": "false","line-state": "im-state-up","mtu": 9220,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/6/0/5"},"Content": {"actual-line-state": "im-state-admin-down","actual-state": "im-state-admin-down","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/6/0/5","l2-transport": "false","line-state": "im-state-admin-down","mtu": 1514,"state": "im-state-admin-down","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/6/0/6"},"Content": {"actual-line-state": "im-state-admin-down","actual-state": "im-state-admin-down","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/6/0/6","l2-transport": "false","line-state": "im-state-admin-down","mtu": 1514,"state": "im-state-admin-down","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/6/0/7"},"Content": {"actual-line-state": "im-state-admin-down","actual-state": "im-state-admin-down","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/6/0/7","l2-transport": "false","line-state": "im-state-admin-down","mtu": 1514,"state": "im-state-admin-down","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/6/0/8"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/6/0/8","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/6/0/9"},"Content": {"actual-line-state": "im-state-admin-down","actual-state": "im-state-admin-down","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/6/0/9","l2-transport": "false","line-state": "im-state-admin-down","mtu": 1514,"state": "im-state-admin-down","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/7/0/0"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/7/0/0","l2-transport": "false","line-state": "im-state-up","mtu": 9220,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/7/0/1"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/7/0/1","l2-transport": "false","line-state": "im-state-up","mtu": 9220,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/7/0/10"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/7/0/10","l2-transport": "false","line-state": "im-state-up","mtu": 9220,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/7/0/11"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/7/0/11","l2-transport": "false","line-state": "im-state-up","mtu": 9220,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/7/0/12"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/7/0/12","l2-transport": "false","line-state": "im-state-up","mtu": 9220,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/7/0/13"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/7/0/13","l2-transport": "false","line-state": "im-state-up","mtu": 9220,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/7/0/14"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/7/0/14","l2-transport": "false","line-state": "im-state-up","mtu": 9220,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/7/0/15"},"Content": {"actual-line-state": "im-state-admin-down","actual-state": "im-state-admin-down","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/7/0/15","l2-transport": "false","line-state": "im-state-admin-down","mtu": 1514,"state": "im-state-admin-down","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/7/0/16"},"Content": {"actual-line-state": "im-state-admin-down","actual-state": "im-state-admin-down","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/7/0/16","l2-transport": "false","line-state": "im-state-admin-down","mtu": 1514,"state": "im-state-admin-down","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/7/0/17"},"Content": {"actual-line-state": "im-state-admin-down","actual-state": "im-state-admin-down","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/7/0/17","l2-transport": "false","line-state": "im-state-admin-down","mtu": 1514,"state": "im-state-admin-down","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/7/0/18"},"Content": {"actual-line-state": "im-state-admin-down","actual-state": "im-state-admin-down","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/7/0/18","l2-transport": "false","line-state": "im-state-admin-down","mtu": 1514,"state": "im-state-admin-down","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/7/0/19"},"Content": {"actual-line-state": "im-state-admin-down","actual-state": "im-state-admin-down","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/7/0/19","l2-transport": "false","line-state": "im-state-admin-down","mtu": 1514,"state": "im-state-admin-down","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/7/0/2"},"Content": {"actual-line-state": "im-state-admin-down","actual-state": "im-state-admin-down","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/7/0/2","l2-transport": "false","line-state": "im-state-admin-down","mtu": 1514,"state": "im-state-admin-down","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/7/0/3"},"Content": {"actual-line-state": "im-state-admin-down","actual-state": "im-state-admin-down","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/7/0/3","l2-transport": "false","line-state": "im-state-admin-down","mtu": 9216,"state": "im-state-admin-down","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/7/0/4"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/7/0/4","l2-transport": "false","line-state": "im-state-up","mtu": 9220,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/7/0/5"},"Content": {"actual-line-state": "im-state-admin-down","actual-state": "im-state-admin-down","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/7/0/5","l2-transport": "false","line-state": "im-state-admin-down","mtu": 9220,"state": "im-state-admin-down","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/7/0/6"},"Content": {"actual-line-state": "im-state-admin-down","actual-state": "im-state-admin-down","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/7/0/6","l2-transport": "false","line-state": "im-state-admin-down","mtu": 1514,"state": "im-state-admin-down","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/7/0/7"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/7/0/7","l2-transport": "false","line-state": "im-state-up","mtu": 9220,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/7/0/8"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/7/0/8","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/7/0/9"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/7/0/9","l2-transport": "false","line-state": "im-state-up","mtu": 9220,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/9/0/0"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/9/0/0","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/9/0/1"},"Content": {"actual-line-state": "im-state-admin-down","actual-state": "im-state-admin-down","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/9/0/1","l2-transport": "false","line-state": "im-state-admin-down","mtu": 1514,"state": "im-state-admin-down","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/9/0/2"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/9/0/2","l2-transport": "false","line-state": "im-state-up","mtu": 9220,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/9/0/3"},"Content": {"actual-line-state": "im-state-admin-down","actual-state": "im-state-admin-down","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/9/0/3","l2-transport": "false","line-state": "im-state-admin-down","mtu": 1514,"state": "im-state-admin-down","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/9/0/4"},"Content": {"actual-line-state": "im-state-admin-down","actual-state": "im-state-admin-down","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/9/0/4","l2-transport": "false","line-state": "im-state-admin-down","mtu": 1514,"state": "im-state-admin-down","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/9/0/5"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/9/0/5","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/9/0/6"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/9/0/6","l2-transport": "false","line-state": "im-state-up","mtu": 9220,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "HundredGigE0/9/0/7"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 100000000,"bandwidth64-bit": 100000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "HundredGigE0/9/0/7","l2-transport": "false","line-state": "im-state-up","mtu": 9220,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_HUNDREDGE"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "Loopback0"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 0,"bandwidth64-bit": 0,"encapsulation": "loopback","encapsulation-type-string": "Loopback","interface": "Loopback0","l2-transport": "false","line-state": "im-state-up","mtu": 1500,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_LOOPBACK"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "Loopback1"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 0,"bandwidth64-bit": 0,"encapsulation": "loopback","encapsulation-type-string": "Loopback","interface": "Loopback1","l2-transport": "false","line-state": "im-state-up","mtu": 1500,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_LOOPBACK"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "Loopback999"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 0,"bandwidth64-bit": 0,"encapsulation": "loopback","encapsulation-type-string": "Loopback","interface": "Loopback999","l2-transport": "false","line-state": "im-state-up","mtu": 1500,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_LOOPBACK"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "MgmtEth0/RP0/CPU0/0"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 1000000,"bandwidth64-bit": 1000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "MgmtEth0/RP0/CPU0/0","l2-transport": "false","line-state": "im-state-up","mtu": 1514,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_ETHERNET"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "MgmtEth0/RP1/CPU0/0"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 1000000,"bandwidth64-bit": 1000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "MgmtEth0/RP1/CPU0/0","l2-transport": "false","line-state": "im-state-up","mtu": 1514,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_ETHERNET"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "Null0"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 0,"bandwidth64-bit": 0,"encapsulation": "null","encapsulation-type-string": "Null","interface": "Null0","l2-transport": "false","line-state": "im-state-up","mtu": 1500,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_NULL"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "TenGigE0/0/0/0"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/0/0","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "TenGigE0/0/0/1"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/0/1","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "TenGigE0/0/0/10"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/0/10","l2-transport": "false","line-state": "im-state-up","mtu": 9192,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "TenGigE0/0/0/11"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/0/11","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "TenGigE0/0/0/12"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/0/12","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "TenGigE0/0/0/13"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/0/13","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "TenGigE0/0/0/14"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/0/14","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "TenGigE0/0/0/15"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/0/15","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "TenGigE0/0/0/16"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/0/16","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "TenGigE0/0/0/17"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/0/17","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "TenGigE0/0/0/18"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/0/18","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "TenGigE0/0/0/19"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/0/19","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "TenGigE0/0/0/2"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/0/2","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "TenGigE0/0/0/3"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/0/3","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "TenGigE0/0/0/4"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/0/4","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "TenGigE0/0/0/5"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/0/5","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "TenGigE0/0/0/6"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/0/6","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "TenGigE0/0/0/7"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/0/7","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "TenGigE0/0/0/8"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/0/8","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}},{"Timestamp": 1711514734793,"Keys": {"interface-name": "TenGigE0/0/0/9"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/0/9","l2-transport": "false","line-state": "im-state-up","mtu": 9192,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}},{"Timestamp": 1711514734794,"Keys": {"interface-name": "TenGigE0/0/1/0"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/1/0","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}},{"Timestamp": 1711514734794,"Keys": {"interface-name": "TenGigE0/0/1/1"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/1/1","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}},{"Timestamp": 1711514734794,"Keys": {"interface-name": "TenGigE0/0/1/10"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/1/10","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}},{"Timestamp": 1711514734794,"Keys": {"interface-name": "TenGigE0/0/1/11"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/1/11","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}},{"Timestamp": 1711514734794,"Keys": {"interface-name": "TenGigE0/0/1/12"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/1/12","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}},{"Timestamp": 1711514734794,"Keys": {"interface-name": "TenGigE0/0/1/13"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/1/13","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}},{"Timestamp": 1711514734794,"Keys": {"interface-name": "TenGigE0/0/1/14"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/1/14","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}},{"Timestamp": 1711514734794,"Keys": {"interface-name": "TenGigE0/0/1/15"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/1/15","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}},{"Timestamp": 1711514734794,"Keys": {"interface-name": "TenGigE0/0/1/16"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/1/16","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}},{"Timestamp": 1711514734794,"Keys": {"interface-name": "TenGigE0/0/1/17"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/1/17","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}},{"Timestamp": 1711514734794,"Keys": {"interface-name": "TenGigE0/0/1/18"},"Content": {"actual-line-state": "im-state-down","actual-state": "im-state-down","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/1/18","l2-transport": "false","line-state": "im-state-down","mtu": 9216,"state": "im-state-down","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}},{"Timestamp": 1711514734794,"Keys": {"interface-name": "TenGigE0/0/1/19"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/1/19","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}},{"Timestamp": 1711514734794,"Keys": {"interface-name": "TenGigE0/0/1/2"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/1/2","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}},{"Timestamp": 1711514734794,"Keys": {"interface-name": "TenGigE0/0/1/3"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/1/3","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}},{"Timestamp": 1711514734794,"Keys": {"interface-name": "TenGigE0/0/1/4"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/1/4","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}},{"Timestamp": 1711514734794,"Keys": {"interface-name": "TenGigE0/0/1/5"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/1/5","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}},{"Timestamp": 1711514734794,"Keys": {"interface-name": "TenGigE0/0/1/6"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/1/6","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}},{"Timestamp": 1711514734794,"Keys": {"interface-name": "TenGigE0/0/1/7"},"Content": {"actual-line-state": "im-state-up","actual-state": "im-state-up","bandwidth": 10000000,"bandwidth64-bit": 10000000,"encapsulation": "ether","encapsulation-type-string": "ARPA","interface": "TenGigE0/0/1/7","l2-transport": "false","line-state": "im-state-up","mtu": 9216,"state": "im-state-up","sub-interface-mtu-overhead": 0,"type": "IFT_TENGETHERNET"}}]}

Kaustubh

unread,

May 4, 2024, 4:02:12 AMMay 4

to Druid User

Logs:

2024-05-04T07:18:58,619 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.library.path=/usr/java/packages/lib:/usr/lib/x86_64-linux-gnu/jni:/lib/x86_64-linux-gnu:/usr/lib/x86_64-linux-gnu:/usr/lib/jni:/lib:/usr/lib
2024-05-04T07:18:58,619 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=var/tmp
2024-05-04T07:18:58,619 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.compiler=<NA>
2024-05-04T07:18:58,620 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.name=Linux
2024-05-04T07:18:58,620 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.arch=amd64
2024-05-04T07:18:58,620 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.version=5.15.0-60-generic
2024-05-04T07:18:58,620 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.name=root
2024-05-04T07:18:58,620 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.home=/root
2024-05-04T07:18:58,621 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.dir=/home/npeauto/apache-druid-29.0.1
2024-05-04T07:18:58,621 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.memory.free=3997MB
2024-05-04T07:18:58,621 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.memory.max=4096MB
2024-05-04T07:18:58,621 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.memory.total=4096MB
2024-05-04T07:18:58,655 INFO [main] org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost sessionTimeout=30000 watcher=org.apache.curator.ConnectionState@511bfbb0
2024-05-04T07:18:58,673 INFO [main] org.apache.zookeeper.common.X509Util - Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation
2024-05-04T07:18:58,685 INFO [main] org.apache.zookeeper.ClientCnxnSocket - jute.maxbuffer value is 1048575 Bytes
2024-05-04T07:18:58,711 INFO [main] org.apache.zookeeper.ClientCnxn - zookeeper.request.timeout value is 0. feature enabled=false
2024-05-04T07:18:58,734 INFO [main] org.apache.curator.framework.imps.CuratorFrameworkImpl - Default schema
2024-05-04T07:18:58,746 INFO [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2181.
2024-05-04T07:18:58,748 INFO [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - SASL config status: Will not attempt to authenticate using SASL (unknown error)
2024-05-04T07:18:58,872 INFO [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - Socket connection established, initiating session, client: /127.0.0.1:39108, server: localhost/127.0.0.1:2181
2024-05-04T07:18:58,887 INFO [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2181, session id = 0x10242b486e30005, negotiated timeout = 30000
2024-05-04T07:18:58,909 INFO [main-EventThread] org.apache.curator.framework.state.ConnectionStateManager - State change: CONNECTED
2024-05-04T07:18:58,948 INFO [main-EventThread] org.apache.curator.framework.imps.EnsembleTracker - New config event received: {}
2024-05-04T07:18:58,949 INFO [main-EventThread] org.apache.curator.framework.imps.EnsembleTracker - New config event received: {}
2024-05-04T07:18:58,975 WARN [NodeRoleWatcher[COORDINATOR]] org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider$NodeRoleWatcher - Ignored event type [CONNECTION_RECONNECTED] for node watcher of role [coordinator].
2024-05-04T07:18:58,976 WARN [NodeRoleWatcher[OVERLORD]] org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider$NodeRoleWatcher - Ignored event type [CONNECTION_RECONNECTED] for node watcher of role [overlord].
2024-05-04T07:18:59,026 INFO [main] org.apache.druid.indexing.worker.executor.ExecutorLifecycle - Running with task: {
"type" : "index_parallel",
"id" : "index_parallel_output1-json_mpfmbpbl_2024-05-04T07:18:32.463Z",
"groupId" : "index_parallel_output1-json_mpfmbpbl_2024-05-04T07:18:32.463Z",
"resource" : {
"availabilityGroup" : "index_parallel_output1-json_mpfmbpbl_2024-05-04T07:18:32.463Z",
"requiredCapacity" : 1
},
"spec" : {

"dataSchema" : {
"dataSource" : "output1-json",
"timestampSpec" : {
"column" : "@timestamp",
"format" : "iso",

"missingValue" : null
},
"dimensionsSpec" : {
"dimensions" : [ {
"type" : "string",
"name" : "Source",
"multiValueHandling" : "SORTED_ARRAY",
"createBitmapIndex" : true

}, {
"type" : "json",
"name" : "Telemetry",

"formatVersion" : 5,
"multiValueHandling" : "SORTED_ARRAY",
"createBitmapIndex" : true

}, {
"type" : "json",
"name" : "Rows",

"formatVersion" : 5,
"multiValueHandling" : "SORTED_ARRAY",
"createBitmapIndex" : true
} ],
"dimensionExclusions" : [ "__time", "@timestamp" ],
"includeAllDimensions" : false,
"useSchemaDiscovery" : false
},
"metricsSpec" : [ ],
"granularitySpec" : {
"type" : "uniform",
"segmentGranularity" : "HOUR",
"queryGranularity" : {
"type" : "none"
},
"rollup" : false,
"intervals" : [ ]
},
"transformSpec" : {
"filter" : null,
"transforms" : [ ]
}
},

"ioConfig" : {
"type" : "index_parallel",
"inputSource" : {
"type" : "local",

"baseDir" : "/home/npeauto",

"filter" : "output1.json"
},
"inputFormat" : {
"type" : "json",

"keepNullColumns" : false,
"assumeNewlineDelimited" : false,
"useJsonNodeReader" : false
},
"appendToExisting" : false,
"dropExisting" : false

},
"tuningConfig" : {
"type" : "index_parallel",

"maxRowsPerSegment" : 50,
"appendableIndexSpec" : {
"type" : "onheap",
"preserveExistingMetrics" : false
},
"maxRowsInMemory" : 1000,
"maxBytesInMemory" : 0,
"skipBytesInMemoryOverheadCheck" : false,
"maxTotalRows" : 200,
"numShards" : null,
"splitHintSpec" : null,

"partitionsSpec" : {
"type" : "dynamic",
"maxRowsPerSegment" : 50,
"maxTotalRows" : 200
},

"indexSpec" : {
"bitmap" : {
"type" : "roaring"
},
"dimensionCompression" : "lz4",
"stringDictionaryEncoding" : {
"type" : "utf8"
},
"metricCompression" : "lz4",
"longEncoding" : "longs"
},
"indexSpecForIntermediatePersists" : {
"bitmap" : {
"type" : "roaring"
},
"dimensionCompression" : "lz4",
"stringDictionaryEncoding" : {
"type" : "utf8"
},
"metricCompression" : "lz4",
"longEncoding" : "longs"
},
"maxPendingPersists" : 0,
"forceGuaranteedRollup" : false,
"reportParseExceptions" : false,
"pushTimeout" : 0,
"segmentWriteOutMediumFactory" : null,
"maxNumConcurrentSubTasks" : 1,
"maxRetry" : 3,
"taskStatusCheckPeriodMs" : 1000,
"chatHandlerTimeout" : "PT10S",
"chatHandlerNumRetries" : 5,
"maxNumSegmentsToMerge" : 100,
"totalNumMergeTasks" : 10,
"logParseExceptions" : false,
"maxParseExceptions" : 2147483647,
"maxSavedParseExceptions" : 0,
"maxColumnsToMerge" : -1,
"awaitSegmentAvailabilityTimeoutMillis" : 0,
"maxAllowedLockCount" : -1,
"partitionDimensions" : [ ]
}
},
"context" : {
"useConcurrentLocks" : true,
"useLineageBasedSegmentAllocation" : true,
"forceTimeChunkLock" : true
},
"dataSource" : "output1-json"
}
2024-05-04T07:18:59,028 INFO [main] org.apache.druid.indexing.worker.executor.ExecutorLifecycle - Attempting to lock file[/home/npeauto/apache-druid-29.0.1/var/druid/task/slot0/index_parallel_output1-json_mpfmbpbl_2024-05-04T07:18:32.463Z/lock].
2024-05-04T07:18:59,028 INFO [NodeRoleWatcher[COORDINATOR]] org.apache.druid.discovery.BaseNodeRoleWatcher - Node [http://localhost:8081] of role [coordinator] detected.
2024-05-04T07:18:59,028 INFO [NodeRoleWatcher[OVERLORD]] org.apache.druid.discovery.BaseNodeRoleWatcher - Node [http://localhost:8081] of role [overlord] detected.
2024-05-04T07:18:59,029 INFO [NodeRoleWatcher[COORDINATOR]] org.apache.druid.discovery.BaseNodeRoleWatcher - Node watcher of role [coordinator] is now initialized with 1 nodes.
2024-05-04T07:18:59,029 INFO [NodeRoleWatcher[OVERLORD]] org.apache.druid.discovery.BaseNodeRoleWatcher - Node watcher of role [overlord] is now initialized with 1 nodes.
2024-05-04T07:18:59,030 INFO [main] org.apache.druid.indexing.worker.executor.ExecutorLifecycle - Acquired lock file[/home/npeauto/apache-druid-29.0.1/var/druid/task/slot0/index_parallel_output1-json_mpfmbpbl_2024-05-04T07:18:32.463Z/lock] in 2ms.
2024-05-04T07:18:59,034 INFO [main] org.apache.druid.indexing.common.task.AbstractBatchIndexTask - Using time chunk lock since forceTimeChunkLock is [true] and mode is [REPLACE_LEGACY].
2024-05-04T07:18:59,041 INFO [main] org.apache.druid.segment.loading.SegmentLocalCacheManager - Using storage location strategy: [LeastBytesUsedStorageLocationSelectorStrategy]
2024-05-04T07:18:59,065 INFO [task-runner-0-priority-0] org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner - Running task: index_parallel_output1-json_mpfmbpbl_2024-05-04T07:18:32.463Z
2024-05-04T07:18:59,070 WARN [task-runner-0-priority-0] org.apache.druid.indexing.common.task.batch.parallel.ParallelIndexSupervisorTask - Intervals are missing in granularitySpec while this task is potentially overwriting existing segments. Forced to use timeChunk lock.
2024-05-04T07:18:59,071 WARN [task-runner-0-priority-0] org.apache.druid.indexing.common.task.batch.parallel.ParallelIndexSupervisorTask - maxNumConcurrentSubTasks[1] is less than or equal to 1. Running sequentially. Please set maxNumConcurrentSubTasks to something higher than 1 if you want to run in parallel ingestion mode.
2024-05-04T07:18:59,074 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Starting lifecycle [module] stage [SERVER]
2024-05-04T07:18:59,078 INFO [task-runner-0-priority-0] org.apache.druid.indexing.common.task.AbstractBatchIndexTask - Using time chunk lock since forceTimeChunkLock is [true] and mode is [REPLACE_LEGACY].
2024-05-04T07:18:59,079 WARN [task-runner-0-priority-0] org.apache.druid.indexing.common.task.IndexTask - Chat handler is already registered. Skipping chat handler registration.
2024-05-04T07:18:59,087 INFO [main] org.eclipse.jetty.server.Server - jetty-9.4.53.v20231009; built: 2023-10-09T12:29:09.265Z; git: 27bde00a0b95a1d5bbee0eae7984f891d2d0f8c9; jvm 11.0.22+7-post-Ubuntu-0ubuntu222.04.1
2024-05-04T07:18:59,103 INFO [task-runner-0-priority-0] org.apache.druid.indexing.common.task.IndexTask - Determining intervals and shardSpecs
2024-05-04T07:18:59,179 INFO [main] org.eclipse.jetty.server.session - DefaultSessionIdManager workerName=node0
2024-05-04T07:18:59,179 INFO [main] org.eclipse.jetty.server.session - No SessionScavenger set, using defaults
2024-05-04T07:18:59,181 INFO [main] org.eclipse.jetty.server.session - node0 Scavenging every 600000ms
2024-05-04T07:18:59,487 INFO [main] com.sun.jersey.server.impl.application.WebApplicationImpl - Initiating Jersey application, version 'Jersey: 1.19.4 05/24/2017 03:20 PM'
2024-05-04T07:19:00,300 INFO [task-runner-0-priority-0] org.apache.druid.indexing.common.task.IndexTask - Found intervals and shardSpecs in 1,197ms
2024-05-04T07:19:00,301 INFO [task-runner-0-priority-0] org.apache.druid.indexing.common.task.AbstractBatchIndexTask - Using time chunk lock since forceTimeChunkLock is [true] and mode is [REPLACE_LEGACY].
2024-05-04T07:19:00,333 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - Started o.e.j.s.ServletContextHandler@218e186b{/,null,AVAILABLE}
2024-05-04T07:19:00,367 INFO [main] org.eclipse.jetty.server.AbstractConnector - Started ServerConnector@445b4594{HTTP/1.1, (http/1.1)}{0.0.0.0:8100}
2024-05-04T07:19:00,368 INFO [main] org.eclipse.jetty.server.Server - Started @26903ms
2024-05-04T07:19:00,368 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Starting lifecycle [module] stage [ANNOUNCEMENTS]
2024-05-04T07:19:00,369 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Successfully started lifecycle [module]
2024-05-04T07:19:02,000 INFO [task-runner-0-priority-0] org.apache.druid.segment.realtime.appenderator.BaseAppenderatorDriver - Pushing [1] segments in background
2024-05-04T07:19:02,007 INFO [task-runner-0-priority-0] org.apache.druid.segment.realtime.appenderator.BaseAppenderatorDriver - Pushing segments: [output1-json_2024-02-01T00:00:00.000Z_2024-02-01T01:00:00.000Z_2024-05-04T07:19:00.550Z]
2024-05-04T07:19:02,012 INFO [task-runner-0-priority-0] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Persisted rows[50] and (estimated) bytes[23,843,972]
2024-05-04T07:19:08,674 ERROR [task-runner-0-priority-0] org.apache.druid.indexing.common.task.IndexTask - Encountered exception in BUILD_SEGMENTS.
java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Direct buffer memory
at org.apache.druid.indexing.common.task.IndexTask.generateAndPublishSegments(IndexTask.java:1055) ~[druid-indexing-service-29.0.1.jar:29.0.1]
at org.apache.druid.indexing.common.task.IndexTask.runTask(IndexTask.java:548) ~[druid-indexing-service-29.0.1.jar:29.0.1]
at org.apache.druid.indexing.common.task.AbstractTask.run(AbstractTask.java:179) ~[druid-indexing-service-29.0.1.jar:29.0.1]
at org.apache.druid.indexing.common.task.batch.parallel.ParallelIndexSupervisorTask.runSequential(ParallelIndexSupervisorTask.java:1214) ~[druid-indexing-service-29.0.1.jar:29.0.1]
at org.apache.druid.indexing.common.task.batch.parallel.ParallelIndexSupervisorTask.runTask(ParallelIndexSupervisorTask.java:551) ~[druid-indexing-service-29.0.1.jar:29.0.1]
at org.apache.druid.indexing.common.task.AbstractTask.run(AbstractTask.java:179) ~[druid-indexing-service-29.0.1.jar:29.0.1]
at org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner$SingleTaskBackgroundRunnerCallable.call(SingleTaskBackgroundRunner.java:478) ~[druid-indexing-service-29.0.1.jar:29.0.1]
at org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner$SingleTaskBackgroundRunnerCallable.call(SingleTaskBackgroundRunner.java:450) ~[druid-indexing-service-29.0.1.jar:29.0.1]
at com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:131) ~[guava-32.0.1-jre.jar:?]
at com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:75) ~[guava-32.0.1-jre.jar:?]
at com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:82) ~[guava-32.0.1-jre.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
at java.lang.Thread.run(Thread.java:829) ~[?:?]
Caused by: java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Direct buffer memory
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:592) ~[guava-32.0.1-jre.jar:?]
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:571) ~[guava-32.0.1-jre.jar:?]
at com.google.common.util.concurrent.FluentFuture$TrustedFuture.get(FluentFuture.java:91) ~[guava-32.0.1-jre.jar:?]
at org.apache.druid.segment.realtime.appenderator.BatchAppenderatorDriver.pushAndClear(BatchAppenderatorDriver.java:151) ~[druid-server-29.0.1.jar:29.0.1]
at org.apache.druid.segment.realtime.appenderator.BatchAppenderatorDriver.pushAllAndClear(BatchAppenderatorDriver.java:134) ~[druid-server-29.0.1.jar:29.0.1]
at org.apache.druid.indexing.common.task.InputSourceProcessor.process(InputSourceProcessor.java:122) ~[druid-indexing-service-29.0.1.jar:29.0.1]
at org.apache.druid.indexing.common.task.IndexTask.generateAndPublishSegments(IndexTask.java:945) ~[druid-indexing-service-29.0.1.jar:29.0.1]
... 13 more
Caused by: java.lang.OutOfMemoryError: Direct buffer memory
at java.nio.Bits.reserveMemory(Bits.java:175) ~[?:?]
at java.nio.DirectByteBuffer.<init>(DirectByteBuffer.java:118) ~[?:?]
at java.nio.ByteBuffer.allocateDirect(ByteBuffer.java:317) ~[?:?]
at org.apache.druid.segment.data.CompressionStrategy$LZ4Compressor.allocateInBuffer(CompressionStrategy.java:338) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.data.BlockLayoutColumnarLongsSerializer.<init>(BlockLayoutColumnarLongsSerializer.java:72) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.data.CompressionFactory.getLongSerializer(CompressionFactory.java:346) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.nested.ScalarLongFieldColumnWriter.open(ScalarLongFieldColumnWriter.java:65) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.nested.NestedDataColumnSerializer.serializeFields(NestedDataColumnSerializer.java:324) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.AutoTypeColumnMerger.writeMergedValueDictionary(AutoTypeColumnMerger.java:252) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.IndexMergerV9.writeDimValuesAndSetupDimConversion(IndexMergerV9.java:817) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.IndexMergerV9.makeIndexFiles(IndexMergerV9.java:217) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.IndexMergerV9.merge(IndexMergerV9.java:1156) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.IndexMergerV9.multiphaseMerge(IndexMergerV9.java:973) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.IndexMergerV9.persist(IndexMergerV9.java:877) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.IndexMerger.persist(IndexMerger.java:225) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.persistHydrant(AppenderatorImpl.java:1527) ~[druid-server-29.0.1.jar:29.0.1]
at org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.access$100(AppenderatorImpl.java:115) ~[druid-server-29.0.1.jar:29.0.1]
at org.apache.druid.segment.realtime.appenderator.AppenderatorImpl$2.call(AppenderatorImpl.java:655) ~[druid-server-29.0.1.jar:29.0.1]
... 6 more
2024-05-04T07:19:08,735 WARN [task-runner-0-priority-0] org.apache.druid.segment.realtime.firehose.ServiceAnnouncingChatHandlerProvider - handler[index_parallel_output1-json_mpfmbpbl_2024-05-04T07:18:32.463Z] not currently registered, ignoring.
2024-05-04T07:19:08,739 INFO [task-runner-0-priority-0] org.apache.druid.indexing.worker.executor.ExecutorLifecycle - Task completed with status: {
"id" : "index_parallel_output1-json_mpfmbpbl_2024-05-04T07:18:32.463Z",
"status" : "FAILED",
"duration" : 9670,
"errorMsg" : "java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Dir...",
"location" : {
"host" : null,
"port" : -1,
"tlsPort" : -1
}
}
2024-05-04T07:19:08,746 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Stopping lifecycle [module] stage [ANNOUNCEMENTS]
2024-05-04T07:19:08,750 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Stopping lifecycle [module] stage [SERVER]
2024-05-04T07:19:08,781 INFO [main] org.eclipse.jetty.server.AbstractConnector - Stopped ServerConnector@445b4594{HTTP/1.1, (http/1.1)}{0.0.0.0:8100}
2024-05-04T07:19:08,782 INFO [main] org.eclipse.jetty.server.session - node0 Stopped scavenging
2024-05-04T07:19:08,790 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - Stopped o.e.j.s.ServletContextHandler@218e186b{/,null,STOPPED}
2024-05-04T07:19:08,798 INFO [main] org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner - Starting graceful shutdown of task[index_parallel_output1-json_mpfmbpbl_2024-05-04T07:18:32.463Z].
2024-05-04T07:19:08,798 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Stopping lifecycle [module] stage [NORMAL]
2024-05-04T07:19:08,842 INFO [LookupExtractorFactoryContainerProvider-MainThread] org.apache.druid.query.lookup.LookupReferencesManager - Lookup Management loop exited. Lookup notices are not handled anymore.
2024-05-04T07:19:08,864 INFO [Curator-Framework-0] org.apache.curator.framework.imps.CuratorFrameworkImpl - backgroundOperationsLoop exiting
2024-05-04T07:19:09,127 INFO [main] org.apache.zookeeper.ZooKeeper - Session: 0x10242b486e30005 closed
2024-05-04T07:19:09,127 INFO [main-EventThread] org.apache.zookeeper.ClientCnxn - EventThread shut down for session: 0x10242b486e30005
2024-05-04T07:19:09,186 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Stopping lifecycle [module] stage [INIT]
Finished peon task

John Kowtko

unread,

May 4, 2024, 9:47:31 AMMay 4

to Druid User

Hi Kaus,

I'm not sure, but it looks like it may be failing during the persist. If that is the case (i.e. the row buffer is still to big due to the large JSON, then try reducing maxRowsInMemory even further. maxRowsInMemory should be less than maxRowsPerSegment anyway ... having it be a greater value doesn't make sense

You might also try upping segmentGranularity from HOUR to DAY or even MONTH or YEAR (depending on the spread of __time values in the data), to reduce the number of time intervals being opened for the ingest job.

And, you might want to turn off concurrent locks just for good measure ... that's a relatively new feature and I don't know how much it adds to the memory usage (it does create alias segments at times to coordinator the activity of multiple ingest jobs).

Let us know if any of this helps.

Thanks. John

Kaustubh

unread,

May 4, 2024, 12:58:27 PMMay 4

to Druid User

Hi,

i tried trying all the suggestions still ingestion is failing...i am running in micro-quickstart mode

Logs:

16:45:35.753 [main] WARN org.apache.druid.indexing.common.tasklogs.ConsoleLoggingEnforcementConfigurationFactory - Clearing all configured appenders for logger root. Using Console instead.
16:45:35.756 [main] WARN org.apache.druid.indexing.common.tasklogs.ConsoleLoggingEnforcementConfigurationFactory - Clearing all configured appenders for logger root. Using Console instead.
16:45:35.756 [main] WARN org.apache.druid.indexing.common.tasklogs.ConsoleLoggingEnforcementConfigurationFactory - Clearing all configured appenders for logger org.apache.druid.initialization. Using Console instead.
16:45:35.757 [main] WARN org.apache.druid.indexing.common.tasklogs.ConsoleLoggingEnforcementConfigurationFactory - Clearing all configured appenders for logger org.skife.config. Using Console instead.
16:45:35.757 [main] WARN org.apache.druid.indexing.common.tasklogs.ConsoleLoggingEnforcementConfigurationFactory - Clearing all configured appenders for logger org.apache.druid.segment. Using Console instead.
16:45:35.757 [main] WARN org.apache.druid.indexing.common.tasklogs.ConsoleLoggingEnforcementConfigurationFactory - Clearing all configured appenders for logger org.apache.kafka.clients.consumer.internals. Using Console instead.
16:45:35.757 [main] WARN org.apache.druid.indexing.common.tasklogs.ConsoleLoggingEnforcementConfigurationFactory - Clearing all configured appenders for logger org.apache.druid.server.QueryResource. Using Console instead.
16:45:35.758 [main] WARN org.apache.druid.indexing.common.tasklogs.ConsoleLoggingEnforcementConfigurationFactory - Clearing all configured appenders for logger org.apache.druid.server.coordinator. Using Console instead.
16:45:35.758 [main] WARN org.apache.druid.indexing.common.tasklogs.ConsoleLoggingEnforcementConfigurationFactory - Clearing all configured appenders for logger com.sun.jersey.guice. Using Console instead.
16:45:35.758 [main] WARN org.apache.druid.indexing.common.tasklogs.ConsoleLoggingEnforcementConfigurationFactory - Clearing all configured appenders for logger org.apache.druid.server.QueryLifecycle. Using Console instead.
2024-05-04T16:45:36,271 INFO [main] org.hibernate.validator.internal.util.Version - HV000001: Hibernate Validator 6.2.5.Final
2024-05-04T16:45:37,419 INFO [main] org.apache.druid.guice.ExtensionsLoader - Loading extension [druid-hdfs-storage], jars: jsr305-2.0.1.jar, hadoop-client-runtime-3.3.6.jar, snappy-java-1.1.10.4.jar, aws-java-sdk-kms-1.12.638.jar, slf4j-api-1.7.36.jar, commons-codec-1.16.0.jar, druid-hdfs-storage-29.0.1.jar, httpcore-4.4.11.jar, commons-logging-1.1.1.jar, wildfly-openssl-1.1.3.Final.jar, hadoop-aws-3.3.6.jar, joda-time-2.12.5.jar, jmespath-java-1.12.638.jar, jackson-dataformat-cbor-2.12.7.jar, aws-java-sdk-core-1.12.638.jar, aws-java-sdk-s3-1.12.638.jar, hadoop-client-api-3.3.6.jar, httpclient-4.5.13.jar
2024-05-04T16:45:37,442 INFO [main] org.apache.druid.guice.ExtensionsLoader - Loading extension [druid-kafka-indexing-service], jars: snappy-java-1.1.10.4.jar, lz4-java-1.8.0.jar, zstd-jni-1.5.2-3.jar, kafka-clients-3.6.1.jar, druid-kafka-indexing-service-29.0.1.jar
2024-05-04T16:45:37,445 INFO [main] org.apache.druid.guice.ExtensionsLoader - Loading extension [druid-datasketches], jars: druid-datasketches-29.0.1.jar, commons-math3-3.6.1.jar
2024-05-04T16:45:37,447 INFO [main] org.apache.druid.guice.ExtensionsLoader - Loading extension [druid-multi-stage-query], jars: druid-multi-stage-query-29.0.1.jar
2024-05-04T16:45:37,755 INFO [main] org.apache.druid.guice.ExtensionsLoader - Loading extension [druid-hdfs-storage], jars: jsr305-2.0.1.jar, hadoop-client-runtime-3.3.6.jar, snappy-java-1.1.10.4.jar, aws-java-sdk-kms-1.12.638.jar, slf4j-api-1.7.36.jar, commons-codec-1.16.0.jar, druid-hdfs-storage-29.0.1.jar, httpcore-4.4.11.jar, commons-logging-1.1.1.jar, wildfly-openssl-1.1.3.Final.jar, hadoop-aws-3.3.6.jar, joda-time-2.12.5.jar, jmespath-java-1.12.638.jar, jackson-dataformat-cbor-2.12.7.jar, aws-java-sdk-core-1.12.638.jar, aws-java-sdk-s3-1.12.638.jar, hadoop-client-api-3.3.6.jar, httpclient-4.5.13.jar
2024-05-04T16:45:37,758 INFO [main] org.apache.druid.guice.ExtensionsLoader - Loading extension [druid-kafka-indexing-service], jars: snappy-java-1.1.10.4.jar, lz4-java-1.8.0.jar, zstd-jni-1.5.2-3.jar, kafka-clients-3.6.1.jar, druid-kafka-indexing-service-29.0.1.jar
2024-05-04T16:45:37,760 INFO [main] org.apache.druid.guice.ExtensionsLoader - Loading extension [druid-datasketches], jars: druid-datasketches-29.0.1.jar, commons-math3-3.6.1.jar
2024-05-04T16:45:37,771 INFO [main] org.apache.druid.guice.ExtensionsLoader - Loading extension [druid-multi-stage-query], jars: druid-multi-stage-query-29.0.1.jar
2024-05-04T16:45:38,773 WARN [main] org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2024-05-04T16:45:39,557 INFO [main] org.apache.druid.guice.JsonConfigurator - Skipping druid.emitter.logging.logLevel property: one of it's prefixes is also used as a property key. Prefix: druid
2024-05-04T16:45:39,608 INFO [main] org.apache.druid.server.emitter.EmitterModule - Using emitter [NoopEmitter{}] for metrics and alerts, with dimensions [{version=29.0.1}].
2024-05-04T16:45:40,208 INFO [main] org.apache.druid.server.metrics.MetricsModule - Loaded 5 monitors: org.apache.druid.java.util.metrics.JvmMonitor, org.apache.druid.server.metrics.ServiceStatusMonitor, org.apache.druid.query.ExecutorServiceMonitor, org.apache.druid.curator.DruidConnectionStateListener, org.apache.druid.server.initialization.jetty.JettyServerModule$JettyMonitor
2024-05-04T16:45:40,223 INFO [main] org.apache.druid.cli.CliPeon - Starting up with processors [3], memory [2,149,580,800], maxMemory [4,294,967,296], directMemory [2,147,483,648]. Properties follow.
2024-05-04T16:45:40,224 INFO [main] org.apache.druid.cli.CliPeon - * attemptId: 1
2024-05-04T16:45:40,224 INFO [main] org.apache.druid.cli.CliPeon - * awt.toolkit: sun.awt.X11.XToolkit
2024-05-04T16:45:40,224 INFO [main] org.apache.druid.cli.CliPeon - * druid.emitter: noop
2024-05-04T16:45:40,224 INFO [main] org.apache.druid.cli.CliPeon - * druid.emitter.logging.logLevel: info
2024-05-04T16:45:40,225 INFO [main] org.apache.druid.cli.CliPeon - * druid.expressions.useStrictBooleans: true
2024-05-04T16:45:40,225 INFO [main] org.apache.druid.cli.CliPeon - * druid.extensions.loadList: ["druid-hdfs-storage", "druid-kafka-indexing-service", "druid-datasketches", "druid-multi-stage-query"]
2024-05-04T16:45:40,225 INFO [main] org.apache.druid.cli.CliPeon - * druid.host: localhost
2024-05-04T16:45:40,225 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.fork.property.druid.processing.buffer.sizeBytes: 500MiB
2024-05-04T16:45:40,225 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.fork.property.druid.processing.numMergeBuffers: 2
2024-05-04T16:45:40,225 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.fork.property.druid.processing.numThreads: 1
2024-05-04T16:45:40,225 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.logs.directory: var/druid/indexing-logs
2024-05-04T16:45:40,225 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.logs.type: file
2024-05-04T16:45:40,226 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.runner.javaOptsArray: ["-server","-Xms2g","-Xmx4g","-XX:MaxDirectMemorySize=2g","-Duser.timezone=UTC","-Dfile.encoding=UTF-8","-XX:+ExitOnOutOfMemoryError","-Djava.util.logging.manager=org.apache.logging.log4j.jul.LogManager"]
2024-05-04T16:45:40,226 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.task.baseTaskDir: /home/npeauto/apache-druid-29.0.1/var/druid/task/slot0
2024-05-04T16:45:40,226 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.task.hadoopWorkingPath: var/druid/hadoop-tmp
2024-05-04T16:45:40,226 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.task.tmpStorageBytesPerTask: 4611686018427387903
2024-05-04T16:45:40,226 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexing.doubleStorage: double
2024-05-04T16:45:40,226 INFO [main] org.apache.druid.cli.CliPeon - * druid.log.path: /home/npeauto/apache-druid-29.0.1/bin/../log
2024-05-04T16:45:40,226 INFO [main] org.apache.druid.cli.CliPeon - * druid.lookup.enableLookupSyncOnStartup: false
2024-05-04T16:45:40,226 INFO [main] org.apache.druid.cli.CliPeon - * druid.metadata.storage.connector.connectURI: jdbc:derby://localhost:1527/var/druid/metadata.db;create=true
2024-05-04T16:45:40,227 INFO [main] org.apache.druid.cli.CliPeon - * druid.metadata.storage.connector.host: localhost
2024-05-04T16:45:40,227 INFO [main] org.apache.druid.cli.CliPeon - * druid.metadata.storage.connector.port: 1527
2024-05-04T16:45:40,227 INFO [main] org.apache.druid.cli.CliPeon - * druid.metadata.storage.type: derby
2024-05-04T16:45:40,227 INFO [main] org.apache.druid.cli.CliPeon - * druid.metrics.emitter.dimension.dataSource: output1-json-new
2024-05-04T16:45:40,227 INFO [main] org.apache.druid.cli.CliPeon - * druid.metrics.emitter.dimension.groupId: index_parallel_output1-json-new_oannkibk_2024-05-04T16:45:33.489Z
2024-05-04T16:45:40,227 INFO [main] org.apache.druid.cli.CliPeon - * druid.metrics.emitter.dimension.taskId: index_parallel_output1-json-new_oannkibk_2024-05-04T16:45:33.489Z
2024-05-04T16:45:40,227 INFO [main] org.apache.druid.cli.CliPeon - * druid.metrics.emitter.dimension.taskType: index_parallel
2024-05-04T16:45:40,227 INFO [main] org.apache.druid.cli.CliPeon - * druid.monitoring.monitors: ["org.apache.druid.java.util.metrics.JvmMonitor", "org.apache.druid.server.metrics.ServiceStatusMonitor"]
2024-05-04T16:45:40,228 INFO [main] org.apache.druid.cli.CliPeon - * druid.node.type: middleManager
2024-05-04T16:45:40,228 INFO [main] org.apache.druid.cli.CliPeon - * druid.plaintextPort: 8100
2024-05-04T16:45:40,228 INFO [main] org.apache.druid.cli.CliPeon - * druid.processing.buffer.sizeBytes: 500MiB
2024-05-04T16:45:40,228 INFO [main] org.apache.druid.cli.CliPeon - * druid.processing.numMergeBuffers: 2
2024-05-04T16:45:40,228 INFO [main] org.apache.druid.cli.CliPeon - * druid.processing.numThreads: 1
2024-05-04T16:45:40,228 INFO [main] org.apache.druid.cli.CliPeon - * druid.selectors.coordinator.serviceName: druid/coordinator
2024-05-04T16:45:40,228 INFO [main] org.apache.druid.cli.CliPeon - * druid.selectors.indexing.serviceName: druid/overlord
2024-05-04T16:45:40,228 INFO [main] org.apache.druid.cli.CliPeon - * druid.server.hiddenProperties: ["druid.s3.accessKey","druid.s3.secretKey","druid.metadata.storage.connector.password", "password", "key", "token", "pwd"]
2024-05-04T16:45:40,229 INFO [main] org.apache.druid.cli.CliPeon - * druid.server.http.numThreads: 12
2024-05-04T16:45:40,229 INFO [main] org.apache.druid.cli.CliPeon - * druid.service: druid/middleManager
2024-05-04T16:45:40,229 INFO [main] org.apache.druid.cli.CliPeon - * druid.sql.enable: true
2024-05-04T16:45:40,229 INFO [main] org.apache.druid.cli.CliPeon - * druid.sql.planner.useGroupingSetForExactDistinct: true
2024-05-04T16:45:40,229 INFO [main] org.apache.druid.cli.CliPeon - * druid.startup.logging.logProperties: true
2024-05-04T16:45:40,229 INFO [main] org.apache.druid.cli.CliPeon - * druid.storage.storageDirectory: var/druid/segments
2024-05-04T16:45:40,229 INFO [main] org.apache.druid.cli.CliPeon - * druid.storage.type: local
2024-05-04T16:45:40,229 INFO [main] org.apache.druid.cli.CliPeon - * druid.task.executor.enablePlaintextPort: true
2024-05-04T16:45:40,230 INFO [main] org.apache.druid.cli.CliPeon - * druid.task.executor.enableTlsPort: false
2024-05-04T16:45:40,230 INFO [main] org.apache.druid.cli.CliPeon - * druid.task.executor.host: localhost
2024-05-04T16:45:40,230 INFO [main] org.apache.druid.cli.CliPeon - * druid.task.executor.plaintextPort: 8091
2024-05-04T16:45:40,230 INFO [main] org.apache.druid.cli.CliPeon - * druid.task.executor.service: druid/middleManager
2024-05-04T16:45:40,230 INFO [main] org.apache.druid.cli.CliPeon - * druid.task.executor.tlsPort: -1
2024-05-04T16:45:40,230 INFO [main] org.apache.druid.cli.CliPeon - * druid.tlsPort: -1
2024-05-04T16:45:40,230 INFO [main] org.apache.druid.cli.CliPeon - * druid.worker.baseTaskDirs: ["var/druid/task"]
2024-05-04T16:45:40,230 INFO [main] org.apache.druid.cli.CliPeon - * druid.worker.capacity: 2
2024-05-04T16:45:40,231 INFO [main] org.apache.druid.cli.CliPeon - * druid.zk.paths.base: /druid
2024-05-04T16:45:40,231 INFO [main] org.apache.druid.cli.CliPeon - * druid.zk.service.host: localhost
2024-05-04T16:45:40,231 INFO [main] org.apache.druid.cli.CliPeon - * file.encoding: UTF-8
2024-05-04T16:45:40,231 INFO [main] org.apache.druid.cli.CliPeon - * file.separator: /
2024-05-04T16:45:40,231 INFO [main] org.apache.druid.cli.CliPeon - * java.awt.graphicsenv: sun.awt.X11GraphicsEnvironment
2024-05-04T16:45:40,231 INFO [main] org.apache.druid.cli.CliPeon - * java.awt.printerjob: sun.print.PSPrinterJob
2024-05-04T16:45:40,231 INFO [main] org.apache.druid.cli.CliPeon - * java.class.path: /home/npeauto/apache-druid-29.0.1/conf/druid/single-server/micro-quickstart/middleManager:/home/npeauto/apache-druid-29.0.1/conf/druid/single-server/micro-quickstart/_common:/home/npeauto/apache-druid-29.0.1/conf/druid/single-server/micro-quickstart/_common/hadoop-xml:/home/npeauto/apache-druid-29.0.1/conf/druid/single-server/micro-quickstart/../_common:/home/npeauto/apache-druid-29.0.1/conf/druid/single-server/micro-quickstart/../_common/hadoop-xml:/home/npeauto/apache-druid-29.0.1/bin/../lib/jersey-guice-1.19.4.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/zookeeper-jute-3.8.3.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/maven-aether-provider-3.1.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/okhttp-1.0.2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jsr305-2.0.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jackson-jaxrs-json-provider-2.12.7.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jetty-security-9.4.53.v20231009.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jetty-rewrite-9.4.53.v20231009.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/aws-java-sdk-sts-1.12.638.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/datasketches-java-4.2.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/snappy-java-1.1.10.4.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/commons-compress-1.24.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/netty-common-4.1.100.Final.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/checker-qual-2.5.7.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/javax.activation-1.2.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jakarta.activation-api-1.2.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/netty-transport-native-unix-common-4.1.100.Final.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/json-smart-2.4.11.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/aws-java-sdk-kms-1.12.638.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/classmate-1.5.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jetty-client-9.4.53.v20231009.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/avatica-metrics-1.23.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/log4j-jul-2.18.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/slf4j-api-1.7.36.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/aether-api-0.9.0.M2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jackson-dataformat-smile-2.12.7.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/shims-0.9.49.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/google-oauth-client-1.34.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/commons-lang3-3.12.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/netty-codec-http-4.1.100.Final.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/resilience4j-core-1.3.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/proj4j-1.2.2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/curator-x-discovery-5.5.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/airline-io-2.8.4.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/sigar-1.6.5.132.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/commons-codec-1.16.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/druid-services-29.0.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/netty-transport-4.1.100.Final.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/elasticache-java-cluster-client-1.2.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jakarta.xml.bind-api-2.3.2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jackson-datatype-joda-2.12.7.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jna-platform-5.13.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/netty-handler-proxy-4.1.100.Final.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/maven-repository-metadata-3.1.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/lz4-java-1.8.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/asm-analysis-9.3.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/druid-processing-29.0.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/curator-framework-5.5.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/maven-artifact-3.6.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/async-http-client-netty-utils-2.5.3.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jboss-logging-3.4.1.Final.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jackson-core-2.12.7.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/FastInfoset-1.2.15.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/calcite-linq4j-1.35.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jackson-jaxrs-smile-provider-2.12.7.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/netty-buffer-4.1.100.Final.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/netty-transport-native-epoll-4.1.100.Final-linux-x86_64.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/netty-codec-4.1.100.Final.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/netty-transport-classes-epoll-4.1.100.Final.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/caffeine-2.8.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/maven-model-builder-3.1.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jackson-module-guice-2.12.7.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/fastutil-core-8.5.4.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/vavr-match-0.10.2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/javax.activation-api-1.2.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/netty-resolver-dns-4.1.100.Final.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/google-http-client-jackson2-1.42.3.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/log4j-core-2.18.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/aether-spi-0.9.0.M2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jaxb-api-2.3.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/asm-commons-9.3.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/commons-pool2-2.2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/plexus-utils-3.0.24.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/netty-codec-socks-4.1.100.Final.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/failureaccess-1.0.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/guice-multibindings-4.1.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/avatica-core-1.23.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/metrics-core-4.2.22.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/javax.el-api-3.0.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/log4j-api-2.18.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/opencsv-4.6.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/log4j-slf4j-impl-2.18.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/oshi-core-6.4.4.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/async-http-client-2.5.3.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/log4j-1.2-api-2.18.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/httpcore5-h2-5.1.3.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/httpcore5-5.1.3.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/httpcore-4.4.11.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jetty-servlets-9.4.53.v20231009.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/opencensus-contrib-http-util-0.31.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/druid-aws-common-29.0.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jackson-jaxrs-base-2.12.7.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/google-api-client-2.2.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/commons-text-1.10.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/commons-math3-3.6.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/grpc-context-1.27.2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/maven-settings-builder-3.1.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/json-simple-1.1.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/commons-collections-3.2.2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/commons-compiler-3.1.9.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/commons-logging-1.1.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/ipaddress-5.3.4.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/netty-resolver-4.1.100.Final.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jackson-annotations-2.12.7.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jakarta.validation-api-2.0.2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/json-path-2.3.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/druid-sql-29.0.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/httpclient5-5.1.3.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/resilience4j-bulkhead-1.3.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/fastutil-extra-8.5.4.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/uzaygezen-core-0.2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/zstd-jni-1.5.2-3.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/rhino-1.7.14.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/config-magic-0.9.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/stax-ex-1.8.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/aws-java-sdk-ec2-1.12.638.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/protobuf-java-3.24.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/janino-3.1.9.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/gson-2.10.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/aether-connector-file-0.9.0.M2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/javax.servlet-api-3.1.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jcl-over-slf4j-1.7.36.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/compress-lzf-1.0.4.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jdbi-2.63.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/google-http-client-apache-v2-1.42.3.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/curator-client-5.5.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jetty-server-9.4.53.v20231009.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/icu4j-73.2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/reactive-streams-1.0.2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jts-core-1.19.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/istack-commons-runtime-3.0.7.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jakarta.el-3.0.4.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/netty-3.10.6.Final.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/guice-assistedinject-4.1.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/wagon-provider-api-2.4.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/curator-recipes-5.5.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/druid-indexing-hadoop-29.0.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/javax.inject-1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jcodings-1.0.43.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/commons-collections4-4.2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jetty-continuation-9.4.53.v20231009.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/derbynet-10.14.2.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/avatica-server-1.23.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jersey-server-1.19.4.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/aopalliance-1.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/joda-time-2.12.5.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/audience-annotations-0.12.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/druid-gcp-common-29.0.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/hibernate-validator-6.2.5.Final.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/calcite-core-1.35.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/asm-9.3.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/plexus-interpolation-1.19.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/commons-dbcp2-2.0.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/druid-server-29.0.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/datasketches-memory-2.2.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jackson-module-jaxb-annotations-2.12.7.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/aether-impl-0.9.0.M2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/txw2-2.3.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/maven-model-3.1.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jersey-core-1.19.4.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/j2objc-annotations-2.8.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/opencensus-api-0.31.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/fastutil-8.5.4.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/guava-32.0.1-jre.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/tesla-aether-0.0.5.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jna-5.13.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/asm-tree-9.3.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/netty-handler-4.1.100.Final.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/commons-io-2.11.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/netty-codec-dns-4.1.100.Final.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/derbyclient-10.14.2.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/google-http-client-1.42.3.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/netty-reactive-streams-2.0.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/google-http-client-gson-1.42.3.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jmespath-java-1.12.638.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jetty-http-9.4.53.v20231009.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jsr311-api-1.1.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/antlr4-runtime-4.5.3.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/aether-util-0.9.0.M2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jetty-io-9.4.53.v20231009.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jaxb-runtime-2.3.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/cron-scheduler-0.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/accessors-smart-2.4.11.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/web-console-29.0.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/aggdesigner-algorithm-6.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/airline-2.8.4.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jackson-dataformat-cbor-2.12.7.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/apiguardian-api-1.1.2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/commons-beanutils-1.9.4.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/joni-2.1.27.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/aether-connector-okhttp-0.0.9.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/commons-lang-2.6.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/guice-servlet-4.1.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jakarta.inject-api-1.0.3.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jetty-util-9.4.53.v20231009.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/aws-java-sdk-core-1.12.638.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/maven-settings-3.1.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/derby-10.14.2.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jackson-databind-2.12.7.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jetty-util-ajax-9.4.53.v20231009.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/guice-4.1.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jackson-datatype-guava-2.12.7.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/disruptor-3.3.6.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/RoaringBitmap-0.9.49.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/aws-java-sdk-s3-1.12.638.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jts-io-common-1.19.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jetty-servlet-9.4.53.v20231009.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/vavr-0.10.2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/druid-indexing-service-29.0.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jackson-jq-0.0.10.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/zookeeper-3.8.3.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/xz-1.9.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jersey-servlet-1.19.4.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/error_prone_annotations-2.20.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jetty-proxy-9.4.53.v20231009.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/httpclient-4.5.13.jar
2024-05-04T16:45:40,232 INFO [main] org.apache.druid.cli.CliPeon - * java.class.version: 55.0
2024-05-04T16:45:40,232 INFO [main] org.apache.druid.cli.CliPeon - * java.home: /usr/lib/jvm/java-11-openjdk-amd64
2024-05-04T16:45:40,232 INFO [main] org.apache.druid.cli.CliPeon - * java.io.tmpdir: var/tmp
2024-05-04T16:45:40,232 INFO [main] org.apache.druid.cli.CliPeon - * java.library.path: /usr/java/packages/lib:/usr/lib/x86_64-linux-gnu/jni:/lib/x86_64-linux-gnu:/usr/lib/x86_64-linux-gnu:/usr/lib/jni:/lib:/usr/lib
2024-05-04T16:45:40,232 INFO [main] org.apache.druid.cli.CliPeon - * java.runtime.name: OpenJDK Runtime Environment
2024-05-04T16:45:40,232 INFO [main] org.apache.druid.cli.CliPeon - * java.runtime.version: 11.0.22+7-post-Ubuntu-0ubuntu222.04.1
2024-05-04T16:45:40,232 INFO [main] org.apache.druid.cli.CliPeon - * java.specification.maintenance.version: 2
2024-05-04T16:45:40,233 INFO [main] org.apache.druid.cli.CliPeon - * java.specification.name: Java Platform API Specification
2024-05-04T16:45:40,233 INFO [main] org.apache.druid.cli.CliPeon - * java.specification.vendor: Oracle Corporation
2024-05-04T16:45:40,233 INFO [main] org.apache.druid.cli.CliPeon - * java.specification.version: 11
2024-05-04T16:45:40,233 INFO [main] org.apache.druid.cli.CliPeon - * java.util.logging.manager: org.apache.logging.log4j.jul.LogManager
2024-05-04T16:45:40,233 INFO [main] org.apache.druid.cli.CliPeon - * java.vendor: Ubuntu
2024-05-04T16:45:40,233 INFO [main] org.apache.druid.cli.CliPeon - * java.vendor.url: https://ubuntu.com/
2024-05-04T16:45:40,233 INFO [main] org.apache.druid.cli.CliPeon - * java.vendor.url.bug: https://bugs.launchpad.net/ubuntu/+source/openjdk-lts
2024-05-04T16:45:40,233 INFO [main] org.apache.druid.cli.CliPeon - * java.version: 11.0.22
2024-05-04T16:45:40,234 INFO [main] org.apache.druid.cli.CliPeon - * java.version.date: 2024-01-16
2024-05-04T16:45:40,234 INFO [main] org.apache.druid.cli.CliPeon - * java.vm.compressedOopsMode: Zero based
2024-05-04T16:45:40,234 INFO [main] org.apache.druid.cli.CliPeon - * java.vm.info: mixed mode, sharing
2024-05-04T16:45:40,234 INFO [main] org.apache.druid.cli.CliPeon - * java.vm.name: OpenJDK 64-Bit Server VM
2024-05-04T16:45:40,234 INFO [main] org.apache.druid.cli.CliPeon - * java.vm.specification.name: Java Virtual Machine Specification
2024-05-04T16:45:40,234 INFO [main] org.apache.druid.cli.CliPeon - * java.vm.specification.vendor: Oracle Corporation
2024-05-04T16:45:40,234 INFO [main] org.apache.druid.cli.CliPeon - * java.vm.specification.version: 11
2024-05-04T16:45:40,234 INFO [main] org.apache.druid.cli.CliPeon - * java.vm.vendor: Ubuntu
2024-05-04T16:45:40,234 INFO [main] org.apache.druid.cli.CliPeon - * java.vm.version: 11.0.22+7-post-Ubuntu-0ubuntu222.04.1
2024-05-04T16:45:40,235 INFO [main] org.apache.druid.cli.CliPeon - * jdk.debug: release
2024-05-04T16:45:40,235 INFO [main] org.apache.druid.cli.CliPeon - * line.separator:

2024-05-04T16:45:40,235 INFO [main] org.apache.druid.cli.CliPeon - * log4j.shutdownCallbackRegistry: org.apache.druid.common.config.Log4jShutdown
2024-05-04T16:45:40,235 INFO [main] org.apache.druid.cli.CliPeon - * log4j.shutdownHookEnabled: true
2024-05-04T16:45:40,235 INFO [main] org.apache.druid.cli.CliPeon - * log4j2.configurationFactory: org.apache.druid.indexing.common.tasklogs.ConsoleLoggingEnforcementConfigurationFactory
2024-05-04T16:45:40,235 INFO [main] org.apache.druid.cli.CliPeon - * log4j2.is.webapp: false
2024-05-04T16:45:40,235 INFO [main] org.apache.druid.cli.CliPeon - * os.arch: amd64
2024-05-04T16:45:40,235 INFO [main] org.apache.druid.cli.CliPeon - * os.name: Linux
2024-05-04T16:45:40,236 INFO [main] org.apache.druid.cli.CliPeon - * os.version: 5.15.0-60-generic
2024-05-04T16:45:40,236 INFO [main] org.apache.druid.cli.CliPeon - * path.separator: :
2024-05-04T16:45:40,236 INFO [main] org.apache.druid.cli.CliPeon - * sun.arch.data.model: 64
2024-05-04T16:45:40,236 INFO [main] org.apache.druid.cli.CliPeon - * sun.boot.library.path: /usr/lib/jvm/java-11-openjdk-amd64/lib
2024-05-04T16:45:40,236 INFO [main] org.apache.druid.cli.CliPeon - * sun.cpu.endian: little
2024-05-04T16:45:40,236 INFO [main] org.apache.druid.cli.CliPeon - * sun.cpu.isalist:
2024-05-04T16:45:40,236 INFO [main] org.apache.druid.cli.CliPeon - * sun.io.unicode.encoding: UnicodeLittle
2024-05-04T16:45:40,236 INFO [main] org.apache.druid.cli.CliPeon - * sun.java.command: org.apache.druid.cli.Main internal peon var/druid/task/slot0/index_parallel_output1-json-new_oannkibk_2024-05-04T16:45:33.489Z 1
2024-05-04T16:45:40,236 INFO [main] org.apache.druid.cli.CliPeon - * sun.java.launcher: SUN_STANDARD
2024-05-04T16:45:40,237 INFO [main] org.apache.druid.cli.CliPeon - * sun.jnu.encoding: UTF-8
2024-05-04T16:45:40,237 INFO [main] org.apache.druid.cli.CliPeon - * sun.management.compiler: HotSpot 64-Bit Tiered Compilers
2024-05-04T16:45:40,237 INFO [main] org.apache.druid.cli.CliPeon - * sun.os.patch.level: unknown
2024-05-04T16:45:40,237 INFO [main] org.apache.druid.cli.CliPeon - * user.country: US
2024-05-04T16:45:40,237 INFO [main] org.apache.druid.cli.CliPeon - * user.dir: /home/npeauto/apache-druid-29.0.1
2024-05-04T16:45:40,237 INFO [main] org.apache.druid.cli.CliPeon - * user.home: /root
2024-05-04T16:45:40,237 INFO [main] org.apache.druid.cli.CliPeon - * user.language: en
2024-05-04T16:45:40,237 INFO [main] org.apache.druid.cli.CliPeon - * user.name: root
2024-05-04T16:45:40,238 INFO [main] org.apache.druid.cli.CliPeon - * user.timezone: UTC
2024-05-04T16:45:40,259 WARN [main] org.apache.druid.indexing.common.config.TaskConfig - Batch processing mode argument value is null or not valid:[null], defaulting to[CLOSED_SEGMENTS]
2024-05-04T16:45:40,504 INFO [main] org.apache.druid.query.DruidProcessingConfig - Detected max direct memory size of [2,147,483,648] bytes
2024-05-04T16:45:40,525 INFO [main] org.apache.druid.segment.loading.SegmentLocalCacheManager - Using storage location strategy: [LeastBytesUsedStorageLocationSelectorStrategy]
2024-05-04T16:45:40,577 INFO [main] org.apache.druid.guice.StorageNodeModule - Segment cache not configured on ServerType [indexer-executor]. It will not be assignable for segment placement
2024-05-04T16:45:40,714 INFO [main] org.eclipse.jetty.util.log - Logging initialized @6282ms to org.eclipse.jetty.util.log.Slf4jLog
2024-05-04T16:45:40,743 INFO [main] org.apache.druid.server.initialization.jetty.JettyServerModule - Creating http connector with port [8100]
2024-05-04T16:45:40,930 WARN [main] org.eclipse.jetty.server.handler.gzip.GzipHandler - minGzipSize of 0 is inefficient for short content, break even is size 23
2024-05-04T16:45:40,935 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[0] of size[524,288,000]
2024-05-04T16:45:41,948 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new result merging buffer[0] of size[524,288,000]
2024-05-04T16:45:42,998 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new result merging buffer[1] of size[524,288,000]
2024-05-04T16:45:44,048 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Starting lifecycle [module] stage [INIT]
2024-05-04T16:45:44,049 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Starting lifecycle [module] stage [NORMAL]
2024-05-04T16:45:44,066 INFO [main] org.apache.curator.framework.imps.CuratorFrameworkImpl - Starting
2024-05-04T16:45:44,128 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:zookeeper.version=3.8.3-6ad6d364c7c0bcf0de452d54ebefa3058098ab56, built on 2023-10-05 10:34 UTC
2024-05-04T16:45:44,128 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:host.name=Auto-Dev52
2024-05-04T16:45:44,128 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.version=11.0.22
2024-05-04T16:45:44,129 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.vendor=Ubuntu
2024-05-04T16:45:44,129 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.home=/usr/lib/jvm/java-11-openjdk-amd64
2024-05-04T16:45:44,129 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.class.path=/home/npeauto/apache-druid-29.0.1/conf/druid/single-server/micro-quickstart/middleManager:/home/npeauto/apache-druid-29.0.1/conf/druid/single-server/micro-quickstart/_common:/home/npeauto/apache-druid-29.0.1/conf/druid/single-server/micro-quickstart/_common/hadoop-xml:/home/npeauto/apache-druid-29.0.1/conf/druid/single-server/micro-quickstart/../_common:/home/npeauto/apache-druid-29.0.1/conf/druid/single-server/micro-quickstart/../_common/hadoop-xml:/home/npeauto/apache-druid-29.0.1/bin/../lib/jersey-guice-1.19.4.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/zookeeper-jute-3.8.3.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/maven-aether-provider-3.1.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/okhttp-1.0.2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jsr305-2.0.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jackson-jaxrs-json-provider-2.12.7.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jetty-security-9.4.53.v20231009.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jetty-rewrite-9.4.53.v20231009.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/aws-java-sdk-sts-1.12.638.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/datasketches-java-4.2.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/snappy-java-1.1.10.4.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/commons-compress-1.24.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/netty-common-4.1.100.Final.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/checker-qual-2.5.7.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/javax.activation-1.2.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jakarta.activation-api-1.2.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/netty-transport-native-unix-common-4.1.100.Final.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/json-smart-2.4.11.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/aws-java-sdk-kms-1.12.638.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/classmate-1.5.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jetty-client-9.4.53.v20231009.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/avatica-metrics-1.23.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/log4j-jul-2.18.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/slf4j-api-1.7.36.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/aether-api-0.9.0.M2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jackson-dataformat-smile-2.12.7.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/shims-0.9.49.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/google-oauth-client-1.34.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/commons-lang3-3.12.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/netty-codec-http-4.1.100.Final.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/resilience4j-core-1.3.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/proj4j-1.2.2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/curator-x-discovery-5.5.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/airline-io-2.8.4.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/sigar-1.6.5.132.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/commons-codec-1.16.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/druid-services-29.0.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/netty-transport-4.1.100.Final.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/elasticache-java-cluster-client-1.2.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jakarta.xml.bind-api-2.3.2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jackson-datatype-joda-2.12.7.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jna-platform-5.13.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/netty-handler-proxy-4.1.100.Final.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/maven-repository-metadata-3.1.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/lz4-java-1.8.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/asm-analysis-9.3.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/druid-processing-29.0.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/curator-framework-5.5.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/maven-artifact-3.6.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/async-http-client-netty-utils-2.5.3.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jboss-logging-3.4.1.Final.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jackson-core-2.12.7.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/FastInfoset-1.2.15.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/calcite-linq4j-1.35.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jackson-jaxrs-smile-provider-2.12.7.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/netty-buffer-4.1.100.Final.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/netty-transport-native-epoll-4.1.100.Final-linux-x86_64.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/netty-codec-4.1.100.Final.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/netty-transport-classes-epoll-4.1.100.Final.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/caffeine-2.8.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/maven-model-builder-3.1.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jackson-module-guice-2.12.7.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/fastutil-core-8.5.4.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/vavr-match-0.10.2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/javax.activation-api-1.2.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/netty-resolver-dns-4.1.100.Final.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/google-http-client-jackson2-1.42.3.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/log4j-core-2.18.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/aether-spi-0.9.0.M2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jaxb-api-2.3.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/asm-commons-9.3.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/commons-pool2-2.2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/plexus-utils-3.0.24.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/netty-codec-socks-4.1.100.Final.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/failureaccess-1.0.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/guice-multibindings-4.1.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/avatica-core-1.23.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/metrics-core-4.2.22.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/javax.el-api-3.0.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/log4j-api-2.18.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/opencsv-4.6.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/log4j-slf4j-impl-2.18.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/oshi-core-6.4.4.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/async-http-client-2.5.3.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/log4j-1.2-api-2.18.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/httpcore5-h2-5.1.3.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/httpcore5-5.1.3.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/httpcore-4.4.11.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jetty-servlets-9.4.53.v20231009.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/opencensus-contrib-http-util-0.31.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/druid-aws-common-29.0.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jackson-jaxrs-base-2.12.7.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/google-api-client-2.2.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/commons-text-1.10.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/commons-math3-3.6.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/grpc-context-1.27.2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/maven-settings-builder-3.1.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/json-simple-1.1.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/commons-collections-3.2.2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/commons-compiler-3.1.9.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/commons-logging-1.1.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/ipaddress-5.3.4.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/netty-resolver-4.1.100.Final.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jackson-annotations-2.12.7.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jakarta.validation-api-2.0.2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/json-path-2.3.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/druid-sql-29.0.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/httpclient5-5.1.3.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/resilience4j-bulkhead-1.3.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/fastutil-extra-8.5.4.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/uzaygezen-core-0.2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/zstd-jni-1.5.2-3.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/rhino-1.7.14.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/config-magic-0.9.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/stax-ex-1.8.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/aws-java-sdk-ec2-1.12.638.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/protobuf-java-3.24.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/janino-3.1.9.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/gson-2.10.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/aether-connector-file-0.9.0.M2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/javax.servlet-api-3.1.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jcl-over-slf4j-1.7.36.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/compress-lzf-1.0.4.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jdbi-2.63.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/google-http-client-apache-v2-1.42.3.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/curator-client-5.5.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jetty-server-9.4.53.v20231009.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/icu4j-73.2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/reactive-streams-1.0.2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jts-core-1.19.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/istack-commons-runtime-3.0.7.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jakarta.el-3.0.4.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/netty-3.10.6.Final.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/guice-assistedinject-4.1.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/wagon-provider-api-2.4.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/curator-recipes-5.5.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/druid-indexing-hadoop-29.0.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/javax.inject-1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jcodings-1.0.43.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/commons-collections4-4.2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jetty-continuation-9.4.53.v20231009.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/derbynet-10.14.2.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/avatica-server-1.23.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jersey-server-1.19.4.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/aopalliance-1.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/joda-time-2.12.5.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/audience-annotations-0.12.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/druid-gcp-common-29.0.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/hibernate-validator-6.2.5.Final.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/calcite-core-1.35.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/asm-9.3.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/plexus-interpolation-1.19.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/commons-dbcp2-2.0.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/druid-server-29.0.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/datasketches-memory-2.2.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jackson-module-jaxb-annotations-2.12.7.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/aether-impl-0.9.0.M2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/txw2-2.3.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/maven-model-3.1.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jersey-core-1.19.4.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/j2objc-annotations-2.8.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/opencensus-api-0.31.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/fastutil-8.5.4.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/guava-32.0.1-jre.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/tesla-aether-0.0.5.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jna-5.13.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/asm-tree-9.3.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/netty-handler-4.1.100.Final.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/commons-io-2.11.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/netty-codec-dns-4.1.100.Final.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/derbyclient-10.14.2.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/google-http-client-1.42.3.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/netty-reactive-streams-2.0.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/google-http-client-gson-1.42.3.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jmespath-java-1.12.638.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jetty-http-9.4.53.v20231009.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jsr311-api-1.1.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/antlr4-runtime-4.5.3.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/aether-util-0.9.0.M2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jetty-io-9.4.53.v20231009.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jaxb-runtime-2.3.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/cron-scheduler-0.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/accessors-smart-2.4.11.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/web-console-29.0.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/aggdesigner-algorithm-6.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/airline-2.8.4.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jackson-dataformat-cbor-2.12.7.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/apiguardian-api-1.1.2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/commons-beanutils-1.9.4.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/joni-2.1.27.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/aether-connector-okhttp-0.0.9.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/commons-lang-2.6.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/guice-servlet-4.1.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jakarta.inject-api-1.0.3.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jetty-util-9.4.53.v20231009.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/aws-java-sdk-core-1.12.638.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/maven-settings-3.1.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/derby-10.14.2.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jackson-databind-2.12.7.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jetty-util-ajax-9.4.53.v20231009.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/guice-4.1.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jackson-datatype-guava-2.12.7.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/disruptor-3.3.6.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/RoaringBitmap-0.9.49.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/aws-java-sdk-s3-1.12.638.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jts-io-common-1.19.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jetty-servlet-9.4.53.v20231009.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/vavr-0.10.2.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/druid-indexing-service-29.0.1.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jackson-jq-0.0.10.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/zookeeper-3.8.3.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/xz-1.9.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jersey-servlet-1.19.4.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/error_prone_annotations-2.20.0.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/jetty-proxy-9.4.53.v20231009.jar:/home/npeauto/apache-druid-29.0.1/bin/../lib/httpclient-4.5.13.jar
2024-05-04T16:45:44,129 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.library.path=/usr/java/packages/lib:/usr/lib/x86_64-linux-gnu/jni:/lib/x86_64-linux-gnu:/usr/lib/x86_64-linux-gnu:/usr/lib/jni:/lib:/usr/lib
2024-05-04T16:45:44,130 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=var/tmp
2024-05-04T16:45:44,130 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.compiler=<NA>
2024-05-04T16:45:44,130 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.name=Linux
2024-05-04T16:45:44,130 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.arch=amd64
2024-05-04T16:45:44,130 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.version=5.15.0-60-generic
2024-05-04T16:45:44,130 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.name=root
2024-05-04T16:45:44,130 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.home=/root
2024-05-04T16:45:44,131 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.dir=/home/npeauto/apache-druid-29.0.1
2024-05-04T16:45:44,131 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.memory.free=1962MB
2024-05-04T16:45:44,131 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.memory.max=4096MB
2024-05-04T16:45:44,131 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.memory.total=2050MB
2024-05-04T16:45:44,141 INFO [main] org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost sessionTimeout=30000 watcher=org.apache.curator.ConnectionState@153409b8
2024-05-04T16:45:44,151 INFO [main] org.apache.zookeeper.common.X509Util - Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation
2024-05-04T16:45:44,157 INFO [main] org.apache.zookeeper.ClientCnxnSocket - jute.maxbuffer value is 1048575 Bytes
2024-05-04T16:45:44,174 INFO [main] org.apache.zookeeper.ClientCnxn - zookeeper.request.timeout value is 0. feature enabled=false
2024-05-04T16:45:44,193 INFO [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2181.
2024-05-04T16:45:44,194 INFO [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - SASL config status: Will not attempt to authenticate using SASL (unknown error)
2024-05-04T16:45:44,198 INFO [main] org.apache.curator.framework.imps.CuratorFrameworkImpl - Default schema
2024-05-04T16:45:44,212 INFO [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - Socket connection established, initiating session, client: /127.0.0.1:41864, server: localhost/127.0.0.1:2181
2024-05-04T16:45:44,228 INFO [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2181, session id = 0x102450ff7490005, negotiated timeout = 30000
2024-05-04T16:45:44,248 INFO [main-EventThread] org.apache.curator.framework.state.ConnectionStateManager - State change: CONNECTED
2024-05-04T16:45:44,283 INFO [main-EventThread] org.apache.curator.framework.imps.EnsembleTracker - New config event received: {}
2024-05-04T16:45:44,283 INFO [main-EventThread] org.apache.curator.framework.imps.EnsembleTracker - New config event received: {}
2024-05-04T16:45:44,297 WARN [NodeRoleWatcher[COORDINATOR]] org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider$NodeRoleWatcher - Ignored event type [CONNECTION_RECONNECTED] for node watcher of role [coordinator].
2024-05-04T16:45:44,299 WARN [NodeRoleWatcher[OVERLORD]] org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider$NodeRoleWatcher - Ignored event type [CONNECTION_RECONNECTED] for node watcher of role [overlord].
2024-05-04T16:45:44,349 INFO [NodeRoleWatcher[COORDINATOR]] org.apache.druid.discovery.BaseNodeRoleWatcher - Node [http://localhost:8081] of role [coordinator] detected.
2024-05-04T16:45:44,349 INFO [NodeRoleWatcher[OVERLORD]] org.apache.druid.discovery.BaseNodeRoleWatcher - Node [http://localhost:8081] of role [overlord] detected.
2024-05-04T16:45:44,350 INFO [NodeRoleWatcher[COORDINATOR]] org.apache.druid.discovery.BaseNodeRoleWatcher - Node watcher of role [coordinator] is now initialized with 1 nodes.
2024-05-04T16:45:44,350 INFO [NodeRoleWatcher[OVERLORD]] org.apache.druid.discovery.BaseNodeRoleWatcher - Node watcher of role [overlord] is now initialized with 1 nodes.
2024-05-04T16:45:44,426 INFO [main] org.apache.druid.indexing.worker.executor.ExecutorLifecycle - Running with task: {
"type" : "index_parallel",
"id" : "index_parallel_output1-json-new_oannkibk_2024-05-04T16:45:33.489Z",
"groupId" : "index_parallel_output1-json-new_oannkibk_2024-05-04T16:45:33.489Z",
"resource" : {
"availabilityGroup" : "index_parallel_output1-json-new_oannkibk_2024-05-04T16:45:33.489Z",

"requiredCapacity" : 1
},
"spec" : {
"dataSchema" : {

"dataSource" : "output1-json-new",

"segmentGranularity" : "YEAR",

"maxRowsPerSegment" : 25,

"appendableIndexSpec" : {
"type" : "onheap",
"preserveExistingMetrics" : false
},

"maxRowsInMemory" : 10,
"maxBytesInMemory" : 0,
"skipBytesInMemoryOverheadCheck" : false,
"maxTotalRows" : 50,

"numShards" : null,
"splitHintSpec" : null,
"partitionsSpec" : {
"type" : "dynamic",

"maxRowsPerSegment" : 25,
"maxTotalRows" : 50

"forceTimeChunkLock" : true,
"useLineageBasedSegmentAllocation" : true
},
"dataSource" : "output1-json-new"
}
2024-05-04T16:45:44,427 INFO [main] org.apache.druid.indexing.worker.executor.ExecutorLifecycle - Attempting to lock file[/home/npeauto/apache-druid-29.0.1/var/druid/task/slot0/index_parallel_output1-json-new_oannkibk_2024-05-04T16:45:33.489Z/lock].
2024-05-04T16:45:44,428 INFO [main] org.apache.druid.indexing.worker.executor.ExecutorLifecycle - Acquired lock file[/home/npeauto/apache-druid-29.0.1/var/druid/task/slot0/index_parallel_output1-json-new_oannkibk_2024-05-04T16:45:33.489Z/lock] in 1ms.
2024-05-04T16:45:44,431 INFO [main] org.apache.druid.indexing.common.task.AbstractBatchIndexTask - Using time chunk lock since forceTimeChunkLock is [true] and mode is [REPLACE_LEGACY].
2024-05-04T16:45:44,439 INFO [main] org.apache.druid.segment.loading.SegmentLocalCacheManager - Using storage location strategy: [LeastBytesUsedStorageLocationSelectorStrategy]
2024-05-04T16:45:44,456 INFO [task-runner-0-priority-0] org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner - Running task: index_parallel_output1-json-new_oannkibk_2024-05-04T16:45:33.489Z
2024-05-04T16:45:44,460 WARN [task-runner-0-priority-0] org.apache.druid.indexing.common.task.batch.parallel.ParallelIndexSupervisorTask - Intervals are missing in granularitySpec while this task is potentially overwriting existing segments. Forced to use timeChunk lock.
2024-05-04T16:45:44,461 WARN [task-runner-0-priority-0] org.apache.druid.indexing.common.task.batch.parallel.ParallelIndexSupervisorTask - maxNumConcurrentSubTasks[1] is less than or equal to 1. Running sequentially. Please set maxNumConcurrentSubTasks to something higher than 1 if you want to run in parallel ingestion mode.
2024-05-04T16:45:44,464 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Starting lifecycle [module] stage [SERVER]
2024-05-04T16:45:44,468 INFO [task-runner-0-priority-0] org.apache.druid.indexing.common.task.AbstractBatchIndexTask - Using time chunk lock since forceTimeChunkLock is [true] and mode is [REPLACE_LEGACY].
2024-05-04T16:45:44,469 WARN [task-runner-0-priority-0] org.apache.druid.indexing.common.task.IndexTask - Chat handler is already registered. Skipping chat handler registration.
2024-05-04T16:45:44,469 INFO [main] org.eclipse.jetty.server.Server - jetty-9.4.53.v20231009; built: 2023-10-09T12:29:09.265Z; git: 27bde00a0b95a1d5bbee0eae7984f891d2d0f8c9; jvm 11.0.22+7-post-Ubuntu-0ubuntu222.04.1
2024-05-04T16:45:44,515 INFO [task-runner-0-priority-0] org.apache.druid.indexing.common.task.IndexTask - Determining intervals and shardSpecs
2024-05-04T16:45:44,552 INFO [main] org.eclipse.jetty.server.session - DefaultSessionIdManager workerName=node0
2024-05-04T16:45:44,552 INFO [main] org.eclipse.jetty.server.session - No SessionScavenger set, using defaults
2024-05-04T16:45:44,554 INFO [main] org.eclipse.jetty.server.session - node0 Scavenging every 660000ms
2024-05-04T16:45:44,781 INFO [main] com.sun.jersey.server.impl.application.WebApplicationImpl - Initiating Jersey application, version 'Jersey: 1.19.4 05/24/2017 03:20 PM'
2024-05-04T16:45:45,516 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - Started o.e.j.s.ServletContextHandler@218e186b{/,null,AVAILABLE}
2024-05-04T16:45:45,530 INFO [main] org.eclipse.jetty.server.AbstractConnector - Started ServerConnector@445b4594{HTTP/1.1, (http/1.1)}{0.0.0.0:8100}
2024-05-04T16:45:45,530 INFO [main] org.eclipse.jetty.server.Server - Started @11100ms
2024-05-04T16:45:45,530 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Starting lifecycle [module] stage [ANNOUNCEMENTS]
2024-05-04T16:45:45,532 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Successfully started lifecycle [module]
2024-05-04T16:45:45,668 INFO [task-runner-0-priority-0] org.apache.druid.indexing.common.task.IndexTask - Found intervals and shardSpecs in 1,153ms
2024-05-04T16:45:45,668 INFO [task-runner-0-priority-0] org.apache.druid.indexing.common.task.AbstractBatchIndexTask - Using time chunk lock since forceTimeChunkLock is [true] and mode is [REPLACE_LEGACY].
2024-05-04T16:45:46,431 INFO [task-runner-0-priority-0] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Flushing in-memory data to disk because No more rows can be appended to sink,rowsCurrentlyInMemory[10] is greater than maxRowsInMemory[10].
2024-05-04T16:45:46,455 INFO [task-runner-0-priority-0] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Persisted rows[10] and (estimated) bytes[3,706,964]
2024-05-04T16:45:46,699 INFO [task-runner-0-priority-0] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Flushing in-memory data to disk because No more rows can be appended to sink,rowsCurrentlyInMemory[10] is greater than maxRowsInMemory[10].
2024-05-04T16:45:52,067 WARN [task-runner-0-priority-0] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Ingestion was throttled for [5,366] millis because persists were pending.
2024-05-04T16:45:52,068 INFO [task-runner-0-priority-0] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Persisted rows[10] and (estimated) bytes[6,278,634]
2024-05-04T16:45:52,186 ERROR [[index_parallel_output1-json-new_oannkibk_2024-05-04T16:45:33.489Z]-appenderator-persist] org.apache.druid.segment.AutoTypeColumnMerger - Failed to merge dictionary for column [Rows]
org.apache.druid.java.util.common.IOE: Failed to write to file: /home/npeauto/apache-druid-29.0.1/var/druid/task/slot0/index_parallel_output1-json-new_oannkibk_2024-05-04T16:45:33.489Z/work/persist/output1-json-new_2024-01-01T00:00:00.000Z_2025-01-01T00:00:00.000Z_2024-05-04T16:45:45.909Z/0/tmpOutputFiles/filePeon7671881532210838363.tmp. Current size of file: 4074
at org.apache.druid.segment.writeout.FileWriteOutBytes.flush(FileWriteOutBytes.java:67) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.writeout.FileWriteOutBytes.flushIfNeeded(FileWriteOutBytes.java:55) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.writeout.FileWriteOutBytes.write(FileWriteOutBytes.java:92) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.writeout.FileWriteOutBytes.write(FileWriteOutBytes.java:115) ~[druid-processing-29.0.1.jar:29.0.1]
at java.io.OutputStream.write(OutputStream.java:122) ~[?:?]
at org.apache.druid.segment.data.ObjectStrategy.writeTo(ObjectStrategy.java:79) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.data.GenericIndexedWriter.write(GenericIndexedWriter.java:254) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.nested.NestedDataColumnSerializer.serializeFields(NestedDataColumnSerializer.java:275) ~[druid-processing-29.0.1.jar:29.0.1]

at org.apache.druid.segment.AutoTypeColumnMerger.writeMergedValueDictionary(AutoTypeColumnMerger.java:252) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.IndexMergerV9.writeDimValuesAndSetupDimConversion(IndexMergerV9.java:817) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.IndexMergerV9.makeIndexFiles(IndexMergerV9.java:217) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.IndexMergerV9.merge(IndexMergerV9.java:1156) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.IndexMergerV9.multiphaseMerge(IndexMergerV9.java:973) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.IndexMergerV9.persist(IndexMergerV9.java:877) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.IndexMerger.persist(IndexMerger.java:225) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.persistHydrant(AppenderatorImpl.java:1527) ~[druid-server-29.0.1.jar:29.0.1]
at org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.access$100(AppenderatorImpl.java:115) ~[druid-server-29.0.1.jar:29.0.1]
at org.apache.druid.segment.realtime.appenderator.AppenderatorImpl$2.call(AppenderatorImpl.java:655) ~[druid-server-29.0.1.jar:29.0.1]

at com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:131) ~[guava-32.0.1-jre.jar:?]
at com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:75) ~[guava-32.0.1-jre.jar:?]
at com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:82) ~[guava-32.0.1-jre.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
at java.lang.Thread.run(Thread.java:829) ~[?:?]

Caused by: java.nio.channels.ClosedByInterruptException
at java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:199) ~[?:?]
at sun.nio.ch.FileChannelImpl.endBlocking(FileChannelImpl.java:162) ~[?:?]
at sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:285) ~[?:?]
at org.apache.druid.io.Channels.writeFully(Channels.java:32) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.writeout.FileWriteOutBytes.flush(FileWriteOutBytes.java:64) ~[druid-processing-29.0.1.jar:29.0.1]
... 23 more
2024-05-04T16:45:52,229 ERROR [[index_parallel_output1-json-new_oannkibk_2024-05-04T16:45:33.489Z]-appenderator-persist] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Incremental persist failed: {class=org.apache.druid.segment.realtime.appenderator.AppenderatorImpl, segment=output1-json-new_2024-01-01T00:00:00.000Z_2025-01-01T00:00:00.000Z_2024-05-04T16:45:45.909Z, dataSource=output1-json-new, count=0}
2024-05-04T16:45:52,231 ERROR [task-runner-0-priority-0] org.apache.druid.indexing.common.task.IndexTask - Encountered exception in BUILD_SEGMENTS.
org.apache.druid.java.util.common.RE: Error while persisting
at org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.throwPersistErrorIfExists(AppenderatorImpl.java:278) ~[druid-server-29.0.1.jar:29.0.1]
at org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.add(AppenderatorImpl.java:290) ~[druid-server-29.0.1.jar:29.0.1]
at org.apache.druid.segment.realtime.appenderator.BaseAppenderatorDriver.append(BaseAppenderatorDriver.java:430) ~[druid-server-29.0.1.jar:29.0.1]
at org.apache.druid.segment.realtime.appenderator.BatchAppenderatorDriver.add(BatchAppenderatorDriver.java:116) ~[druid-server-29.0.1.jar:29.0.1]
at org.apache.druid.indexing.common.task.InputSourceProcessor.process(InputSourceProcessor.java:108) ~[druid-indexing-service-29.0.1.jar:29.0.1]

at org.apache.druid.indexing.common.task.IndexTask.generateAndPublishSegments(IndexTask.java:945) ~[druid-indexing-service-29.0.1.jar:29.0.1]

at org.apache.druid.indexing.common.task.IndexTask.runTask(IndexTask.java:548) ~[druid-indexing-service-29.0.1.jar:29.0.1]
at org.apache.druid.indexing.common.task.AbstractTask.run(AbstractTask.java:179) ~[druid-indexing-service-29.0.1.jar:29.0.1]
at org.apache.druid.indexing.common.task.batch.parallel.ParallelIndexSupervisorTask.runSequential(ParallelIndexSupervisorTask.java:1214) ~[druid-indexing-service-29.0.1.jar:29.0.1]
at org.apache.druid.indexing.common.task.batch.parallel.ParallelIndexSupervisorTask.runTask(ParallelIndexSupervisorTask.java:551) ~[druid-indexing-service-29.0.1.jar:29.0.1]
at org.apache.druid.indexing.common.task.AbstractTask.run(AbstractTask.java:179) ~[druid-indexing-service-29.0.1.jar:29.0.1]
at org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner$SingleTaskBackgroundRunnerCallable.call(SingleTaskBackgroundRunner.java:478) ~[druid-indexing-service-29.0.1.jar:29.0.1]
at org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner$SingleTaskBackgroundRunnerCallable.call(SingleTaskBackgroundRunner.java:450) ~[druid-indexing-service-29.0.1.jar:29.0.1]
at com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:131) ~[guava-32.0.1-jre.jar:?]
at com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:75) ~[guava-32.0.1-jre.jar:?]
at com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:82) ~[guava-32.0.1-jre.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
at java.lang.Thread.run(Thread.java:829) ~[?:?]

Caused by: java.lang.OutOfMemoryError: Direct buffer memory
at java.nio.Bits.reserveMemory(Bits.java:175) ~[?:?]
at java.nio.DirectByteBuffer.<init>(DirectByteBuffer.java:118) ~[?:?]
at java.nio.ByteBuffer.allocateDirect(ByteBuffer.java:317) ~[?:?]
at org.apache.druid.segment.data.CompressionStrategy$LZ4Compressor.allocateInBuffer(CompressionStrategy.java:338) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.data.BlockLayoutColumnarLongsSerializer.<init>(BlockLayoutColumnarLongsSerializer.java:72) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.data.CompressionFactory.getLongSerializer(CompressionFactory.java:346) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.nested.ScalarLongFieldColumnWriter.open(ScalarLongFieldColumnWriter.java:65) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.nested.NestedDataColumnSerializer.serializeFields(NestedDataColumnSerializer.java:324) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.AutoTypeColumnMerger.writeMergedValueDictionary(AutoTypeColumnMerger.java:252) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.IndexMergerV9.writeDimValuesAndSetupDimConversion(IndexMergerV9.java:817) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.IndexMergerV9.makeIndexFiles(IndexMergerV9.java:217) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.IndexMergerV9.merge(IndexMergerV9.java:1156) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.IndexMergerV9.multiphaseMerge(IndexMergerV9.java:973) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.IndexMergerV9.persist(IndexMergerV9.java:877) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.IndexMerger.persist(IndexMerger.java:225) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.persistHydrant(AppenderatorImpl.java:1527) ~[druid-server-29.0.1.jar:29.0.1]
at org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.access$100(AppenderatorImpl.java:115) ~[druid-server-29.0.1.jar:29.0.1]
at org.apache.druid.segment.realtime.appenderator.AppenderatorImpl$2.call(AppenderatorImpl.java:655) ~[druid-server-29.0.1.jar:29.0.1]
... 6 more

2024-05-04T16:45:52,245 WARN [task-runner-0-priority-0] org.apache.druid.segment.realtime.firehose.ServiceAnnouncingChatHandlerProvider - handler[index_parallel_output1-json-new_oannkibk_2024-05-04T16:45:33.489Z] not currently registered, ignoring.
2024-05-04T16:45:52,251 INFO [task-runner-0-priority-0] org.apache.druid.indexing.worker.executor.ExecutorLifecycle - Task completed with status: {
"id" : "index_parallel_output1-json-new_oannkibk_2024-05-04T16:45:33.489Z",
"status" : "FAILED",
"duration" : 7789,
"errorMsg" : "org.apache.druid.java.util.common.RE: Error while persisting\n\tat org.apache.druid.segment.realtime.a...",

"location" : {
"host" : null,
"port" : -1,
"tlsPort" : -1
}
}

2024-05-04T16:45:52,257 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Stopping lifecycle [module] stage [ANNOUNCEMENTS]
2024-05-04T16:45:52,259 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Stopping lifecycle [module] stage [SERVER]
2024-05-04T16:45:52,268 INFO [main] org.eclipse.jetty.server.AbstractConnector - Stopped ServerConnector@445b4594{HTTP/1.1, (http/1.1)}{0.0.0.0:8100}
2024-05-04T16:45:52,269 INFO [main] org.eclipse.jetty.server.session - node0 Stopped scavenging
2024-05-04T16:45:52,270 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - Stopped o.e.j.s.ServletContextHandler@218e186b{/,null,STOPPED}
2024-05-04T16:45:52,275 INFO [main] org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner - Starting graceful shutdown of task[index_parallel_output1-json-new_oannkibk_2024-05-04T16:45:33.489Z].
2024-05-04T16:45:52,276 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Stopping lifecycle [module] stage [NORMAL]
2024-05-04T16:45:52,297 INFO [LookupExtractorFactoryContainerProvider-MainThread] org.apache.druid.query.lookup.LookupReferencesManager - Lookup Management loop exited. Lookup notices are not handled anymore.
2024-05-04T16:45:52,323 INFO [Curator-Framework-0] org.apache.curator.framework.imps.CuratorFrameworkImpl - backgroundOperationsLoop exiting
2024-05-04T16:45:52,432 INFO [main] org.apache.zookeeper.ZooKeeper - Session: 0x102450ff7490005 closed
2024-05-04T16:45:52,432 INFO [main-EventThread] org.apache.zookeeper.ClientCnxn - EventThread shut down for session: 0x102450ff7490005
2024-05-04T16:45:52,460 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Stopping lifecycle [module] stage [INIT]
Finished peon task

John Kowtko

unread,

May 4, 2024, 2:42:27 PMMay 4

to druid...@googlegroups.com

Does your file system have an issue with the temp file (I am assuming it is a persist file) being written?

Failed to write to file: /home/npeauto/apache-druid-29.0.1/var/druid/task/slot0/index_parallel_output1-json-new_oannkibk_2024-05-04T16:45:33.489Z/work/persist/output1-json-new_2024-01-01T00:00:00.000Z_2025-01-01T00:00:00.000Z_2024-05-04T16:45:45.909Z/0/tmpOutputFiles/filePeon7671881532210838363.tmp.

--
You received this message because you are subscribed to the Google Groups "Druid User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/druid-user/16a86696-854e-4ca0-a4d8-4ef10fe13468n%40googlegroups.com.

John Kowtko

Technical Success Manager

john....@imply.io

Message has been deleted

John Kowtko

unread,

May 6, 2024, 10:22:27 AMMay 6

to druid...@googlegroups.com

HI Kaus,

Unfortunately I am at the limit of my knowledge here. If you want to reach a larger audience I suggest posting on the Apach Druid Slack channel ... there are many others who frequent that forum and should be able to provide more help here.

Thanks. John

On Sat, May 4, 2024 at 11:49 AM Kaustubh <kaus...@gmail.com> wrote:

Hi,

I am not sure about this. Would need some steps to debug this.

--

You received this message because you are subscribed to the Google Groups "Druid User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-user+...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/druid-user/CAHjOy1fLYzcuMyqTtnYehJUm31PgXpKtvd48hSNzkdvzfG4aMA%40mail.gmail.com.

Kaustubh

unread,

May 7, 2024, 7:18:42 AMMay 7

to Druid User

Hi John,

was able to ingest the data, but for very small segment size(10 rows), after specifying 2 properties:

maxPendingPersists = 1

maxColumnsToMerge = 2

But seems like the "Rows" column is just too big to do any meaningful work.

So now i want to break the "Rows" column and create multiple druid rows from a single payload. Something like this - https://github.com/apache/druid/issues/8446

If there is any blog or guide to do this, please share it. Anyways thanks for the support!

John Kowtko

unread,

May 7, 2024, 2:38:36 PMMay 7

to Druid User

I've seen a JSON object with 80k elements ingested ... so the limit could be in the memory allocation of Peon JVM. Maybe bump up heap size a bit more?

Also, notice the persist log entries:

2024-05-04T16:45:46,455 INFO [task-runner-0-priority-0] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Persisted rows[10] and (estimated) bytes[3,706,964]

...

2024-05-04T16:45:52,068 INFO [task-runner-0-priority-0] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Persisted rows[10] and (estimated) bytes[6,278,634]

So the rows are pretty big, more than 100k each ...

Kaustubh

unread,

May 13, 2024, 8:30:19 AMMay 13

to Druid User

Hi,

I tried the https://github.com/implydata/druid-example-extension mentioned approach to explode single input row into multiple rows by just following the JsonInputFormat:

created a TelemetryInputFormat.java
created a TelemetryLineReader.java

Worked once for input file with few lines of JSON...but getting Too many open files exception repeatedly now

Any idea on how to fix this

//TelemetryInputFormat.java

package io.imply.druid.example.indexer;

import com.fasterxml.jackson.annotation.JsonCreator;
import com.fasterxml.jackson.annotation.JsonInclude;
import com.fasterxml.jackson.annotation.JsonProperty;
import com.fasterxml.jackson.core.JsonParser.Feature;
import com.fasterxml.jackson.databind.ObjectMapper;
import org.apache.druid.data.input.InputEntity;
import org.apache.druid.data.input.InputEntityReader;
import org.apache.druid.data.input.InputRowSchema;
import org.apache.druid.data.input.impl.NestedInputFormat;
import org.apache.druid.java.util.common.IAE;
import org.apache.druid.java.util.common.parsers.JSONPathSpec;
import org.apache.druid.utils.CompressionUtils;

import javax.annotation.Nullable;
import java.io.File;
import java.util.Collections;
import java.util.Map;
import java.util.Map.Entry;
import java.util.Objects;

public class TelemetryInputFormat extends NestedInputFormat implements AutoCloseable
{
public static final String TYPE_KEY = "telemetry";
private final Map<String, Boolean> featureSpec;
private final ObjectMapper objectMapper;
private final boolean keepNullColumns;
private final boolean lineSplittable;
private final boolean assumeNewlineDelimited;
private final boolean useJsonNodeReader;

@JsonCreator
public TelemetryInputFormat(
@JsonProperty("flattenSpec") @Nullable JSONPathSpec flattenSpec,
@JsonProperty("featureSpec") @Nullable Map<String, Boolean> featureSpec,
@JsonProperty("keepNullColumns") @Nullable Boolean keepNullColumns,
@JsonProperty("assumeNewlineDelimited") @Nullable Boolean assumeNewlineDelimited,
@JsonProperty("useJsonNodeReader") @Nullable Boolean useJsonNodeReader
)
{
this(flattenSpec, featureSpec, keepNullColumns, true, assumeNewlineDelimited, useJsonNodeReader);
}

public TelemetryInputFormat(
@Nullable JSONPathSpec flattenSpec,
Map<String, Boolean> featureSpec,
Boolean keepNullColumns,
boolean lineSplittable,
Boolean assumeNewlineDelimited,
Boolean useJsonNodeReader
)
{
super(flattenSpec);
this.featureSpec = featureSpec == null ? Collections.emptyMap() : featureSpec;
this.objectMapper = new ObjectMapper();
if (keepNullColumns != null) {
this.keepNullColumns = keepNullColumns;
} else {
this.keepNullColumns = flattenSpec != null && flattenSpec.isUseFieldDiscovery();
}
for (Entry<String, Boolean> entry : this.featureSpec.entrySet()) {
Feature feature = Feature.valueOf(entry.getKey());
objectMapper.configure(feature, entry.getValue());
}
this.lineSplittable = lineSplittable;
this.assumeNewlineDelimited = assumeNewlineDelimited != null && assumeNewlineDelimited;
this.useJsonNodeReader = useJsonNodeReader != null && useJsonNodeReader;
if (this.assumeNewlineDelimited && this.useJsonNodeReader) {
throw new IAE("useJsonNodeReader cannot be set to true when assumeNewlineDelimited is true.");
}
}

@JsonProperty
@JsonInclude(JsonInclude.Include.NON_EMPTY)
public Map<String, Boolean> getFeatureSpec()
{
return featureSpec;
}

@JsonProperty
public boolean isKeepNullColumns()
{
return keepNullColumns;
}

@JsonProperty
public boolean isAssumeNewlineDelimited()
{
return assumeNewlineDelimited;
}

@JsonProperty
public boolean isUseJsonNodeReader()
{
return useJsonNodeReader;
}

@Override
public boolean isSplittable()
{
return false;
}

@Override
public InputEntityReader createReader(InputRowSchema inputRowSchema, InputEntity source, File temporaryDirectory)
{
try {
System.out.println("inside createReader - " + this.toString());
if (this.lineSplittable || this.assumeNewlineDelimited) {
System.out.println("inside TelemetryLineReader TelemetryLineReader TelemetryLineReader");
return new TelemetryLineReader(inputRowSchema, source, getFlattenSpec(), objectMapper, keepNullColumns);
} else if (this.useJsonNodeReader) {
System.out.println("inside TelemetryNodeReader TelemetryNodeReader TelemetryNodeReader");
return new TelemetryNodeReader(inputRowSchema, source, getFlattenSpec(), objectMapper, keepNullColumns);
} else {
System.out.println("inside TelemetryReader TelemetryReader TelemetryReader");
return new TelemetryReader(inputRowSchema, source, getFlattenSpec(), objectMapper, keepNullColumns);
}
} catch (Exception e) {
throw new RuntimeException("Failed to create input entity reader", e);
}
}

@Override
public long getWeightedSize(String path, long size)
{
CompressionUtils.Format compressionFormat = CompressionUtils.Format.fromFileName(path);
if (CompressionUtils.Format.GZ == compressionFormat) {
return size * CompressionUtils.COMPRESSED_TEXT_WEIGHT_FACTOR;
}
return size;
}

public TelemetryInputFormat withLineSplittable(boolean lineSplittable)
{
return new TelemetryInputFormat(this.getFlattenSpec(),
this.getFeatureSpec(),
this.keepNullColumns,
lineSplittable,
assumeNewlineDelimited,
useJsonNodeReader
);
}

@Override
public void close() {
// Close any resources that need cleanup here
}

@Override
public boolean equals(Object o)
{
if (this == o) {
return true;
}
if (o == null || getClass() != o.getClass()) {
return false;
}
if (!super.equals(o)) {
return false;
}
TelemetryInputFormat that = (TelemetryInputFormat) o;
return keepNullColumns == that.keepNullColumns
&& lineSplittable == that.lineSplittable
&& assumeNewlineDelimited == that.assumeNewlineDelimited
&& useJsonNodeReader == that.useJsonNodeReader
&& Objects.equals(featureSpec, that.featureSpec);
}

@Override
public int hashCode()
{
return Objects.hash(
super.hashCode(),
featureSpec,
keepNullColumns,
lineSplittable,
assumeNewlineDelimited,
useJsonNodeReader
);
}

@Override
public String toString()
{
return "TelemetryInputFormat{" +
"featureSpec=" + featureSpec +
", keepNullColumns=" + keepNullColumns +
", lineSplittable=" + lineSplittable +
", assumeNewlineDelimited=" + assumeNewlineDelimited +
", useJsonNodeReader=" + useJsonNodeReader +
'}';
}
}

//TelemetryLineReader.java

package io.imply.druid.example.indexer;

import com.fasterxml.jackson.databind.JsonNode;
import com.fasterxml.jackson.databind.ObjectMapper;
import com.fasterxml.jackson.databind.node.ObjectNode;
import org.apache.druid.data.input.InputEntity;
import org.apache.druid.data.input.InputRow;
import org.apache.druid.data.input.InputRowSchema;
import org.apache.druid.data.input.TextReader;
import org.apache.druid.data.input.impl.MapInputRowParser;
import org.apache.druid.java.util.common.parsers.JSONFlattenerMaker;
import org.apache.druid.java.util.common.parsers.JSONPathSpec;
import org.apache.druid.java.util.common.parsers.ObjectFlattener;
import org.apache.druid.java.util.common.parsers.ObjectFlatteners;
import org.apache.druid.java.util.common.parsers.ParseException;

import java.io.IOException;
import java.util.ArrayList;
import java.util.HashMap;
import java.util.List;
import java.util.Map;

public class TelemetryLineReader extends TextReader {
private final ObjectFlattener<JsonNode> flattener;
private final ObjectMapper mapper;

TelemetryLineReader(
InputRowSchema inputRowSchema,
InputEntity source,
JSONPathSpec flattenSpec,
ObjectMapper mapper,
boolean keepNullColumns
) {
super(inputRowSchema, source);
this.flattener = ObjectFlatteners.create(
flattenSpec,
new JSONFlattenerMaker(
keepNullColumns,
inputRowSchema.getDimensionsSpec().useSchemaDiscovery()
)
);
this.mapper = mapper;
}

@Override
public List<InputRow> parseInputRows(String line) throws IOException, ParseException {
try {
final JsonNode document = mapper.readValue(line, JsonNode.class);
final JsonNode source = document.get("Source");
final JsonNode telemetryNode = document.get("Telemetry");
final JsonNode rowsNode = document.get("Rows");

if (telemetryNode == null || rowsNode == null || !rowsNode.isArray()) {
throw new RuntimeException("Invalid input JSON format: " + line);
}

final List<InputRow> inputRows = new ArrayList<>();

for (JsonNode rowNode : rowsNode) {
final ObjectNode outputNode = mapper.createObjectNode();
outputNode.set("Source", source);
outputNode.set("Telemetry", telemetryNode);
outputNode.set("Row", rowNode);

inputRows.add(MapInputRowParser.parse(getInputRowSchema(), flattener.flatten(outputNode)));
}
return inputRows;
} catch (IOException e) {
throw new IOException("Error parsing input line: " + line, e);
}
}

@Override
public List<Map<String, Object>> toMap(String intermediateRow) throws IOException {
try {
final JsonNode document = mapper.readTree(intermediateRow);
final List<Map<String, Object>> outputRows = new ArrayList<>();

final String source = document.has("Source") ? document.get("Source").asText() : null;
final JsonNode telemetryNode = document.get("Telemetry");
final JsonNode rowsNode = document.get("Rows");

if (source != null && telemetryNode != null && rowsNode != null) {
for (JsonNode rowNode : rowsNode) {
final Map<String, Object> outputRow = new HashMap<>();
outputRow.put("Source", source);
outputRow.put("Telemetry", mapper.treeToValue(telemetryNode, Map.class));
outputRow.put("Row", mapper.treeToValue(rowNode, Map.class));
outputRows.add(outputRow);
}
} else {
throw new IOException("Invalid intermediate row format");
}

return outputRows;
} catch (IOException e) {
throw new IOException("Error converting intermediate row to map: " + intermediateRow, e);
}
}

@Override
public int getNumHeaderLinesToSkip() {
return 0;
}

@Override
public boolean needsToProcessHeaderLine() {
return false;
}

@Override
public void processHeaderLine(String line) {
// No header line processing required
}

}

Kaustubh

unread,

May 13, 2024, 8:32:42 AMMay 13

to Druid User

Indexing log:

2024-05-13T11:45:56,128 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=var/tmp

2024-05-13T11:45:56,128 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.compiler=<NA>
2024-05-13T11:45:56,128 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.name=Mac OS X
2024-05-13T11:45:56,128 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.arch=aarch64
2024-05-13T11:45:56,128 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.version=12.3
2024-05-13T11:45:56,128 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.name=kaustubh1.kumar
2024-05-13T11:45:56,128 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.home=/Users/kaustubh1.kumar
2024-05-13T11:45:56,128 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.dir=/Users/kaustubh1.kumar/software/apache-druid-29.0.1
2024-05-13T11:45:56,128 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.memory.free=967MB
2024-05-13T11:45:56,128 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.memory.max=1024MB
2024-05-13T11:45:56,128 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.memory.total=1024MB
2024-05-13T11:45:56,130 INFO [main] org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost sessionTimeout=30000 watcher=org.apache.curator.ConnectionState@762f8ff6
2024-05-13T11:45:56,132 INFO [main] org.apache.zookeeper.common.X509Util - Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation
2024-05-13T11:45:56,133 INFO [main] org.apache.zookeeper.ClientCnxnSocket - jute.maxbuffer value is 1048575 Bytes
2024-05-13T11:45:56,138 INFO [main] org.apache.zookeeper.ClientCnxn - zookeeper.request.timeout value is 0. feature enabled=false
2024-05-13T11:45:56,142 INFO [main] org.apache.curator.framework.imps.CuratorFrameworkImpl - Default schema
2024-05-13T11:45:56,142 INFO [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/[0:0:0:0:0:0:0:1]:2181.
2024-05-13T11:45:56,142 INFO [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - SASL config status: Will not attempt to authenticate using SASL (unknown error)
2024-05-13T11:45:56,149 INFO [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - Socket connection established, initiating session, client: /[0:0:0:0:0:0:0:1]:53779, server: localhost/[0:0:0:0:0:0:0:1]:2181
2024-05-13T11:45:56,171 INFO [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/[0:0:0:0:0:0:0:1]:2181, session id = 0x1000f94cb350005, negotiated timeout = 30000
2024-05-13T11:45:56,173 INFO [main-EventThread] org.apache.curator.framework.state.ConnectionStateManager - State change: CONNECTED
2024-05-13T11:45:56,178 INFO [main-EventThread] org.apache.curator.framework.imps.EnsembleTracker - New config event received: {}
2024-05-13T11:45:56,178 INFO [main-EventThread] org.apache.curator.framework.imps.EnsembleTracker - New config event received: {}
2024-05-13T11:45:56,180 WARN [NodeRoleWatcher[COORDINATOR]] org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider$NodeRoleWatcher - Ignored event type [CONNECTION_RECONNECTED] for node watcher of role [coordinator].
2024-05-13T11:45:56,180 WARN [NodeRoleWatcher[OVERLORD]] org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider$NodeRoleWatcher - Ignored event type [CONNECTION_RECONNECTED] for node watcher of role [overlord].
2024-05-13T11:45:56,184 INFO [main] org.apache.druid.indexing.worker.executor.ExecutorLifecycle - Running with task: {
  "type" : "index_parallel",
  "id" : "index_parallel_dump_ag2_random_123_anlpajlp_2024-05-13T11:45:53.196Z",
  "groupId" : "index_parallel_dump_ag2_random_123_anlpajlp_2024-05-13T11:45:53.196Z",
  "resource" : {
    "availabilityGroup" : "index_parallel_dump_ag2_random_123_anlpajlp_2024-05-13T11:45:53.196Z",

    "requiredCapacity" : 1
  },
  "spec" : {
    "dataSchema" : {

      "dataSource" : "dump_ag2_random_123",
      "timestampSpec" : {
        "column" : "!!!_no_such_column_!!!",
        "format" : "auto",
        "missingValue" : "2010-01-01T00:00:00.000Z"
      },
      "dimensionsSpec" : {
        "dimensions" : [ {
          "type" : "json",
          "name" : "Row",

          "formatVersion" : 5,
          "multiValueHandling" : "SORTED_ARRAY",
          "createBitmapIndex" : true
        }, {
          "type" : "json",
          "name" : "Telemetry",
          "formatVersion" : 5,
          "multiValueHandling" : "SORTED_ARRAY",
          "createBitmapIndex" : true
        }, {

          "type" : "string",
          "name" : "Source",
          "multiValueHandling" : "SORTED_ARRAY",
          "createBitmapIndex" : true
        } ],

"dimensionExclusions" : [ "__time", "!!!_no_such_column_!!!" ],

        "includeAllDimensions" : false,
        "useSchemaDiscovery" : false
      },
      "metricsSpec" : [ ],
      "granularitySpec" : {
        "type" : "uniform",

"segmentGranularity" : {
"type" : "all"

        },
        "queryGranularity" : {
          "type" : "none"
        },
        "rollup" : false,
        "intervals" : [ ]
      },
      "transformSpec" : {
        "filter" : null,
        "transforms" : [ ]
      }
    },
    "ioConfig" : {
      "type" : "index_parallel",
      "inputSource" : {
        "type" : "local",

        "baseDir" : "/Users/kaustubh1.kumar/software/druid/examples/quickstart/telemetry",
        "filter" : "dump_ag2_random.json"
      },
      "inputFormat" : {
        "type" : "telemetry",

        "keepNullColumns" : false,
        "assumeNewlineDelimited" : false,
        "useJsonNodeReader" : false
      },
      "appendToExisting" : false,
      "dropExisting" : false
    },
    "tuningConfig" : {
      "type" : "index_parallel",

"maxRowsPerSegment" : 5000000,

      "appendableIndexSpec" : {
        "type" : "onheap",
        "preserveExistingMetrics" : false
      },

      "maxRowsInMemory" : 1000000,
      "maxBytesInMemory" : 0,
      "skipBytesInMemoryOverheadCheck" : false,
      "maxTotalRows" : null,

      "numShards" : null,
      "splitHintSpec" : null,
      "partitionsSpec" : {
        "type" : "dynamic",

"maxRowsPerSegment" : 5000000,
"maxTotalRows" : null

"dataSource" : "dump_ag2_random_123"
}
2024-05-13T11:45:56,184 INFO [main] org.apache.druid.indexing.worker.executor.ExecutorLifecycle - Attempting to lock file[/Users/kaustubh1.kumar/software/apache-druid-29.0.1/var/druid/task/slot0/index_parallel_dump_ag2_random_123_anlpajlp_2024-05-13T11:45:53.196Z/lock].
2024-05-13T11:45:56,185 INFO [main] org.apache.druid.indexing.worker.executor.ExecutorLifecycle - Acquired lock file[/Users/kaustubh1.kumar/software/apache-druid-29.0.1/var/druid/task/slot0/index_parallel_dump_ag2_random_123_anlpajlp_2024-05-13T11:45:53.196Z/lock] in 1ms.
2024-05-13T11:45:56,186 INFO [main] org.apache.druid.indexing.common.task.AbstractBatchIndexTask - Using time chunk lock since forceTimeChunkLock is [true] and mode is [REPLACE_LEGACY].
2024-05-13T11:45:56,188 INFO [main] org.apache.druid.segment.loading.SegmentLocalCacheManager - Using storage location strategy: [LeastBytesUsedStorageLocationSelectorStrategy]
2024-05-13T11:45:56,189 INFO [NodeRoleWatcher[COORDINATOR]] org.apache.druid.discovery.BaseNodeRoleWatcher - Node [http://localhost:8081] of role [coordinator] detected.
2024-05-13T11:45:56,189 INFO [NodeRoleWatcher[OVERLORD]] org.apache.druid.discovery.BaseNodeRoleWatcher - Node [http://localhost:8081] of role [overlord] detected.
2024-05-13T11:45:56,189 INFO [NodeRoleWatcher[COORDINATOR]] org.apache.druid.discovery.BaseNodeRoleWatcher - Node watcher of role [coordinator] is now initialized with 1 nodes.
2024-05-13T11:45:56,189 INFO [NodeRoleWatcher[OVERLORD]] org.apache.druid.discovery.BaseNodeRoleWatcher - Node watcher of role [overlord] is now initialized with 1 nodes.
2024-05-13T11:45:56,192 INFO [task-runner-0-priority-0] org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner - Running task: index_parallel_dump_ag2_random_123_anlpajlp_2024-05-13T11:45:53.196Z
2024-05-13T11:45:56,193 WARN [task-runner-0-priority-0] org.apache.druid.indexing.common.task.batch.parallel.ParallelIndexSupervisorTask - Intervals are missing in granularitySpec while this task is potentially overwriting existing segments. Forced to use timeChunk lock.
2024-05-13T11:45:56,193 WARN [task-runner-0-priority-0] org.apache.druid.indexing.common.task.batch.parallel.ParallelIndexSupervisorTask - maxNumConcurrentSubTasks[1] is less than or equal to 1. Running sequentially. Please set maxNumConcurrentSubTasks to something higher than 1 if you want to run in parallel ingestion mode.
2024-05-13T11:45:56,193 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Starting lifecycle [module] stage [SERVER]
2024-05-13T11:45:56,194 INFO [task-runner-0-priority-0] org.apache.druid.indexing.common.task.AbstractBatchIndexTask - Using time chunk lock since forceTimeChunkLock is [true] and mode is [REPLACE_LEGACY].
2024-05-13T11:45:56,194 INFO [main] org.eclipse.jetty.server.Server - jetty-9.4.53.v20231009; built: 2023-10-09T12:29:09.265Z; git: 27bde00a0b95a1d5bbee0eae7984f891d2d0f8c9; jvm 19.0.1+10-21
2024-05-13T11:45:56,194 WARN [task-runner-0-priority-0] org.apache.druid.indexing.common.task.IndexTask - Chat handler is already registered. Skipping chat handler registration.
2024-05-13T11:45:56,201 INFO [task-runner-0-priority-0] org.apache.druid.indexing.common.task.IndexTask - Determining intervals and shardSpecs
2024-05-13T11:45:56,204 INFO [main] org.eclipse.jetty.server.session - DefaultSessionIdManager workerName=node0
2024-05-13T11:45:56,204 INFO [main] org.eclipse.jetty.server.session - No SessionScavenger set, using defaults
2024-05-13T11:45:56,204 INFO [main] org.eclipse.jetty.server.session - node0 Scavenging every 660000ms
inside createReader - TelemetryInputFormat{featureSpec={}, keepNullColumns=false, lineSplittable=true, assumeNewlineDelimited=false, useJsonNodeReader=false}
inside TelemetryLineReader TelemetryLineReader TelemetryLineReader
2024-05-13T11:45:56,238 INFO [main] com.sun.jersey.server.impl.application.WebApplicationImpl - Initiating Jersey application, version 'Jersey: 1.19.4 05/24/2017 03:20 PM'
2024-05-13T11:45:56,252 INFO [task-runner-0-priority-0] org.apache.druid.indexing.common.task.IndexTask - Found intervals and shardSpecs in 50ms
2024-05-13T11:45:56,252 INFO [task-runner-0-priority-0] org.apache.druid.indexing.common.task.AbstractBatchIndexTask - Using time chunk lock since forceTimeChunkLock is [true] and mode is [REPLACE_LEGACY].
inside createReader - TelemetryInputFormat{featureSpec={}, keepNullColumns=false, lineSplittable=true, assumeNewlineDelimited=false, useJsonNodeReader=false}
inside TelemetryLineReader TelemetryLineReader TelemetryLineReader
2024-05-13T11:45:56,512 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - Started o.e.j.s.ServletContextHandler@4fea23d6{/,null,AVAILABLE}
2024-05-13T11:45:56,518 INFO [main] org.eclipse.jetty.server.AbstractConnector - Started ServerConnector@24bdd996{HTTP/1.1, (http/1.1)}{0.0.0.0:8100}
2024-05-13T11:45:56,518 INFO [main] org.eclipse.jetty.server.Server - Started @2903ms
2024-05-13T11:45:56,518 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Starting lifecycle [module] stage [ANNOUNCEMENTS]
2024-05-13T11:45:56,518 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Successfully started lifecycle [module]
2024-05-13T11:45:56,519 INFO [task-runner-0-priority-0] org.apache.druid.segment.realtime.appenderator.BaseAppenderatorDriver - Pushing [1] segments in background
2024-05-13T11:45:56,520 INFO [task-runner-0-priority-0] org.apache.druid.segment.realtime.appenderator.BaseAppenderatorDriver - Pushing segments: [dump_ag2_random_123_-146136543-09-08T08:23:32.096Z_146140482-04-24T15:36:27.903Z_2024-05-13T11:45:56.364Z]
2024-05-13T11:45:56,521 INFO [task-runner-0-priority-0] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Persisted rows[244] and (estimated) bytes[1,487,118]
2024-05-13T11:45:56,914 ERROR [[index_parallel_dump_ag2_random_123_anlpajlp_2024-05-13T11:45:53.196Z]-appenderator-persist] org.apache.druid.segment.AutoTypeColumnMerger - Failed to merge dictionary for column [Row]
java.io.IOException: Too many open files
at java.io.UnixFileSystem.createFileExclusively0(Native Method) ~[?:?]
at java.io.UnixFileSystem.createFileExclusively(UnixFileSystem.java:356) ~[?:?]
at java.io.File.createTempFile(File.java:2179) ~[?:?]
at org.apache.druid.segment.writeout.TmpFileSegmentWriteOutMedium.makeWriteOutBytes(TmpFileSegmentWriteOutMedium.java:46) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.data.GenericIndexedWriter.open(GenericIndexedWriter.java:223) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.data.BlockLayoutColumnarLongsSerializer.open(BlockLayoutColumnarLongsSerializer.java:80) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.nested.ScalarLongFieldColumnWriter.open(ScalarLongFieldColumnWriter.java:73) ~[druid-processing-29.0.1.jar:29.0.1]

at org.apache.druid.segment.nested.NestedDataColumnSerializer.serializeFields(NestedDataColumnSerializer.java:324) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.AutoTypeColumnMerger.writeMergedValueDictionary(AutoTypeColumnMerger.java:252) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.IndexMergerV9.writeDimValuesAndSetupDimConversion(IndexMergerV9.java:817) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.IndexMergerV9.makeIndexFiles(IndexMergerV9.java:217) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.IndexMergerV9.merge(IndexMergerV9.java:1156) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.IndexMergerV9.multiphaseMerge(IndexMergerV9.java:973) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.IndexMergerV9.persist(IndexMergerV9.java:877) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.IndexMerger.persist(IndexMerger.java:225) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.persistHydrant(AppenderatorImpl.java:1527) ~[druid-server-29.0.1.jar:29.0.1]
at org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.access$100(AppenderatorImpl.java:115) ~[druid-server-29.0.1.jar:29.0.1]
at org.apache.druid.segment.realtime.appenderator.AppenderatorImpl$2.call(AppenderatorImpl.java:655) ~[druid-server-29.0.1.jar:29.0.1]

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
at java.lang.Thread.run(Thread.java:1589) ~[?:?]
2024-05-13T11:45:57,015 ERROR [[index_parallel_dump_ag2_random_123_anlpajlp_2024-05-13T11:45:53.196Z]-appenderator-persist] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Incremental persist failed: {class=org.apache.druid.segment.realtime.appenderator.AppenderatorImpl, segment=dump_ag2_random_123_-146136543-09-08T08:23:32.096Z_146140482-04-24T15:36:27.903Z_2024-05-13T11:45:56.364Z, dataSource=dump_ag2_random_123, count=0}
2024-05-13T11:45:57,016 ERROR [task-runner-0-priority-0] org.apache.druid.indexing.common.task.IndexTask - Encountered exception in BUILD_SEGMENTS.
java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.RuntimeException: java.io.IOException: Too many open files
at org.apache.druid.indexing.common.task.IndexTask.generateAndPublishSegments(IndexTask.java:1055) ~[druid-indexing-service-29.0.1.jar:29.0.1]

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
at java.lang.Thread.run(Thread.java:1589) ~[?:?]
Caused by: java.util.concurrent.ExecutionException: java.lang.RuntimeException: java.io.IOException: Too many open files

at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:592) ~[guava-32.0.1-jre.jar:?]
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:571) ~[guava-32.0.1-jre.jar:?]
at com.google.common.util.concurrent.FluentFuture$TrustedFuture.get(FluentFuture.java:91) ~[guava-32.0.1-jre.jar:?]
at org.apache.druid.segment.realtime.appenderator.BatchAppenderatorDriver.pushAndClear(BatchAppenderatorDriver.java:151) ~[druid-server-29.0.1.jar:29.0.1]

at org.apache.druid.segment.realtime.appenderator.BatchAppenderatorDriver.pushAllAndClear(BatchAppenderatorDriver.java:134) ~[druid-server-29.0.1.jar:29.0.1]
at org.apache.druid.indexing.common.task.InputSourceProcessor.process(InputSourceProcessor.java:131) ~[druid-indexing-service-29.0.1.jar:29.0.1]

at org.apache.druid.indexing.common.task.IndexTask.generateAndPublishSegments(IndexTask.java:945) ~[druid-indexing-service-29.0.1.jar:29.0.1]

... 13 more
Caused by: java.lang.RuntimeException: java.io.IOException: Too many open files
at org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.persistHydrant(AppenderatorImpl.java:1562) ~[druid-server-29.0.1.jar:29.0.1]

at org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.access$100(AppenderatorImpl.java:115) ~[druid-server-29.0.1.jar:29.0.1]
at org.apache.druid.segment.realtime.appenderator.AppenderatorImpl$2.call(AppenderatorImpl.java:655) ~[druid-server-29.0.1.jar:29.0.1]
... 6 more

Caused by: java.io.IOException: Too many open files
at java.io.UnixFileSystem.createFileExclusively0(Native Method) ~[?:?]
at java.io.UnixFileSystem.createFileExclusively(UnixFileSystem.java:356) ~[?:?]
at java.io.File.createTempFile(File.java:2179) ~[?:?]
at org.apache.druid.segment.writeout.TmpFileSegmentWriteOutMedium.makeWriteOutBytes(TmpFileSegmentWriteOutMedium.java:46) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.data.GenericIndexedWriter.open(GenericIndexedWriter.java:223) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.data.BlockLayoutColumnarLongsSerializer.open(BlockLayoutColumnarLongsSerializer.java:80) ~[druid-processing-29.0.1.jar:29.0.1]
at org.apache.druid.segment.nested.ScalarLongFieldColumnWriter.open(ScalarLongFieldColumnWriter.java:73) ~[druid-processing-29.0.1.jar:29.0.1]

2024-05-13T11:45:57,020 WARN [task-runner-0-priority-0] org.apache.druid.segment.realtime.firehose.ServiceAnnouncingChatHandlerProvider - handler[index_parallel_dump_ag2_random_123_anlpajlp_2024-05-13T11:45:53.196Z] not currently registered, ignoring.
2024-05-13T11:45:57,022 INFO [task-runner-0-priority-0] org.apache.druid.indexing.worker.executor.ExecutorLifecycle - Task completed with status: {
  "id" : "index_parallel_dump_ag2_random_123_anlpajlp_2024-05-13T11:45:53.196Z",
  "status" : "FAILED",
  "duration" : 828,
  "errorMsg" : "java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.RuntimeException: jav...",

  "location" : {
    "host" : null,
    "port" : -1,
    "tlsPort" : -1
  }
}

2024-05-13T11:45:57,024 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Stopping lifecycle [module] stage [ANNOUNCEMENTS]
2024-05-13T11:45:57,025 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Stopping lifecycle [module] stage [SERVER]
2024-05-13T11:45:57,028 INFO [main] org.eclipse.jetty.server.AbstractConnector - Stopped ServerConnector@24bdd996{HTTP/1.1, (http/1.1)}{0.0.0.0:8100}
2024-05-13T11:45:57,028 INFO [main] org.eclipse.jetty.server.session - node0 Stopped scavenging
2024-05-13T11:45:57,028 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - Stopped o.e.j.s.ServletContextHandler@4fea23d6{/,null,STOPPED}
2024-05-13T11:45:57,039 INFO [main] org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner - Starting graceful shutdown of task[index_parallel_dump_ag2_random_123_anlpajlp_2024-05-13T11:45:53.196Z].
2024-05-13T11:45:57,040 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Stopping lifecycle [module] stage [NORMAL]
2024-05-13T11:45:57,045 INFO [LookupExtractorFactoryContainerProvider-MainThread] org.apache.druid.query.lookup.LookupReferencesManager - Lookup Management loop exited. Lookup notices are not handled anymore.
2024-05-13T11:45:57,047 INFO [Curator-Framework-0] org.apache.curator.framework.imps.CuratorFrameworkImpl - backgroundOperationsLoop exiting
2024-05-13T11:45:57,173 INFO [main] org.apache.zookeeper.ZooKeeper - Session: 0x1000f94cb350005 closed
2024-05-13T11:45:57,173 INFO [main-EventThread] org.apache.zookeeper.ClientCnxn - EventThread shut down for session: 0x1000f94cb350005
2024-05-13T11:45:57,179 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Stopping lifecycle [module] stage [INIT]
Finished peon task

Kaustubh

unread,

May 16, 2024, 1:58:48 AMMay 16

to Druid User

Update: was update to proceed using custom inputFormat when tried this on a server

Reply all

Reply to author

Forward

0 new messages