Future timestamp on segments

38 views
Skip to first unread message

ds.al...@gmail.com

unread,
Apr 24, 2018, 6:42:50 AM4/24/18
to Druid Development
I am getting started with Druid and this is my very first query ....

The segment  for my datasource is getting created with future timestamp. 
Highlighted with color blue is the ingestion timestamp and hilghlighted red is what i found in HDFS.

MTAS_Raw_2018-08-28T14:00:00.000Z_2018-08-28T15:00:00.000Z_2018-04-24T00:42:02.665Z

MTAS_Raw is the datasource name.

HDFS and Historical Node is running on same server.


Payload from Druid metadata (druid_segments) table.

 


{
"binaryVersion" : 9,
"dataSource" : "MTAS_Raw",
"dimensions" : "COUNTER_GROUP_ID,MTAS_P_3,MTAS_P_4,MTAS_P_1,MTAS_P_2",
"identifier" : "MTAS_Raw_2018-08-28T14:00:00.000Z_2018-08-28T15:00:00.000Z_2018-04-24T00:42:02.665Z",
"interval" : "2018-08-28T14:00:00.000Z/2018-08-28T15:00:00.000Z",
"loadSpec" : {
"path" : "/MTAS_Raw/20180828T140000.000Z_20180828T150000.000Z/2018-04-24T00_42_02.665Z/0_index.zip",
"type" : "hdfs"
},
"metrics" : "MTAS_C_1,MTAS_C_2,MTAS_C_3,MTAS_C_4,MTAS_C_5,MTAS_C_6,MTAS_C_7",
"shardSpec" : {
"partitionNum" : 0,
"partitions" : 0,
"type" : "numbered"
},
"size" : 206710,
"version" : "2018-04-24T00:42:02.665Z"
}


MTAS_Raw_2018-08-28T14:00:00.000Z_2018-08-28T15:00:00.000Z_2018-04-24T00:42:02.665ZMTAS_Raw2018-04-24T01:08:41.281Z2018-08-28T14:00:00.000Z2018-08-28T15:00:00.000Z12018-04-24T00:42:02.665Z1...

Gian Merlino

unread,
May 3, 2018, 2:53:47 PM5/3/18
to druid-de...@googlegroups.com
Hello,

This would be a better question for the druid-user list (druid...@googlegroups.com).

Although, what I guess is happening is that for some reason, Druid thinks your data is timestamped for 2018-08-28. Please double-check that. If your timestamps are not for that day, then double-check your timestampSpec.

Gian

--
You received this message because you are subscribed to the Google Groups "Druid Development" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-development+unsubscribe@googlegroups.com.
To post to this group, send email to druid-development@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/druid-development/9b5e14dc-5dff-4a5e-bb1a-46d283c714ff%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Reply all
Reply to author
Forward
0 new messages