timestamp format

1,164 views
Skip to first unread message

Dmitry Oleynikov

unread,
Jan 20, 2016, 7:53:21 AM1/20/16
to Druid User
Hi, I have tons of timestamped data from different sources. Some of them have milliseconds , some does not. is it possible to import such data within one task?

Second question is : I could not find any description of timestamp formats in Druid.

charles.allen

unread,
Jan 20, 2016, 7:31:01 PM1/20/16
to Druid User
The supported timestamp formats are in https://github.com/metamx/java-util/blob/master/src/main/java/com/metamx/common/parsers/TimestampParser.java

But you can only define one ParseSpec per ingestion task right now. So you could have multiple ingestions for the different data sets, but currently cannot have ONE ingestion tackle all the different timestamps.

Pet Nik

unread,
Jan 21, 2016, 9:42:40 AM1/21/16
to Druid User
try

"timestampSpec": {
"column": "timestamp",
"format": "posix"
}

среда, 20 января 2016 г., 15:53:21 UTC+3 пользователь Dmitry Oleynikov написал:

Fangjin

unread,
Jan 21, 2016, 7:11:44 PM1/21/16
to Druid User
Dmitry, the timestamp formats are described here:

Search for "timestamp spec"

--
You received this message because you are subscribed to the Google Groups "Druid User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-user+...@googlegroups.com.
To post to this group, send email to druid...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/druid-user/9e19023c-ceea-40f1-a86a-1757c07eed6d%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

Reply all
Reply to author
Forward
0 new messages