Issues with date-time conversation

15 views
Skip to first unread message

chiemezie ukaumunna

unread,
Nov 19, 2019, 9:54:04 AM11/19/19
to Elasticsearch ES
Hello 

I am having some issues converting Date-Time Dynamically in ES, I am streaming from MSSQL to Kafka as topics and  finally to ES as indexes 
The fields I want to convert 


Please Advise 

This is how my DateTime looks like 

Output on Kafka AVRO format
=========================

"CREATED_TIMESTAMP": 1573719856898000000,
"UPDATED_TIMESTAMP": 1573720190225000000,

Output on Kibana
===================

CREATED_TIMESTAMP:
+49871555-03-18T09:26:40.000Z


UPDATED_TIMESTAMP:
+49871555-03-18T00:50:00.000Z




REST API Call
==================

PUT /_template/kafkaconnect/
{
"template": "*",
"settings":

{ "number_of_shards": 1, "number_of_replicas": 0 }

,
"mappings": {
"dynamic_templates": [
{
"dates": {
"match": "@timestamp",
"mapping":

{ "type": "date" }

}
},
{
"dates": {
"match": "*TIMESTAMP",
"mapping":

{ "type": "date", "format": "yyyy-MM-dd HH:mm:ss||yyyy-MM-dd||epoch_millis" }

}

}
]
}
}
}








chiemezie ukaumunna

unread,
Dec 5, 2019, 4:09:41 PM12/5/19
to Elasticsearch ES
using this configuration  "time.precision.mode":"connect" resolved the issue 
Reply all
Reply to author
Forward
0 new messages