Hello
I am having some issues converting Date-Time Dynamically in ES, I am streaming from MSSQL to Kafka as topics and finally to ES as indexes
The fields I want to convert
Please Advise
This is how my DateTime looks like
Output on Kafka AVRO format
=========================
"CREATED_TIMESTAMP": 1573719856898000000,
"UPDATED_TIMESTAMP": 1573720190225000000,
Output on Kibana
===================
- CREATED_TIMESTAMP:
- +49871555-03-18T09:26:40.000Z
- UPDATED_TIMESTAMP:
- +49871555-03-18T00:50:00.000Z
REST API Call
==================
PUT /_template/kafkaconnect/
{
"template": "*",
"settings":
{ "number_of_shards": 1, "number_of_replicas": 0 },
"mappings": {
"dynamic_templates": [
{
"dates": {
"match": "@timestamp",
"mapping":
{ "type": "date" }}
},
{
"dates": {
"match": "*TIMESTAMP",
"mapping":
{ "type": "date", "format": "yyyy-MM-dd HH:mm:ss||yyyy-MM-dd||epoch_millis" }}
}
]
}
}
}