Hope you are doing great.
NOTE: Candidate must be local to
Texas!!!
Job Title: Lead Big Data Engineer
Location: Dallas,
TX
Duration: Long term Contract
Overview:
The system you would be building Purpose of
the bus.
Confluent Kafka Message Processing
To aggregate, distribute and
store infrastructure data (Reference Data, Events, Metrics, Logs) from a very
large global network Data Ingestion Frameworks
We use FluentD, but as our
bus grows, we will be using a bunch of other frameworks Messaging
Confluent
Kafka Message Processing
Currently using Spark, but as the bus grows we may
use other frameworks like Storm Storage
HDFS/HBase/Hive/ElasticSearch
Volumes
Current volume 6/7 TB per day, 2019 goal 40 TB per day, 2020 goal –
400 TB per day.
Regards:
Neil Khanna - Executive Search
Consulting
Knights Inc.
100 Overlook Center, 2nd Floor
Princeton| New Jersey-08540
Desk: 609-357-9484 or 609-357-9397 Extn: 116
neil....@consultingknights.com
Website:
www.Consultingknights.com
This
email message, including any attachments, is for the sole use of the intended
recipient(s) and may contain confidential and privileged information.
Any
unauthorized review, use, disclosure or distribution is prohibited. If you are
not the intended recipient, please contact the sender by reply e-mail and
destroy all copies
of the original message.
Thanks
Neil Khanna | IT Recruiter
Consulting Knights Inc
100 Overlook Center, 2nd Floor
Princeton| New Jersey-08540