W2 Requirement
Job Title: Lead Bigdata Hadoop Engineer (with GCP exp)
Location: Irving, TX (Hybrid – Weekly 2-3 days must go to office)
Duration: 12+ Months
Email - alagesh...@xnovaq.com
Visa: Except OPT/CPT
Ingestion and Curation skills needed
Required Skills:
Must Have:
Must have hands on Lead experience.
Big data expert with 6+ years experience in Hadoop Big data ecosystem
Spark - Batch & Streaming (Python, Scala )
Apache Kafka hands on experience
Experience in cloud environment, specially GCP
Experience in developing both batch and real-time streaming data pipelines
Python/Shell scripting
Expertise in SQL
Experience in Hive, Impala, Ozone, Iceberg
Oozie and Airflow scheduler hands on experience
Good to have:
Hadoop fundamental concepts
CICD
Cloudera ecosystem experience