1)Role: Lead Data Engineer/ Big Data Lead / Hadoop / AWS Data Engineer
Location: Plano TX
Client: Capital One
Duration: Long term
Any Visa is accepted (OPT, CPT, H1B, H1B Transfer, H4-EAD, GC-EAD, E3 ,L1,L2-EAD,USC and GC)
Minimum experience : 8+ Years.
Responsibilities: • Help develop sustainable data solutions with current and leading gen data technologies to meet the needs of our organization and business customers
• Grasp / master new technologies rapidly as needed to progress varied initiatives
• Break down complex data issues and resolve them
• Build robust systems with an eye on automation and the long-term maintenance and support of the application
• Work directly with the product owner and end-users to constantly deliver products in a highly collaborative and agile environment
Basic Qualifications:
• Bachelor's Degree
• At least 4 years of Data Engineering experience with Big Data Technologies: Apache Spark, Hadoop, or Kafka
• At least 3 years of microservices development experience: Python, Java or Scala
• At least 2 years of experience building data pipelines, CICD pipelines, and fit for purpose data stores
• At least 1 year of experience in Cloud technologies: AWS, OpenStack, Docker, Ansible, Chef or Terraform • 4+ years of experience working with AWS: S3, EMR, or EC2
• 4+ years of experience working with data consumption patterns in SQL or Python applications
• 2+ years of experience with NOSQL Graph Databases.