Urgent Opening # Lead Data Engineer in Bay Area, CA
umakant yadav
Hi,
I hope you're having a good day! I'm reaching out to you to check whether you are open/looking for a new contract opportunity for a Lead Data Engineer in Bay Area, CA Please reply to me for more details.
Role: Lead Data Engineer
Location: Bay Area CA (Remote)
Duration: Long term contract
Interview: coding round: Advance SQL, Python
Job Description:
Looking for Lead Data Engineer to be part of the largest social media organization, working for their data center business group under the data science team. The team has a mandate to move data centers to autonomous – self running /self-healing data centers. All projects are aligned toward the above mandate. All projects handle Petabytes of data coming from different sensors & help in creating business value out of it.
The team consists of industry leaders in the data science space, and Ph.D./scholars from schools like MIT.
Job Description:
We are looking for Data Engineers to build data pipelines for the Data Center business group's Data Science team at the largest social media organization using its next-generation data tools. As a member of a centralized Data Science/Data Engineering team, you will contribute to a variety of projects and technologies, depending on partner needs.
Responsibilities
· Partner with leadership, engineers, program managers, and data scientists to understand data needs.
· Design, build and launch extremely efficient and reliable data pipelines to move data across several platforms including Data Warehouse, online caches, and real-time systems.
· Build data expertise and own data quality for your areas.
Qualifications
· 2+ years of Data Engineering experience
· Advanced SQL coding - Expert in SQL with a good understanding of how relational databases work
· Experience querying massive datasets using Presto, Hive, etc.
· Good Python Programming Experience
· Experience with Data Warehousing Architecture
· Experience with workflow management engines like Airflow, Data swarm, Luigi, etc.
· 2+ years' experience in custom ETL design, implementation, and maintenance
· Experience with data quality and validation.
Experience with SQL performance tuning and e2e process optimization
Thanks,
Uma Email: u...@cy-tec.com
11710, Plaza America Drive, |