Urgent REQ : Senior Data Engineer || HYBRID || EXP : 14+ ||
0 views
Skip to first unread message
Gayatri Candid8
Sep 27, 2023, 3:28:46 PM9/27/23
to pra...@candid8.us
Job Title: Senior Data Engineer (Java, Python, Spark, REST API)
--
location : HYbrid
visa : usc ,gc, h1b
EXP : 14+
2daya per week onsite in NY
Job Description
We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will play a crucial role in designing, implementing, and maintaining data pipelines and infrastructure for our big data projects. Your expertise in Java, Python, Spark cluster management, data science, big data, REST API development, and knowledge of Databricks and Delta Lake will be essential in driving the success of our data initiatives.
Responsibilities:
- Design, develop, and implement scalable data pipelines and ETL processes using Java, Python, and Spark.
-Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and design efficient solutions.
Manage and optimize Spark clusters to ensure high performance and reliability.
- Perform data exploration, data cleaning, and data transformation tasks to prepare data for analysis and modeling.
- Develop and maintain data models and schemas to support data integration and analysis.
- Implement data quality and validation checks to ensure accuracy and consistency of data.
-Utilize REST API development skills to create and integrate data services and endpoints for seamless data access and consumption.
-Monitor and troubleshoot data pipeline performance, identifying and resolving bottlenecks and issues..
- Stay updated with the latest technologies and trends in big data, data engineering, data science, and REST API development, and provide recommendations for process improvements.
- Mentor and guide junior team members, providing technical leadership and sharing best practices.
Qualifications:
Master's degree in Computer Science, Data Science, or a related field.
- Minimum of 3 years of professional experience in data engineering, working with Java, Python, Spark, and big data technologies.
Strong programming skills in Java and Python, with expertise in building scalable and maintainable code.
--
Job Description
We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will play a crucial role in designing, implementing, and maintaining data pipelines and infrastructure for our big data projects. Your expertise in Java, Python, Spark cluster management, data science, big data, REST API development, and knowledge of Databricks and Delta Lake will be essential in driving the success of our data initiatives.
Responsibilities:
- Design, develop, and implement scalable data pipelines and ETL processes using Java, Python, and Spark.
-Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and design efficient solutions.
Manage and optimize Spark clusters to ensure high performance and reliability.
- Perform data exploration, data cleaning, and data transformation tasks to prepare data for analysis and modeling.
- Develop and maintain data models and schemas to support data integration and analysis.
- Implement data quality and validation checks to ensure accuracy and consistency of data.
-Utilize REST API development skills to create and integrate data services and endpoints for seamless data access and consumption.
-Monitor and troubleshoot data pipeline performance, identifying and resolving bottlenecks and issues..
- Stay updated with the latest technologies and trends in big data, data engineering, data science, and REST API development, and provide recommendations for process improvements.
- Mentor and guide junior team members, providing technical leadership and sharing best practices.
Qualifications:
Master's degree in Computer Science, Data Science, or a related field.
- Minimum of 3 years of professional experience in data engineering, working with Java, Python, Spark, and big data technologies.
Strong programming skills in Java and Python, with expertise in building scalable and maintainable code.
|
Sender notified by Mailtrack | 09/27/23, 12:58:34 PM |
Prabhas CH
IT Recruiter
M: 878-888-6242 | Email: pra...@candid8.us / prabhas...@gmail.com
A: HQ - 12337 Jones Road, 200-25, Houston, TEXAS 77070, US
Website: www.Candid8.us
Reply all
Reply to author
Forward
0 new messages