Hiring Data Engineer
Abhinav Mohanty
Hello Everyone,
Please share suitable profiles.
Don’t call me, Once I review the profile will give you a call.
|
If you are sharing any profile, please mention: Location – Work Authorization – "Before submitting any candidates please share the visa back and front copy must and LinkedIn id " |
Role: Data Engineer
Location: Raleigh, NC (onsite) – Need Local
Job Description:
We are seeking a skilled mid-level+ Data Engineer to
join our team and focus on quality assurance, quality checking, and ETL
processes. The successful candidate will be responsible for ensuring the
integrity and accuracy of data transferred from a shared file transfer service
to an S3 bucket and subsequently into and through our Snowflake data platform.
This data will be utilized by downstream applications and reporting systems.
These applications and the corresponding consumed data are critical to business
process execution.
Key Responsibilities:
Quality Assurance & Quality Checking: Implement and maintain data
quality to ensure the accuracy and reliability of data throughout the ETL
process.
ETL Processes: Design, develop, and optimize ETL workflows to efficiently
transfer data from file transfer services to S3 buckets and Snowflake.
Data Integration: Ensure seamless data integration into data platform, enabling
efficient consumption by downstream applications and reporting tools.
Data Quality Management: Address data quality challenges, including
inconsistencies in source data that do not meet ingestion requirements, which
can lead to load failures or data backouts.
Collaboration: Work closely with business owners, data analysts, business
intelligence teams, and other stakeholders to understand data requirements and
deliver high-quality data solutions.
Monitoring & Troubleshooting: To preserve data flow and integrity, monitor
pipelines, identify issues, and implement solutions.
Skills Required -8 years
· Demonstrated mid-level+ experience in data engineering, with an emphasis on data quality assurance and ETL processes.
· Expertise in Python, PyPI, and SQL
· Demonstrate a strong understanding of cybersecurity principles related to code development, DevOps, data access, and fundamental cybersecurity.
· Understanding of fundamental public-cloud capabilities.
· Proven capacity to comprehend business needs and convert them into technical requirements.