Job Title: Data Engineer (Databricks, Python, Spark, Control-M)
Location: Richardson, TX (Onsite)
Job Description:
We are seeking a skilled Data Engineer with expertise in Databricks, Python, Apache Spark, and Control-M to join our dynamic team. The ideal candidate will be responsible for designing, developing, and optimizing data pipelines, ensuring data accuracy, and working closely with cross-functional teams to support business intelligence and analytics initiatives.
Responsibilities:
- Design and develop scalable data pipelines using Databricks and Apache Spark for large-scale data processing.
- Write efficient Python scripts to automate data workflows, transformations, and ETL processes.
- Implement data ingestion, transformation, and storage solutions within cloud-based or on-premise environments.
- Manage job scheduling and automation using Control-M, ensuring smooth execution and monitoring of batch processes.
- Optimize Spark-based ETL workflows for better performance and cost-efficiency.
- Work with structured and unstructured datasets, ensuring data quality, consistency, and governance.
- Troubleshoot data processing issues and optimize SQL queries for performance improvement.
- Collaborate with data analysts, data scientists, and business teams to support their reporting and analytics needs.
- Ensure compliance with data security policies and industry standards.
Requirements:
- Strong experience in Databricks and Apache Spark for building data pipelines.
- Proficiency in Python for data processing, scripting, and automation.
- Hands-on experience with Control-M for scheduling and managing data workflows.
- Solid understanding of SQL for data extraction, transformation, and analysis.
- Experience working with cloud platforms such as AWS, Azure, or GCP (preferred).
- Knowledge of data warehousing concepts, ETL frameworks, and best practices.
- Strong problem-solving skills and the ability to work in a fast-paced environment.
- Excellent communication skills to collaborate with technical and business teams.
David Abraham
BDM/ IT RECRUITER
✉️ Email: da...@innoverglobalinc.com INNOVER GLOBAL INC
📞 Phone: +1 (302) 918-XXXX 🌐An E-Verify Employer
📍 Address: 75 Executive Drive, Suite 🌍 Website: www.innoverglobalinc.com
321 Aurora, IL – 60504
ABOUT INNOVER GLOBAL INC
Innover Global Inc specializes in placing contract job seekers into Information Technology, Accounting and Finance, Engineering, and Government jobs.
Innover Global Inc is a premier provider of employment and staffing solutions to Fortune 1000 customers across the United States and Canada.
We provide long-term contract, short-term contract, temporary-to-permanent, direct placement, and enhanced staffing services.