Data Engineer / Data Reliability Engineer II

[Venkat Reddy]

Job Title: Data Engineer / Data Reliability Engineer II
Location: Basking Ridge, NJ (Hybrid – Local candidates only)


Job Summary:
We are looking for a Data Engineer / Data Reliability Engineer II with strong experience in PostgreSQL and AWS. The ideal candidate should have hands-on experience working with PostgreSQL as a source system, building and managing data pipelines (ETL/ELT), and supporting large-scale data lakes and data warehouses that integrate data from multiple sources.

Key Responsibilities:
* Build, optimize, and manage large data lakes and data warehouses using data from multiple disparate sources.
* Design, develop, and maintain data pipelines (ETL/ELT) using PostgreSQL and AWS services.
* Proactively monitor PostgreSQL RDS instances for performance, availability, and resource utilization such as CPU, memory, storage, and connections using tools like CloudWatch and Prometheus.
* Identify performance bottlenecks in PostgreSQL RDS and apply tuning techniques such as reviewing query execution plans, adding missing indexes, and recommending parameter adjustments.
* Monitor the health and performance of Debezium and Kafka Connect connectors, and troubleshoot issues related to data capture and delivery.
* Monitor ETL workflows and data pipelines for errors, performance bottlenecks, and processing delays; troubleshoot and resolve issues to ensure reliable and timely data movement.
* Provide support for data-related issues and participate in root cause analysis.
* Monitor Apache Airflow DAGs, identify failed tasks, troubleshoot issues, and rerun workflows when needed.
* Develop and maintain automation scripts and Infrastructure as Code (IaC) templates using tools such as Terraform and Crossplane.
* Participate in on-call rotations to respond to database-related incidents and perform troubleshooting and RCA.
* Implement and maintain database security best practices, including access controls, encryption, and compliance requirements.
* Regularly audit and assess database security configurations.
* Configure and manage database backup and recovery strategies to ensure data integrity and availability.
* Analyze database query performance and collaborate with developers to optimize SQL queries and schemas.
* Contribute to continuous improvement initiatives to enhance the reliability, scalability, and performance of cloud databases.
* Assist in designing and optimizing database schemas for cloud environments.

Required Skills:
* Strong experience with PostgreSQL and AWS
* Hands-on experience building ETL/ELT data pipelines
* Strong SQL scripting skills for querying and data manipulation
* Familiarity with Debezium, Kafka Connect, and ETL frameworks
* Basic understanding of Amazon Redshift and Amazon S3
* Exposure to Apache Spark for data processing
* Basic understanding of Apache Airflow for workflow orchestration
* Familiarity with scripting languages such as Python and Bash is a plus
* Knowledge of database security best practices, including access controls, encryption, and compliance requirements

Preferred Qualifications:
* AWS Certified Database – Specialty certification is a plus
* Experience with automation and infrastructure provisioning tools such as Terraform and Crossplane

Experience & Education:
* Bachelor’s degree in Computer Science, Information Technology, or a related field
* 5–8 years of experience in Data Engineering, with a strong focus on PostgreSQL

Thanks & Regards,
Maddula Venkateshwara Reddy | ICS Global Soft
Senior. US IT RECRUITER
venkatre...@gmail.com