Urgent role Databricks admin with AWS Exp at East Brunswick, NJ
Rahul Pandey
Hello,
We have a long-term contract with our customer matching your skills. If you are interested, please send us your resume. If you are not interested, please forward this position to your contacts. We sincerely appreciate it.
Role: Databricks admin with AWS Exp
Location: East Brunswick, NJ
Local or near by state
Job Summary:
Need 8 + years of Databricks admin with AWS responsibilities who can manage Databricks environments on AWS, focusing on platform stability, performance optimization, and maintenance. They also integrate Databricks with other AWS services and use tools like Terraform to manage infrastructure. This role often involves provisioning accounts, tuning performance, and troubleshooting issues.
Key Responsibilities:
- Platform Management:
Oversee and maintain the Databricks environment on AWS, ensuring its stability and optimal performance.
- Integration:
Integrate Databricks with other AWS services like Redshift, Glue, and S3.
- Infrastructure Management:
Utilize Terraform to manage infrastructure related to Databricks, often automating the process.
- Account and User Management:
Manage Databricks accounts, including workspace creation, user provisioning, and access control.
- Security and Compliance:
Implement security measures and compliance practices within Databricks, including Unity Catalog for access control.
- Performance Optimization:
Conduct performance tuning and optimization of Databricks clusters and workloads.
- Troubleshooting:
Diagnose and resolve any issues or problems within the Databricks environment.
- Monitoring and Alerting:
Set up and monitor system metrics and alerts to ensure the platform's smooth operation.
- Data Governance:
Manage data governance within Databricks, including metadata management and access controls.
- Collaboration:
Work closely with data engineers, data scientists, and business stakeholders to support their needs.
Skills and Experience:
- Databricks Expertise: Proficiency in Databricks administration, including cluster management, workspace management, and user management.
- AWS Expertise: Strong knowledge of AWS services, especially those related to data and analytics (e.g., S3, Redshift, Glue, Lambda, SageMaker).
- Programming Skills: Experience with Python, Spark, and Scala for developing and managing big data applications.
- Infrastructure-as-Code: Familiarity with tools like Terraform for automating infrastructure deployment and management.
- Data Warehousing: Experience with data warehousing concepts and practices.
- Cloud Computing: Understanding of cloud computing principles and practices.
- Security and Compliance: Knowledge of security best practices and compliance requirements.
- Troubleshooting and Problem-Solving: Ability to diagnose and resolve technical issues related to Databricks and AWS.
Thanks & Warm Regards
Rahul Pandey | Senior Technical Recruiter|
Phone: | Direct : +1 (972)6361447 Ext : 467 |