Looking for Databricks Admin

[N Chandu]

Hello There,

 

Below is the JD for Databricks Admin Role. Please source relevant resumes.

 

Role: Databricks Admin

Location: Atlanta, GA

Duration: Long Term

 

 

The JD is as follows :

·       Create Databricks workspace and assigned the user access using SCIM API

·       Estimate the cluster size, monitoring and troubleshooting of the Spark databricks cluster.

·       Create All purpose and Job clusters for respective job in lower lanes and production environments.

·       Define cluster policies which can be used for setting up the cluster

·       Creating pipelines, data flows and complex data transformations and manipulations using PySpark with Databricks.

·       Create, provision multiple Databricks clusters needed for batch and continuous streaming data processing and installed the required libraries for the clusters.

·       Create custom scripts for deploying the Databricks jobs from lower lanes to Production environment with appropriate tags.

·       Upgrade the Databricks runtime version for jobs

·       Develop Azure Databricks notebooks to apply the business transformations and perform data cleansing operations.

·       AWS Databricks experience

 

Full Name

E-Mail

Contact

Location

Relocation

Availability

Work Auth

Graduation Year

LinkedIn

Rate

Thanks & Regards,

 

Rao. A

Sr. Delivery Manager (IT)

Ra...@sysrs.com

Contact: 410-639-6697

SYSRS IT SERVICES

Office : 10632 Little Patuxent Parkway Suite # 256 Columbia, MD 21044