Hi,
Greetings!!
We have an Immediate opening for Remote: Databricks Engineer. Please go through the requirement and reply with your updated profile, contact details, and your availability if you would be interested in it.
Please send profiles to kish...@usgrpinc.com
Title: Databricks Engineer Location: Remote Duration: 6 to 12 months |
Job Description
· Designing and implementing highly performant data ingestion pipelines from multiple sources using Databricks on AWS
· Developing scalable and re-usable frameworks for ingesting large data sets and moving them from Bronze to silver and from Silver to Gold layer in databricks.
· Integrating the end to end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times
· Working with event based / streaming technologies to ingest and process data
· Proficient in writing Spark code in below languages: Scala, Python, and SQL
· Experience with cloud-based architectures in AWS, AZURE
· Experience in Big Data components such as Kafka, Spark SQL, Dataframes, HIVE DB
· Experience with databases and data warehousing
· Read and write data in AWS Databricks
· Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints
· Experience working with large scale data processing services (Hadoop)
Thanks & Regards
Krishna Kishore
United Software Group Inc..
6000 Venture Dr, Suite # C & D
Dublin, Ohio 43017
Phone: 614-495-9222 * 326 || 614-639-4387 (D)
Email: kish...@usgrpinc.com
Fax: 1-866-764-1148
To unsubscribe from this mailing, please click here UNSUBSCRIBE
______________________________________________________________________________________________________________________________________________________________________________________________________________________
USG is an Equal Opportunity Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, disability, military status, national origin or any other characteristic protected under federal, state, or applicable local law.