REQ:: Data Science Engineer _ Remote _12+ Months
Sam Thomas
Requirement Details:
Job Title: Data Science Engineer
Location: Remote
Duration: 12+ Months
Rate:$55/hr All Incl on C2C
Job Description:
Job Description:
We are looking for a data scientist/engineer who can help us integrate spark NLP pipelines into an existing database infrastructure. The successful candidate will have experience working with the Apache spark framework. You will work with a team to configure Apache spark environment and prototype spark NLP solutions using pretrained pipelines. The solutions will read data from SQL transactional systems or data warehouse, process it, and store the output. You will be involved in assessing the success and performance of the implemented solutions.
Key Qualifications
Overall 8 Years of IT Experience
3 – 5 years of experience as a data scientist or engineer.
3+ years proven ability in distributed data technologies e.g., Spark, Yarn, Hadoop, Hive, etc.
Best in class SQL experience. Ability to write sophisticated SQLs across platforms.
Proven hands - on experience in Python/PySpark/Scala and ability to manipulate data using Pandas, NumPy, Koalas etc.
Experience working as an architect to design distributed data platforms.
Working experience with Open- source orchestration tools i.e., Apache Airflow/ Azkaban etc.
Experience working with unstructured clinical data is a plus.
A teammate with excellent communication/collaboration skills when it comes to closely working with data scientists and machine learning engineers daily.
--