Title
: Senior
/lead Data Engineer
Location
: Eagan, MN(Need locals only)
Duration
: 3-6 months
Rate
: $ Open
Visa
Status
: GC, US Citizens, H4-EAD and H1B only
Relevant Experience: 10+
Years
Job Description
- What are they looking for:
- Dev Engineer capabilities (this is the core
of the role)
- App dev experience (scripting, especially in
python)
- Expert in AI or Automation (this would be a
huge plus)
- NOTE: they understand this might be a
unicorn, so these are listed in priority with 2 and 3 being bonuses
Skills
· Proficient
in data manipulation and pipeline development
· Experience
processing large datasets in a distributed environment
· Hands-on
experience with Databricks notebooks, workflows, and cluster management
· Moderate
hands-on experience with S3, Lambda, Glue, and EC2
· Experience
scheduling and automating pipelines
· Strong
SQL skills for complex data extraction and transformation queries
· Comfortable
with version control in a collaborative, shared-repo environment
· Comfortable
creating and managing issues and epics
Summary
· Modernize
data pipeline from SAS to Python/PySpark on Databricks.
o This Data
Engineer will own and evolve our critical HEDIS data pipeline.
§ HEDIS data is
delivered to our analytics vendor and used to measure BCBS’s performance across
key dimensions of care.
o This role will
initially partner with SMEs during a knowledge transfer
period. They will eventually take on pipeline ownership.
If you are comfortable for this position, please share me below details
with DL and Visa copy.
Candidate Details:
|
Full
Name
|
|
|
Current
Location
|
|
|
Skype
id
|
|
|
Contact
info Phone
|
|
|
Email
id
|
|
|
Last
4 digits of SSN
|
|
|
LinkedIn
id
|
|
|
Work
authorization/ Visa details
|
|
|
Education
and Year of Graduation
|
|
|
Relocation
(y/N)
|
|
|
Face
to Face interview ( Y/N)
|
|
Skill Matrix:
|
Skills
|
Years
of experience
|
Year
Last Used
|
|
|
|
|
|
|
|
|
Employer Details: