Re: Senior Data Engineer - Boston, MA Need locals only - 12 Months

[pshanthi .]

Client                                     : Perficient

Title                                       : Senior Data Engineer

Location                               : Boston, MA Need locals only

Duration                              : 12 Months

Rate                                       : $Open

Visa Status                          : Any work Status 

Relevant Experience: 8 Years

 Duties and Responsibilities:

• Design, develop, and maintain scalable data pipelines using Azure Data Factory, Databricks, and SQL Server (T-SQL).
• Implement configuration-driven ingestion processes for batch and near real-time data.
• Ingest, transform, and integrate data from diverse sources (APIs, JSON, CSV, XLS, etc.) using industry best practices.
• Analyze, design, and document data models (ERDs), create data dictionaries and data flow diagrams as part of pipeline development.
• Design and implement Lakehouse solutions leveraging Medallion architecture.
• Develop and maintain SSRS and Power BI datasets and reports.
• Oversee the health, scalability, and security of the Azure-based data platform.
• Support and enhance data governance, cataloging, and MDM initiatives.
• Ensure data security, privacy, and compliance best practices are followed.
• Manage access controls, data lineage, and metadata to support data discoverability and compliance.
• Continuously evaluate and improve data engineering processes for efficiency, automation, and reliability.
• Develop and maintain CI/CD pipelines using GitHub Actions or CircleCI.
• Implement and refine monitoring, alerting, and observability for data pipelines and platform health.
• Collaborate with cross-functional teams to identify and eliminate process bottlenecks.
• Optimize data pipelines and platform components for performance, scalability, and cost-effectiveness.
• Evaluate and implement data quality and observability tools to ensure data reliability and accessibility.
• Work closely with the data product manager, program manager, engineering manager, and scrum master to define and deliver data products based on priorities.
• Participate in sprint planning, backlog refinement, and Agile ceremonies.
• Collaborate with offshore and cross-functional teams to deliver high-quality solutions.
• Refine user stories and requirements to ensure clarity and actionability.
• Participate in new teammate onboarding, provide guidance and mentorship to junior engineers and facilitate regular feedback sessions, career development planning, and technical upskilling.
• Stay current with industry trends, emerging technologies, and best practices in data engineering.

 

 Qualifications, Skills and Experience:

• 7+ years of professional experience in data engineering and BI, with a focus on Azure technologies.
• Deep expertise in SQL Server (2016+), Azure Data Factory, Databricks, and NoSQL databases.
• Strong experience in ingesting and integrating data from APIs, JSON, XML, CSV, XLS, and other formats.
• Experience with configuration-driven data ingestion and transformation processes.
• Strong understanding of Lakehouse architecture, data warehousing concepts, and dimensional modeling.
• Experience with Power BI, SSRS, and/or Microsoft Fabric for reporting and analytics.
• Hands-on experience with CI/CD tools (ADO/GitHub Actions/CircleCI) and DataOps practices.
• Familiarity with data quality, data observability, data governance, cataloging, and MDM tools.
• Proficient in Agile methodologies; experience with Scrum ceremonies, sprint planning, and backlog management, burndown metrics, and incremental delivery.

** Out of all that detailed job description, please keep the following most important points in view while sourcing:

·       Needs to be on-site 4 days of the week (Boston)

·       Leaning more towards Data Engineering; they have received multiple Data Analysts and DBAs who don’t fit the Data Engineering criteria. Data Engineering is the day to day for this profile.

o   We’re looking for people with experience on Data Warehouse, Lakehouse, Medallion Architecture, Observability, Quality Checks, Data Catalogs

·       Acceptable AWS experience in lieu of Azure; the person will need to learn Azure fast

·       Python is expected; is not listed in the job description but they use Python as a 1st class citizen language within their team

·       Person character is a MUST. They’re looking for a very pro-active, extroverted person. Even though is a Sr. position, expectations this person to mentor more Jr. people

especially as the person settles into his day to day.

·       Databricks / Snowflake knowledge is a plus. They are currently evaluating platform modernization, and 50% of the candidate’s job would be to support current platform in MS Fabric, and 50% on helping lead the way towards that newer platform – for which this experience with Databricks / Snowflake could come in handy.

If you are comfortable for this position, please share me below details with DL and Visa copy.

Candidate Details:

Full Name
Current  Location
Skype id
Contact info Phone
Email id
Last 4 digits of SSN
LinkedIn id
Work authorization/ Visa details
Education and Year of Graduation
Relocation (y/N)
Face to Face interview ( Y/N)

 

Skill Matrix:

Skills	Years of experience	Year Last Used

Employer Details:

Regards,

 Shanthi Pedhiredla

SOVEREIGN TECHNOLOGIES LLC

psha...@sovereigntec.com

http://www.sovereigntec.com

Certified Minority Owned Business ( MBE)