ONLY CANADIANS -Data/Scala/Spark Engineering Specialist Montreal, QC
subhani mohammed
Morgan Stanley - Looking for Data/Scala/Spark Engineering Specialist with expertise in Snowflake.
Position: Data/Scala/Spark Engineering Specialist
Location: Montreal, QC
Duration; 12 Months
In-person Interview
We're migrating complex on-prem regulatory reporting pipelines from a legacy ETL + Autosys + SQL + Teradata stack to a modern Databricks + Snowflake platform on Azure. The role is hands-on: design, implement, test, and reconcile production pipelines feeding regulatory reports under strict parity requirements.
Must-have
=========
Scala / Spark — production experience writing Spark applications in Scala (not
just notebooks); comfortable with the DataFrame API, joins, window functions,
partitioning, and performance tuning
Databricks — Serverless compute, Unity Catalog, Asset Bundles, Databricks CLI
SQL fluency — confortable writing, analyzing and extracting requirements from
complex SQL scripts
Snowflake — schema design, performance, Spark-Snowflake connector
Azure — ADLS, networking basics, secrets/identity (Entra ID / managed
identities)
Orchestration — Airflow (DAG authoring, sensors, retries, SLAs)
CI/CD — Artifactory, GitHub Actions pipelines: build, sharded test matrices,
artifact promotion through dev → QA → UAT → prod
Testing — Experience in TDD,
writing unit tests (ScalaTest, AnyFlatSpec) and BDD (Concordion or equivalent)
Data quality & reconciliation —
building automated parity checks against legacy outputs, drift detection,
row-level reconciliation tooling
Large-scale migrations — proven track record migrating legacy ETL
(Autosys/Informatica/etc.) to cloud data platforms, including dependency
mapping and cutover planning
Modern data engineering practices — medallion architecture (Bronze/Silver/Gold),
idempotent pipelines, schema evolution, lineage, observability
Nice-to-have
============
Financial services / regulatory reporting domain
Python (Databricks utilities, tooling)
Spec-driven development workflows (specs → plans → tasks → implementation)
Gradle (composite builds) and JVM tooling
Thanks & Regards,
Subhani (VP-Deliveries $ Client Acquistions)
Direct: (682) 342-2229
whatsapp:9603890800
Email: Sub...@a1resourcing.com
A1 Resourcing Inc
Our Name Reflects Our Work
A1 RESOURCING INC is committed to responsible email communication and firmly opposes unsolicited emails ("spam"). If you have received this message in error or no longer wish to receive emails from us, we sincerely apologize for any inconvenience caused. To unsubscribe, please reply with “REMOVE” in the subject line and include any email addresses you would like removed from our list.