Role Name: Databricks Solution Architect
Work site: New York City, NY (Onsite)
Duration: 12+ Months
Rate: $75/hr to $80/hr on c2c (DOE)
Job Description:
• Strong Data Engineer with experience primarily on Databricks and secondary experience with Snowflake
• Design and implement scalable cloud data platforms using AWS, Databricks, and Snowflake.
• Build and optimize Lakehouse architectures leveraging Medallion (Bronze/Silver/Gold) patterns, Delta Lake, and modern data warehousing principles.
• Develop and maintain batch, streaming, and real-time data pipelines using Spark, PySpark, SQL, Airflow, Glue, and AWS services.
• Establish enterprise data governance through Unity Catalog, Snowflake Governance, metadata management, lineage, and data quality frameworks.
• Architect secure, scalable, and cost-efficient solutions across AWS services including S3, Lambda, Glue, MWAA, Kinesis, and IAM.
• Design semantic data models, curated data products, and reporting layers supporting Power BI, Tableau, Domo, and self-service analytics.
• Lead AI/GenAI initiatives utilizing Databricks Genie, Snowflake Cortex, Cortex Analyst, Cortex Search, Amazon Bedrock, OpenAI, and enterprise AI platforms.
• Implement RAG, vector search, AI agents, and conversational analytics solutions to improve business decision-making and productivity.
• Collaborate with business, product, engineering, and analytics teams to translate requirements into scalable technical solutions.
• Define architecture standards, best practices, and modernization roadmaps for enterprise data and AI platforms.
• Drive platform performance, reliability, observability, security, and FinOps optimization initiatives.
• Mentor engineers and architects while providing technical leadership for complex enterprise programs.
Regards
Divyansh
divy...@net2source.com