Hiring : Palantir Foundry Lead Data Engineer : 100% Remote

[Aditya Jain]

Hi,

We have a high-priority opening for a Foundry Lead Data Engineer

Please share your resume if you are interested

 

Foundry Lead Data Engineer

• Job Title: Foundry Lead Data Engineer (Pyspark ,Palantir Foundry)
• Location: 100% Remote 
• Client: Cognizant / PG&E
• Experience Required: 10 – 14 Years
• Request ID: 53157-1

 

Job Summary

We are seeking a Foundry Lead Data Engineer to design and deploy high-scale data architectures within the Palantir Foundry ecosystem. This role is critical for optimizing data processing workflows using PySpark and integrating complex data models to support utility-scale business intelligence. You will act as a technical lead, collaborating with cross-functional teams at PG&E to build robust pipelines, ensure data security, and mentor junior engineers while driving innovation in grid and operational analytics.

 

Key Responsibilities & Required Skills

Palantir Foundry Architecture

• Solution Integration: Design and implement end-to-end data solutions within Palantir Foundry, ensuring seamless integration with existing utility enterprise systems.
• Ontology Development: Develop and maintain robust data models and ontologies that serve as the foundation for strategic decision-making and advanced analytics.
• Work Model Deployment: Oversee the deployment of Palantir Work Model solutions, maintaining high availability and reliability for mission-critical grid data.

Data Engineering & Optimization

• PySpark Development: Design scalable data processing architectures using PySpark to handle massive datasets and reduce processing latency.
• Pipeline Tuning: Continuously monitor and optimize data pipelines to improve performance, ensuring efficient data flow from raw ingestion to final insights.
• Security & Compliance: Implement rigorous data security protocols and industry compliance standards to safeguard sensitive utility information.

Leadership & Strategic Innovation

• Technical Mentorship: Provide guidance to junior team members, conducting code reviews and fostering a culture of technical excellence.
• Stakeholder Collaboration: Partner with business stakeholders to define project requirements and deliver technology solutions that align with PG&E’s operational goals.
• Emerging Tech: Evaluate new tools and features within the Palantir and Spark ecosystems to recommend architectural enhancements.

 

Mandatory Technical Requirements

1. Core Stack: Extensive hands-on experience with Palantir Foundry and Palantir platforms.
2. Programming: Expert proficiency in PySpark for complex data transformation and analysis.
3. Experience: 10–14 years of professional experience in data architecture and solution design.
4. Modeling: Proven expertise in developing scalable data models and enterprise-level data architectures.
5. Education: Bachelor’s degree in Computer Science or IT (Master’s degree preferred).

 

 

 

Thanks,

_______________________________________

Aditya Jain | New York Technology Partners

120 Wood Avenue S | Suite 504 | Iselin NJ 08830

Email: adity...@nytpcorp.com 

LinkedIn | www.nytp.com

 

We respect your online privacy. If you would like to be removed from our mailing list please reply with "Remove" in the subject and we will comply immediately. We apologize for any inconvenience caused. Please let us know if you have more than one domain. The material in this e-mail is intended only for the use of the individual to whom it is addressed and may contain information that is confidential, privileged, and exempt from disclosure under applicable law. If you are not the intended recipient, be advised that the unauthorized use, disclosure, copying, distribution, or the taking of any action in reliance on this information is strictly prohibited.