remote
Principal - Data Engineering - LTIMindtree
Software Engineer
Lead the design and optimization of scalable data pipelines using SQL, Python, Spark, and Hadoop within Palantir Foundry, driving high-performance analytics and cross‑functional collaboration.
About the role
Key Responsibilities
- Architect and implement end‑to‑end data pipelines in Palantir Foundry, ensuring scalability, reliability, and performance.
- Write and optimize complex SQL queries and Python/Spark code for large‑scale data transformations.
- Integrate TypeScript components for data processing and application development within the Foundry ecosystem.
- Collaborate with product, analytics, and offshore teams to translate business requirements into robust data solutions.
- Monitor, troubleshoot, and tune data workflows, leveraging Hadoop and other distributed storage technologies.
- Document architecture, best practices, and maintain code quality standards across the data engineering team.
Requirements
- 5+ years of experience in data engineering with a strong focus on SQL, Python, and Spark.
- Proven expertise in Hadoop ecosystems and distributed data processing.
- Hands‑on experience with Palantir Foundry modules and data pipeline orchestration.
- Solid understanding of TypeScript for building data‑centric applications.
- Excellent problem‑solving skills and ability to work collaboratively in a cross‑functional environment.
Skills
sqlpythonhadooptypescript