remote
Senior Specialist - Data Engineering - LTIMindtree
Software Engineer
Senior Specialist in Data Engineering with 7‑11 years of Python and Spark expertise, designing and maintaining scalable data pipelines and analytics solutions to power business intelligence.
About the role
Key Responsibilities
- Design, develop, and optimize Python applications for large‑scale data processing using Spark.
- Build and maintain robust, scalable data pipelines that automate workflows and support real‑time analytics.
- Collaborate with cross‑functional teams to integrate Python‑based solutions into existing data infrastructure.
- Ensure code quality, performance, and maintainability through best practices, code reviews, and automated testing.
- Document architecture, data flows, and operational procedures for future reference and compliance.
Requirements
- 7–11 years of professional experience in Python development with a focus on data engineering.
- Strong proficiency in Spark (PySpark) and experience building distributed data pipelines.
- Hands‑on experience with data warehousing, ETL processes, and data quality assurance.
- Excellent problem‑solving skills and ability to translate business requirements into technical solutions.
- Effective communication skills and a collaborative mindset for working with cross‑functional teams.