onsite
Senior Software Engineer - Mahindra & Mahindra Ltd
Software Engineer
Lead the design and implementation of large‑scale data pipelines using Pyspark and Databricks, while delivering interactive analytics with Power BI and advancing ML models in TensorFlow. Drive end‑to‑end solutions for automotive data at scale.
About the role
Key Responsibilities
- Architect and develop high‑performance data pipelines in Pyspark on Databricks for automotive telemetry and sensor data.
- Build and maintain interactive dashboards in Power BI to provide actionable insights to business stakeholders.
- Design and prototype machine learning models using TensorFlow, integrating them into production workflows.
- Collaborate with data engineers to optimize Spark jobs, ensuring scalability and cost efficiency.
- Document data architecture, pipeline logic, and best practices for future maintainability.
Requirements
- 2–5 years of experience in big data engineering with proven expertise in Pyspark and Databricks.
- Strong command of Spark, SQL, and data modeling concepts.
- Hands‑on experience with Power BI and visual analytics.
- Familiarity with TensorFlow for building and deploying ML models.
- Excellent problem‑solving skills and ability to work cross‑functionally in a fast‑paced environment.
Skills
databrickspower bitensorflow