onsite
Senior Data Engineer - Actalent
Data Engineer
Lead data engineering for connected vehicle platforms, transforming large-scale interaction data into actionable insights using Python, Spark, and AWS to enhance in‑car entertainment, navigation, and connectivity experiences.
About the role
Key Responsibilities
- Design, build, and maintain scalable data pipelines ingesting millions of events from connected vehicles.
- Transform raw interaction data into structured datasets for analytics, using Python, SQL, and Apache Spark.
- Collaborate with product managers and engineers to define data models that support real‑time dashboards and machine‑learning initiatives.
- Optimize ETL workflows on AWS (Glue, Redshift, S3) to reduce latency and cost.
- Ensure data quality, governance, and compliance across all data assets.
Requirements
- 5+ years of data engineering experience in a large‑scale, cloud‑native environment.
- Proficiency in Python, SQL, and Spark for data processing.
- Hands‑on experience with AWS services (Glue, Redshift, S3, EMR).
- Strong understanding of data modeling, ETL design, and performance tuning.
- Excellent communication skills and ability to work cross‑functionally with product and engineering teams.
Skills
pythonsqlapache sparkaws