onsite
Senior Manager, Data Platform & Autonomy Infrastructure
Software Engineer
Lead the design, development, and operation of scalable data platforms and autonomous infrastructure, driving data modeling, pipeline orchestration, and cloud storage solutions for high‑performance analytics.
About the role
Key Responsibilities
- Architect and oversee end‑to‑end data platforms that support autonomous systems, ensuring reliability, scalability, and security.
- Lead a team of data engineers to design robust data models, build and maintain ETL/ELT pipelines, and implement real‑time streaming solutions.
- Drive the adoption of cloud services (AWS) and orchestration tools (Apache Airflow, Kubernetes) to automate data workflows and infrastructure provisioning.
- Collaborate with product, ML, and analytics stakeholders to translate business requirements into technical specifications and data solutions.
- Establish best practices for data governance, quality, and monitoring, and mentor engineers on modern data engineering techniques.
Requirements
- 5+ years of hands‑on experience in data engineering, data modeling, and building large‑scale data pipelines.
- Strong proficiency in Python and SQL, with experience using Apache Spark or similar distributed processing frameworks.
- Deep knowledge of cloud platforms (AWS) and infrastructure‑as‑code/orchestration tools such as Apache Airflow and Kubernetes.
- Proven leadership experience managing technical teams and delivering complex data platform projects.
- Excellent problem‑solving skills and ability to communicate technical concepts to cross‑functional audiences.
Skills
pythonsqlawsapache spark