remote
POD/SVS Engineering Lead / Associate Director, Data and Analytics Specialist
Software Engineer
Lead a high‑performing data engineering team, designing and maintaining scalable data pipelines with Apache Airflow and Spark, while ensuring robust API integrations and automated monitoring across BigQuery environments.
About the role
Key Responsibilities
- Architect, develop, and optimize large‑scale data pipelines using Apache Airflow and Apache Spark to support analytics and reporting needs.
- Design and expose data services through well‑documented APIs, ensuring secure, high‑throughput access for internal and external stakeholders.
- Implement automated monitoring, alerting, and incident response workflows to maintain data quality and system reliability.
- Collaborate with cross‑functional teams to translate business requirements into technical specifications and deliver actionable insights via BigQuery.
- Mentor and grow a team of data engineers, fostering best practices in coding, testing, and documentation.
Requirements
- 5+ years of experience in data engineering, with a strong focus on Airflow, Spark, and BigQuery.
- Proven track record of designing and deploying production‑grade APIs and automated monitoring solutions.
- Excellent problem‑solving skills and ability to work in a fast‑paced, collaborative environment.
- Strong communication skills, capable of translating complex technical concepts to non‑technical stakeholders.