onsite
Senior Data Engineering Specialist
Software Engineer
Senior Data Engineering Specialist responsible for designing, building, and maintaining scalable data pipelines using Airflow, BigQuery, and Cloud Functions, with a strong focus on CI/CD automation and robust data modeling.
About the role
Key Responsibilities
- Design, develop, and optimize end‑to‑end data pipelines on Google Cloud Platform using Apache Airflow and BigQuery.
- Implement CI/CD workflows to automate deployment, testing, and monitoring of data pipelines and Cloud Functions.
- Write production‑grade Python and SQL code for data extraction, transformation, and loading (ETL) processes.
- Collaborate with data analysts, scientists, and product teams to translate business requirements into scalable data solutions.
- Monitor pipeline performance, troubleshoot failures, and ensure data quality and reliability.
Requirements
- 5+ years of hands‑on experience in data engineering, preferably in a cloud‑native environment.
- Deep expertise with Apache Airflow, Google BigQuery, and Google Cloud Functions.
- Proficiency in Python and SQL for building robust ETL workflows.
- Strong background in CI/CD practices and tools (e.g., GitHub Actions, Cloud Build, Jenkins).
- Excellent problem‑solving skills and ability to work in an Agile, collaborative team setting.