onsite
Senior Data Engineer GCP
Data Engineer
Lead end‑to‑end data pipeline development on Google Cloud, architecting scalable solutions with BigQuery, Airflow, and Cloud Composer while implementing robust CI/CD practices.
About the role
Key Responsibilities
- Design, build, and maintain large‑scale data pipelines on GCP, leveraging BigQuery for analytics and storage.
- Develop and schedule workflows using Apache Airflow and Cloud Composer, ensuring reliability and scalability.
- Implement CI/CD pipelines for data workflows, automating deployment, testing, and monitoring.
- Collaborate with data scientists and analysts to translate business requirements into technical solutions.
- Optimize query performance, manage data partitioning, and enforce data governance policies.
Requirements
- 5+ years of experience in data engineering with a focus on GCP services.
- Hands‑on experience with Apache Airflow, Cloud Composer, and BigQuery.
- Strong understanding of CI/CD principles and tools (e.g., Git, Jenkins, Cloud Build).
- Excellent problem‑solving skills and ability to work in a fast‑paced environment.