onsite
Data Engineer Python - Immediate Join
Data Engineer
Seeking a Data Engineer proficient in Python to design, build, and maintain data pipelines using Apache Airflow and BigQuery, implement CI/CD workflows, develop APIs, and ensure high‑quality data through robust cleansing processes.
About the role
Key Responsibilities
- Design, develop, and maintain scalable data pipelines in Python using Apache Airflow.
- Integrate and optimize data storage and analytics workloads on Google BigQuery.
- Build and document RESTful APIs for internal and external data consumption.
- Implement CI/CD pipelines to automate testing, deployment, and monitoring of data workflows.
- Perform data profiling, validation, and cleansing to guarantee data accuracy and reliability.
- Collaborate with data scientists, analysts, and product teams to translate business requirements into technical solutions.
Requirements
- 3+ years of professional experience as a Data Engineer or similar role.
- Strong proficiency in Python and hands‑on experience with Apache Airflow orchestration.
- Deep knowledge of Google BigQuery, SQL, and data modeling concepts.
- Experience building CI/CD pipelines using tools such as GitLab CI, Jenkins, or GitHub Actions.
- Proven ability to develop, test, and maintain APIs and perform comprehensive data cleansing.