onsite
Senior Data Engineer Python, AWS, Airflow, Terraform - Capgemini
Data Engineer
Senior Data Engineer responsible for designing, building, and operating cloud‑native REST APIs and data pipelines using Python, AWS services, Airflow, and Terraform, while ensuring robust monitoring, logging, and CI/CD practices.
About the role
Key Responsibilities
- Design, develop, and maintain high‑performance, secure REST APIs on AWS using Python, API Gateway, and Lambda.
- Build and orchestrate data pipelines with Airflow and AWS Glue to support data modernization initiatives.
- Implement infrastructure as code with Terraform and manage CI/CD pipelines for automated deployment.
- Provide production support, including monitoring, logging, root‑cause analysis, and incident resolution.
- Collaborate with cross‑functional teams to define API contracts, ensure data quality, and drive continuous improvement.
Requirements
- 5+ years of professional experience in Python development and cloud‑native API design.
- Strong hands‑on expertise with AWS services such as Lambda, API Gateway, and Glue.
- Proficiency in Airflow workflow orchestration and Terraform infrastructure provisioning.
- Experience implementing CI/CD pipelines and DevOps best practices.
- Excellent problem‑solving, root‑cause analysis, and communication skills.
Skills
pythonairflowterraformcicdrest api