onsite
Staff Data Engineer AWS Cloud & AI
Data Engineer
Senior data engineer leading design and implementation of scalable data pipelines on AWS, leveraging CloudFormation, API Gateway, Glue, Lake Formation, and DataZone to enable AI‑ready data platforms.
About the role
Key Responsibilities
- Architect, build, and maintain end‑to‑end data pipelines on AWS, ensuring high performance, reliability, and security.
- Design infrastructure as code using AWS CloudFormation to provision and manage data services at scale.
- Integrate API Gateway with data ingestion services, enabling real‑time data flow for downstream AI models.
- Implement data cataloging, governance, and access control with AWS Lake Formation and DataZone.
- Develop ETL/ELT processes using AWS Glue, optimizing transformations for large‑volume datasets.
- Collaborate with data scientists and analytics teams to deliver AI‑ready data sets and support model deployment.
Requirements
- 5+ years of professional experience in data engineering, with deep expertise in AWS data services.
- Proven ability to write and maintain CloudFormation templates and automate infrastructure deployments.
- Strong knowledge of data lake architecture, data cataloging, and governance using Lake Formation and DataZone.
- Hands‑on experience building ETL pipelines with AWS Glue and integrating APIs via API Gateway.
- Solid understanding of security best practices, IAM, and networking within AWS environments.