onsite
Senior Data Engineer - Aita Consulting Services,Inc.
Data Engineer
Lead the design and implementation of scalable data pipelines and models using Python, SQL, AWS services, DBT, and Iceberg, driving high-performance data solutions for a fast-growing ecosystem.
About the role
Key Responsibilities
- Design, develop, and maintain end‑to‑end data pipelines on AWS (S3, Lambda, SNS, SQS) using Python and SQL.
- Build and evolve conceptual, logical, and physical data models, ensuring alignment with business requirements.
- Implement table structures and transformations in DBT, optimizing for performance and reliability.
- Collaborate closely with data scientists, analysts, and cross‑functional teams to deliver actionable insights.
- Leverage Iceberg for scalable, ACID‑compliant table management and support large‑scale analytics workloads.
- Continuously improve pipeline monitoring, documentation, and best‑practice guidelines.
Requirements
- 5+ years of experience in data engineering, with a strong focus on cloud‑native architectures.
- Proficiency in Python, SQL, and modern data modeling techniques.
- Hands‑on experience with AWS services (S3, Lambda, SNS, SQS) and data lake technologies.
- Deep knowledge of DBT and Iceberg for data transformation and table management.
- Excellent communication skills and a collaborative mindset.