Senior Data Engineer driving large‑scale data pipelines and AI solutions using Python, SQL, Spark, and AWS to enable enterprise‑level analytics and model deployment.
About the role
Key Responsibilities
Design, develop, and maintain scalable data pipelines for structured and unstructured data using Python, SQL, and Apache Spark.
Implement and optimize data lake architectures on AWS, ensuring data quality, lineage, and security.
Collaborate with data scientists to ingest, transform, and serve data for machine‑learning models and AI applications.
Monitor pipeline performance, troubleshoot issues, and continuously improve throughput and reliability.
Document data models, pipeline logic, and best practices for cross‑functional teams.
Requirements
5+ years of experience in data engineering with a strong focus on big‑data technologies.