remote
Lead Engineer - Data & AI - Quest Global
Software Engineer
Lead Data & AI Engineer driving end‑to‑end data pipelines, advanced analytics, and ML model deployment on AWS. Own architecture, data quality, and cross‑functional collaboration to deliver high‑impact AI solutions.
About the role
Key Responsibilities
- Design, build, and maintain scalable data pipelines using Python, SQL, and Apache Spark on AWS.
- Develop and deploy production‑ready machine learning models, ensuring reproducibility and performance.
- Collaborate with data scientists, product managers, and stakeholders to translate business needs into technical solutions.
- Implement data governance, security, and compliance best practices across the data platform.
- Mentor and lead a small team of engineers, fostering a culture of continuous improvement and knowledge sharing.
Requirements
- 5+ years of experience in data engineering and AI/ML development.
- Proficiency in Python, SQL, and Spark for large‑scale data processing.
- Hands‑on experience with AWS services (S3, Redshift, EMR, SageMaker).
- Strong understanding of data modeling, ETL, and data lake architecture.
- Excellent communication skills and a proven ability to lead technical initiatives.
Skills
pythonsqlapache sparkawsmachine learning