remote
AI Data Engineer - BV Teck
Data Engineer
Lead the design and implementation of AI‑driven data pipelines, leveraging Python, Spark, and AWS to deliver scalable, secure solutions that power intelligent business automation.
About the role
Key Responsibilities
- Design, develop, and maintain end‑to‑end data pipelines for AI and analytics workloads using Python and Apache Spark.
- Implement robust ETL processes, ensuring data quality, lineage, and compliance across cloud and on‑prem environments.
- Collaborate with data scientists to deploy machine‑learning models into production, optimizing for performance and scalability.
- Manage and monitor data infrastructure on AWS (S3, Redshift, Glue, EMR), applying best practices for security and cost efficiency.
- Document architecture, data flows, and operational procedures for cross‑functional teams.
Requirements
- 5+ years of experience in data engineering, with a strong focus on AI/ML pipelines.
- Proficiency in Python, SQL, and Spark; experience with AWS data services.
- Solid understanding of data modeling, ETL design, and data governance.
- Hands‑on experience deploying ML models and monitoring their performance.
- Excellent problem‑solving skills and ability to work collaboratively in a fast‑paced environment.
Skills
pythonsqlapache sparkawsmachine learning