remote
Senior AI Data Engineer - SAP
Data Engineer
Senior AI Data Engineer responsible for designing, building, and operationalizing AI‑driven data pipelines on Azure, leveraging Python, Spark, and advanced data modeling to support SAP RPT model family initiatives.
About the role
Key Responsibilities
- Design and implement scalable data pipelines for AI/ML workloads using Python, Apache Spark, and Azure Data Factory.
- Develop and maintain data models that feed the SAP RPT model family, ensuring high data quality and performance.
- Collaborate with data scientists and product owners to translate business requirements into robust data solutions.
- Optimize data storage and processing on Azure Synapse and Azure Data Lake, applying best practices for security and cost efficiency.
- Monitor, troubleshoot, and continuously improve ETL processes and production workloads.
Requirements
- 5+ years of experience in data engineering, with strong proficiency in Python, SQL, and Apache Spark.
- Hands‑on experience with Azure data services (Data Factory, Synapse, Data Lake) and cloud‑based data architectures.
- Solid understanding of data modeling, data warehousing, and ETL design patterns.
- Experience supporting machine‑learning pipelines and deploying models in production.
- Excellent problem‑solving skills and ability to work cross‑functionally in an agile environment.
Skills
pythonsqlapache sparkmachine learning