onsite
Senior Data Engineer / Architect - Ernsting's family
Data Engineer
Lead the design and implementation of scalable data architectures, integrating SAP and non‑SAP sources on Azure and Databricks, to empower advanced analytics and machine learning initiatives.
About the role
Key Responsibilities
- Architect and maintain end‑to‑end data pipelines from SAP BW, SAP Datasphere, and external sources to Azure Data Lake and Databricks workspaces.
- Collaborate with Data Scientists and Reporting Engineers to deliver high‑quality, production‑ready data products for advanced analytics and ML models.
- Design and enforce data governance, security, and compliance standards across the data platform.
- Optimize performance and cost of data processing workflows using Azure services and Databricks optimizations.
- Document architecture, data models, and best practices for internal stakeholders.
Requirements
- Extensive experience with SAP BW, SAP Datasphere, and integration to cloud platforms.
- Proficiency in Python, SQL, and big‑data processing frameworks (Databricks, Spark).
- Strong background in data modeling, ETL design, and data governance.
- Hands‑on experience with Microsoft Azure services (Data Factory, Synapse, ADLS).
- Excellent communication skills and ability to translate business needs into technical solutions.
Skills
pythonsqldatabricks