onsite
Senior Data Platform Engineer - Fraud & Integration - DKB
Data Engineer
Lead the design and maintenance of a scalable data platform that powers fraud detection and integration services, leveraging Python, SQL, AWS, Spark, and Kafka to deliver real‑time insights and robust data pipelines.
About the role
Key Responsibilities
- Architect, develop, and maintain large‑scale data pipelines and lakehouse solutions on AWS, ensuring high availability and performance for fraud analytics.
- Implement real‑time data ingestion and processing using Spark and Kafka, translating business requirements into efficient ETL workflows.
- Collaborate with data scientists and product teams to expose clean, enriched datasets for machine‑learning models and reporting.
- Optimize query performance and storage costs through partitioning, indexing, and cost‑effective data lifecycle policies.
- Monitor, troubleshoot, and continuously improve pipeline reliability, implementing automated alerts and incident response procedures.
Requirements
- 5+ years of experience in data engineering, with a strong focus on cloud (AWS) and big‑data technologies.
- Deep understanding of data modeling, lakehouse architecture, and performance tuning in distributed environments.
- Experience with CI/CD for data workflows, monitoring, and observability tools.
- Strong analytical mindset, excellent communication skills, and a proactive approach to problem solving.