onsite
Senior Data Architect / Data Engineer - Trianel GmbH
Data Engineer
Design and implement scalable data platforms for energy trading, leading architecture decisions and building robust ETL pipelines using Python, Spark, Kafka and AWS services.
About the role
Key Responsibilities
- Design and evolve the end‑to‑end data architecture for the energy trading platform, ensuring scalability, reliability and performance.
- Develop, test and maintain high‑throughput data pipelines using Python, Apache Spark and Kafka to ingest, transform and store large volumes of market data.
- Implement cloud‑native solutions on AWS (e.g., S3, Redshift, Glue, Lambda) and manage infrastructure as code.
- Collaborate with data scientists, traders and IT teams to translate business requirements into robust data models and ETL processes.
- Establish best practices for data governance, quality monitoring and documentation across the data ecosystem.
Requirements
- 5+ years of experience in data architecture or engineering, preferably in the energy or financial services domain.
- Strong proficiency in Python and SQL, with hands‑on experience building pipelines in Apache Spark and Kafka.
- Deep knowledge of AWS data services and cloud‑based data warehousing solutions.
- Expertise in data modeling, ETL design, and performance optimization for large‑scale datasets.
- Excellent problem‑solving skills and ability to work autonomously in a fast‑paced, cross‑functional environment.
Skills
pythonsqlapache sparkkafkaaws