onsite
Databricks Expert - Halbauer GmbH
Software Engineer
Lead data engineering initiatives in banking, leveraging Databricks and Spark to build scalable pipelines, optimize SQL queries, and deliver insights with Python. Requires deep technical expertise and German C‑level communication skills.
About the role
Key Responsibilities
- Design, develop, and maintain end‑to‑end data pipelines on Databricks using Spark and Python.
- Optimize SQL queries and Spark jobs for performance and cost efficiency.
- Collaborate with data scientists and business stakeholders to translate requirements into scalable solutions.
- Implement data quality checks, monitoring, and alerting across the data platform.
- Document architecture, processes, and best practices for the engineering team.
Requirements
- Minimum 2 years of hands‑on experience with Databricks and Apache Spark.
- Strong proficiency in Python and SQL; experience with Scala is a plus.
- Solid understanding of data engineering concepts, ETL, and lakehouse architecture.
- Excellent German communication skills at C‑level; English is a plus.
- Proactive problem‑solving attitude and ability to work in a fast‑paced banking environment.
Skills
databricksapache sparkpythonsql