onsite
Senior Data Engineer - baramundi software GmbH
Data Engineer
Senior Data Engineer responsible for designing, building, and optimizing data pipelines and warehouse solutions on cloud platforms, leveraging Python, SQL, and Spark to enable advanced analytics and business intelligence.
About the role
Key Responsibilities
- Design, develop, and maintain scalable ETL pipelines to ingest and transform data from diverse sources.
- Build and optimize data warehouse schemas and models to support reporting and analytics.
- Implement data processing workflows using Apache Spark and Python for high‑performance batch and streaming jobs.
- Collaborate with product, analytics, and DevOps teams to integrate data solutions into cloud‑native services (AWS).
- Ensure data quality, reliability, and security through testing, monitoring, and documentation.
Requirements
- 5+ years of professional experience in data engineering or related fields.
- Strong proficiency in Python and advanced SQL for data manipulation.
- Hands‑on experience with data warehousing concepts, ETL tools, and cloud platforms (AWS preferred).
- Solid knowledge of Apache Spark (or similar big‑data processing frameworks) and streaming technologies.
- Ability to work autonomously in an agile environment and communicate complex technical concepts clearly.
Skills
pythonsqlapache spark