onsite
Application & Data Engineer - Traffic Data Management - BAV Dienstsitz Aurich
Data Engineer
Lead the design, development, and maintenance of scalable data pipelines for traffic data, leveraging Python, SQL, and Big Data technologies to deliver actionable insights for transportation management.
About the role
Key Responsibilities
- Design, implement, and optimize ETL pipelines for large-scale traffic datasets using Python, SQL, and Apache Spark.
- Develop and maintain data models and schemas to support real-time analytics and reporting.
- Integrate GIS data sources and perform spatial analysis to enhance traffic flow insights.
- Collaborate with cross-functional teams to define data requirements and deliver actionable dashboards.
- Ensure data quality, consistency, and compliance with regulatory standards.
Requirements
- Bachelor’s or FH-Diplom in Computer Science, Data Engineering, or related field.
- Proven experience with Python, SQL, and Big Data frameworks (Spark, Hadoop).
- Strong knowledge of ETL processes, data modeling, and workflow orchestration (Airflow).
- Experience with GIS technologies and spatial data analysis.
- Excellent problem‑solving skills and ability to work independently in a dynamic environment.
Skills
pythonsqlapache sparkairflow