onsite
Junior Data Engineer - Cumming Group
Data Engineer
Entry‑level data engineer building and maintaining data pipelines on Azure Databricks, leveraging Python, SQL and Spark to support a modern lakehouse architecture.
About the role
Key Responsibilities
- Design, develop, and maintain data pipelines using Azure Databricks and Spark.
- Write efficient Python and SQL scripts to extract, transform, and load data from diverse sources.
- Collaborate with data scientists and analysts to ensure data quality and accessibility.
- Monitor pipeline performance, troubleshoot issues, and implement optimizations.
- Document data workflows and contribute to the data platform’s best‑practice guidelines.
Requirements
- Strong foundation in Python programming and SQL querying.
- Experience with Spark and Azure Databricks or similar big‑data platforms.
- Understanding of ETL concepts and data pipeline architecture.
- Excellent problem‑solving skills and attention to detail.
- Effective communication and teamwork abilities.