remote
Senior Data Engineer Databricks - Qode
Data Engineer
Senior Data Engineer specializing in Databricks and Spark to design, build, and optimize enterprise data pipelines, data warehouses, and BI solutions on cloud platforms.
About the role
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark.
- Build and optimize data warehouses and dimensional models to support reporting and analytics.
- Implement ETL/ELT processes in Python and SQL, ensuring data quality and performance.
- Collaborate with data scientists, analysts, and business stakeholders to translate requirements into robust data solutions.
- Deploy and monitor data workloads on cloud platforms (e.g., Azure, AWS) using CI/CD best practices.
- Provide technical guidance and mentorship to junior engineers.
Requirements
- 8+ years of experience in data engineering, software development, and enterprise data solutions.
- Deep expertise with Databricks, Apache Spark, Python, and SQL.
- Strong background in data modeling, data warehousing, and BI design.
- Hands‑on experience with cloud services (Azure or AWS) and infrastructure‑as‑code/CI‑CD pipelines.
- BS in Computer Science or related field, or equivalent technical experience.
Skills
databricksapache sparkpythonsql