onsite
Data Management Engineer III - Deloitte
Software Engineer
Design, build, and maintain scalable data pipelines and integration solutions using Databricks and Spark, while ensuring data quality, governance, and cross‑functional collaboration.
About the role
Key Responsibilities
- Design, develop, test, and maintain robust data pipelines and integration workflows on the Databricks platform.
- Implement data modeling and schema design to support analytical and operational use cases.
- Collaborate with business and technology stakeholders to define data requirements, ensure data quality, and enforce governance standards.
- Optimize Spark jobs for performance, cost efficiency, and scalability in a cloud environment.
- Provide production support, troubleshoot pipeline failures, and continuously improve reliability and monitoring.
Requirements
- 3+ years of hands‑on data engineering experience, primarily with Databricks and Apache Spark.
- Proficiency in Python and SQL for data transformation and querying.
- Strong understanding of data modeling concepts and ETL best practices.
- Experience working in cloud platforms (AWS, Azure, or GCP) and implementing data security and governance controls.
- Ability to manage multiple priorities, communicate effectively with cross‑functional teams, and deliver solutions in a fast‑paced environment.
Skills
databricksapache sparkpythonsql