onsite
Databricks Data Engineer - Covetus, LLC
Data Engineer
Senior Databricks Data Engineer with 8‑10 years of experience designing, building, and optimizing scalable data pipelines and ETL workflows across AWS, Azure, and GCP, using Python and Spark to ensure data quality and governance.
About the role
Key Responsibilities
- Design, develop, and maintain large‑scale data pipelines on the Databricks Data Intelligence Platform.
- Write efficient, production‑grade Python and Spark code to transform and enrich data.
- Implement data quality checks, monitoring, and alerting to ensure pipeline reliability.
- Apply data governance best practices, including metadata management, lineage, and security controls across cloud environments.
- Collaborate with data scientists, analysts, and stakeholders to translate business requirements into technical solutions.
Requirements
- 8–10 years of experience in data engineering with a focus on big data technologies.
- Deep expertise in Databricks, Apache Spark, and Python.
- Hands‑on experience with cloud platforms (AWS, Azure, or GCP) and their data services.
- Strong understanding of ETL concepts, data modeling, and data governance frameworks.
- Excellent problem‑solving skills and ability to work independently in a fast‑paced environment.
Skills
databrickspythonawsazure