onsite
Senior Data Engineer - Databricks & Cloud - Bank 11
Data Engineer
Lead end‑to‑end data pipelines on Databricks, architect cloud‑native solutions, and drive data quality and performance for a leading financial institution.
About the role
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark on cloud platforms.
- Implement data ingestion, transformation, and orchestration workflows with Python, SQL, and Delta Lake.
- Collaborate with data scientists and business analysts to deliver high‑quality data assets and dashboards.
- Ensure data governance, security, and compliance across all data assets.
- Optimize performance and cost of cloud data workloads, and troubleshoot production issues.
Requirements
- 5+ years of experience in data engineering, with deep expertise in Databricks and Spark.
- Proficient in Python, SQL, and cloud services (AWS, Azure, or GCP).
- Strong understanding of data modeling, ETL best practices, and data lake architecture.
- Experience with Delta Lake, Lakehouse patterns, and data quality frameworks.
- Excellent problem‑solving skills and a collaborative mindset.
Skills
databricksapache sparkpythonsql