remote
Databricks Developer / Data Architect - EXL Service
Software Engineer
Lead the design and optimization of cloud-native data platforms, building scalable ETL pipelines and Lakehouse solutions on Databricks across Azure and AWS environments.
About the role
Key Responsibilities
- Design, develop, and maintain Databricks workspaces and Lakehouse architectures for enterprise data solutions.
- Build and optimize scalable ETL pipelines using Spark, Delta Lake, and Medallion Architecture principles.
- Integrate data from diverse sources, ensuring data quality, lineage, and governance across Azure and AWS cloud services.
- Collaborate with data scientists, analysts, and business stakeholders to translate requirements into robust data models and dashboards.
- Implement performance tuning, monitoring, and cost‑management strategies for cloud data workloads.
Requirements
- 5+ years of experience in data engineering with a focus on Databricks and Spark.
- Proven expertise in Lakehouse design, Delta Lake, and Medallion Architecture.
- Strong knowledge of Azure Data Factory, Azure Synapse, AWS Glue, and related cloud services.
- Hands‑on experience with SQL, Python, and Scala for data processing.
- Excellent problem‑solving skills and ability to work in a fast‑paced, collaborative environment.