onsite
Data Bricks Infra Engineer - EXL Service
Software Engineer
Senior Data Bricks Infra Engineer responsible for designing secure connectors, configuring MCP servers, and optimizing data pipelines between Databricks workspaces and LLM applications using Delta Lake, Unity Catalog, and performance tuning techniques.
About the role
Key Responsibilities
- Design, build, and maintain secure connectors and pipelines between Databricks workspaces (Delta Lake, Unity Catalog) and Model Context Protocol (MCP) servers.
- Implement and configure MCP servers/clients to expose Databricks data, schemas, and analytical tools securely to AI models and LLM applications.
- Optimize data retrieval, caching mechanisms, and query performance between Databricks and LLM orchestration frameworks to minimize latency.
- Ensure all data exposed through the MCP server adheres to strict enterprise data governance and security policies.
- Collaborate with data science, security, and DevOps teams to integrate new data sources and maintain high availability.
Requirements
- 8+ years of experience in data engineering with a focus on Databricks and Delta Lake.
- Proven expertise in Unity Catalog, MCP, and secure data exposure for AI/LLM workloads.
- Strong background in performance tuning, caching, and query optimization.
- Experience with enterprise data governance, security compliance, and role-based access control.
- Excellent problem‑solving skills and ability to work in a fast‑paced, collaborative environment.