onsite
Databricks Engineer / Solutions Architect - Kentro
Solutions Architect
Design and implement a scalable Databricks platform on Azure, delivering modern data pipelines and BI solutions for federal MI/BI workloads using Spark, Python, and SQL.
About the role
Key Responsibilities
- Lead the end‑to‑end design, deployment, and scaling of a greenfield Databricks environment on Azure.
- Architect and build data pipelines using Apache Spark, Python, and SQL to support Management Information and Business Intelligence reporting.
- Integrate source systems, data lakes, and warehouses, ensuring data quality, security, and compliance for federal customers.
- Develop best‑practice governance, monitoring, and cost‑optimization strategies for the Databricks platform.
- Collaborate with stakeholders, data analysts, and engineering teams to translate business requirements into technical solutions.
Requirements
- Certified Databricks Engineer or Solutions Architect with hands‑on experience building production‑grade Databricks workloads.
- Strong expertise in Azure services (Azure Data Lake, Azure Synapse, Azure Active Directory, etc.) and cloud‑native architecture.
- Proficiency in Apache Spark programming using Python/SQL and familiarity with Delta Lake concepts.
- Experience designing data pipelines, ETL/ELT processes, and BI integrations for large‑scale enterprise environments.
- Excellent problem‑solving, communication, and documentation skills, with a focus on security and compliance in federal settings.
Skills
databricksazureapache sparkpythonsql