onsite
Databricks Senior Consultant
Software Engineer
Senior consultant driving data‑centric solutions on Databricks, leveraging AWS and Azure cloud platforms to deliver advanced business intelligence and analytics services.
About the role
Key Responsibilities
- Architect and implement end‑to‑end data pipelines on Databricks, integrating with AWS S3, Redshift, Azure Data Lake, and Synapse.
- Design and optimize Spark jobs for large‑scale data processing, ensuring performance, scalability, and cost efficiency.
- Collaborate with business stakeholders to translate analytical requirements into actionable BI dashboards and reports.
- Lead data governance initiatives, enforcing security, compliance, and data quality best practices across cloud environments.
- Mentor junior engineers and provide technical guidance on cloud architecture, Spark optimization, and BI tool integration.
Requirements
- 5+ years of experience in data engineering or analytics with a focus on Databricks and Spark.
- Proven expertise in AWS and Azure cloud services, including data storage, compute, and security.
- Strong background in business intelligence, data modeling, and dashboard development.
- Excellent problem‑solving skills and ability to communicate complex concepts to non‑technical audiences.
- Experience with CI/CD pipelines, version control, and automated testing in a cloud context.