onsite
Databricks Subject Matter Expert - CGI
Software Engineer
Lead and architect complex data transformation initiatives on the Databricks Lakehouse Platform, partnering with senior stakeholders to design, implement, and deploy production-ready solutions using Spark, Python, and SQL.
About the role
Key Responsibilities
- Act as the primary technical authority on Databricks Lakehouse, advising clients on architecture, best practices, and roadmap.
- Lead end‑to‑end data transformation projects, from strategic design through hands‑on implementation and production deployment.
- Collaborate with CTOs, VPs of Data, and Engineering Leads to translate business requirements into scalable, high‑performance data pipelines.
- Mentor and coach client teams on Spark, Python, and SQL development, ensuring code quality and performance optimization.
- Drive continuous improvement of data processes, tooling, and governance within the Lakehouse ecosystem.
Requirements
- 10+ years of experience in data engineering, with 5+ years focused on Databricks and Lakehouse solutions.
- Deep expertise in Apache Spark, Python, Scala, and SQL, plus experience with cloud data platforms (Azure, AWS, or GCP).
- Proven track record of delivering large‑scale, production‑grade data pipelines and transformations.
- Excellent communication skills, able to influence senior technical and business stakeholders.
- Strong problem‑solving mindset and ability to thrive in fast‑paced, client‑facing environments.
Skills
databricksapache sparkpythonsql