onsite
Senior Principal Databricks Platform Engineering Lead - JPMorgan Chase Bank, N.A.
Software Engineer
Lead the design, implementation, and automation of a scalable Databricks platform on AWS, using Python and Terraform, while mentoring engineering teams and driving data‑centric innovation.
About the role
Key Responsibilities
- Architect and own the end‑to‑end Databricks platform on AWS, ensuring scalability, security, and cost efficiency.
- Develop and maintain infrastructure‑as‑code pipelines using Terraform and Python to automate provisioning, configuration, and lifecycle management.
- Collaborate with data scientists, analysts, and product owners to translate business requirements into robust data solutions.
- Mentor and guide multiple engineering squads, fostering best practices in cloud architecture, CI/CD, and observability.
- Drive continuous improvement by evaluating emerging technologies, optimizing performance, and establishing governance standards.
Requirements
- 10+ years of software engineering experience with deep expertise in Python and cloud platforms, preferably AWS.
- Proven track record designing, deploying, and operating large‑scale Databricks environments.
- Strong hands‑on experience with Terraform or similar IaC tools for automated infrastructure management.
- Solid understanding of data engineering concepts, including Spark, Delta Lake, and data pipeline orchestration.
- Excellent leadership, communication, and mentorship skills, with the ability to influence cross‑functional teams.
Skills
pythondatabricksawsterraform