remote
Databricks Practice Architect II - TEKsystems
Software Engineer
Lead enterprise‑scale data solutions as a Databricks Practice Architect, driving cloud data platform design, Spark optimization, and data engineering best practices across large organizations.
About the role
Key Responsibilities
- Architect and deliver end‑to‑end Databricks solutions, integrating data lakes, warehouses, and analytics pipelines on cloud platforms.
- Lead technical design reviews, performance tuning, and cost optimization for Spark workloads.
- Collaborate with data scientists, engineers, and business stakeholders to translate business requirements into scalable data models.
- Mentor and coach cross‑functional teams on best practices for data engineering, governance, and security.
- Drive continuous improvement of data platform tooling, automation, and monitoring.
Requirements
- 5+ years of experience designing and implementing large‑scale data platforms with Databricks and Apache Spark.
- Proficiency in Python, SQL, and Spark SQL; experience with Delta Lake and Lakehouse architecture.
- Strong background in cloud data services (Azure Synapse, AWS Glue, or GCP BigQuery).
- Excellent communication skills and ability to influence technical direction across multiple teams.
- Experience with data governance, security, and compliance frameworks is a plus.
Skills
databricksapache sparkpythonsql