remote
Databricks Solutions Architect - Strategic Management Solutions, LLC
Solutions Architect
Lead design and implementation of big data solutions on Databricks, leveraging Spark, Python, and cloud platforms to deliver scalable analytics and data engineering services for enterprise clients.
About the role
Key Responsibilities
- Architect and deploy end‑to‑end data pipelines on Databricks, ensuring performance, reliability, and cost efficiency.
- Collaborate with data scientists, engineers, and stakeholders to translate business requirements into scalable Spark solutions.
- Implement data governance, security, and compliance controls across Azure and AWS environments.
- Provide technical guidance and mentorship to development teams on best practices for PySpark, SQL, and Delta Lake.
- Conduct performance tuning, monitoring, and troubleshooting of large‑scale data workloads.
Requirements
- 5+ years of experience designing and operating Databricks/Spark solutions in production.
- Proficiency in Python, SQL, and PySpark for data transformation and analytics.
- Hands‑on experience with Azure Data Lake, Azure Synapse, or AWS Glue/EMR.
- Strong understanding of data lakehouse concepts, Delta Lake, and data governance frameworks.
- Excellent communication skills and ability to translate technical concepts to non‑technical stakeholders.
Skills
databricksapache sparkpythonsqlazureaws