remote
RSA Databricks Consultant - Apex Systems
Software Engineer
Senior consultant who designs, optimizes, and fine‑tunes Databricks environments for advanced analytics, ML, and AI, delivering professional services and managed cybersecurity solutions.
About the role
Key Responsibilities
- Consult with clients to architect and optimize Databricks workspaces for high‑performance analytics and machine learning workloads.
- Design and implement Spark pipelines, data models, and ML workflows using Python, SQL, and Databricks notebooks.
- Collaborate with security teams to embed best‑practice data governance, access controls, and compliance controls within Databricks environments.
- Provide hands‑on training and knowledge transfer to client teams on Databricks features, performance tuning, and cost management.
- Document architecture, configuration, and operational procedures for long‑term client success.
Requirements
- 5+ years of experience with Databricks and Apache Spark in enterprise settings.
- Strong proficiency in Python, SQL, and Spark SQL for data engineering and ML pipelines.
- Hands‑on experience building and deploying machine learning models on Databricks.
- Knowledge of cloud platforms (Azure, AWS, or GCP) and their data services.
- Excellent communication skills and a proven ability to translate technical concepts to business stakeholders.
Skills
databricksapache sparkpythonmachine learningsql