remote
REMOTE - AI Engineering Manager Databricks - State Farm
Engineering Manager
Lead a remote AI engineering team building scalable data pipelines and ML solutions on Databricks, leveraging Python, Spark, and AWS to deliver high‑impact insights and products.
About the role
Key Responsibilities
- Architect and oversee end‑to‑end data pipelines and ML workflows on Databricks, ensuring performance, reliability, and scalability.
- Guide a distributed team of data engineers and ML engineers, fostering best practices in code quality, testing, and documentation.
- Collaborate with product, analytics, and business stakeholders to translate requirements into robust, production‑ready solutions.
- Implement CI/CD pipelines, containerization (Docker/Kubernetes), and cloud infrastructure (AWS) to streamline deployment and monitoring.
- Drive continuous improvement of model training, evaluation, and deployment using MLflow and other MLOps tools.
Requirements
- 5+ years of experience in AI/ML engineering with a strong background in Python and Apache Spark.
- Proven track record managing remote or hybrid teams and delivering production‑grade data products.
- Hands‑on experience with Databricks, MLflow, AWS services (S3, EMR, SageMaker), and Kubernetes.
- Excellent communication skills and ability to translate technical concepts to non‑technical stakeholders.
- Strong problem‑solving mindset and a passion for building scalable, maintainable solutions.
Skills
pythonapache sparkdatabricksmachine learningawskubernetes