remote
Applied Machine Learning & Data Engineering Senior Consultant II - National General Insurance
ML Engineer
Senior consultant driving AI‑powered data ingestion, transformation, and mapping initiatives using Python, SQL, Spark, and AWS to deliver high‑impact automation across the organization.
About the role
Key Responsibilities
- Design, develop, and deploy end‑to‑end data pipelines that ingest, cleanse, and transform large datasets for AI and analytics workloads.
- Implement machine learning models and automated data mapping solutions to accelerate business processes and improve data quality.
- Collaborate with cross‑functional teams to define data requirements, establish best practices, and ensure compliance with data governance standards.
- Optimize performance of data workflows on cloud platforms (AWS) and distributed processing frameworks (Apache Spark).
- Document architecture, code, and operational procedures for maintainability and knowledge transfer.
Requirements
- 5+ years of experience in data engineering and applied machine learning within a large enterprise environment.
- Demonstrated ability to translate business problems into data‑driven solutions and communicate technical concepts to non‑technical stakeholders.
- Experience with data governance, security, and compliance best practices is a plus.
Skills
machine learningpythonsqlawsapache spark