remote
Senior Architect - Data & AI Platform Strategy - MetLife
Software Engineer
Lead the design and implementation of scalable data and AI platforms, driving cloud‑native solutions with Python, Spark, Kafka, and AWS to enable advanced analytics and machine‑learning capabilities.
About the role
Key Responsibilities
- Define and evolve the enterprise data and AI platform strategy, aligning architecture with business goals and emerging technologies.
- Design, build, and optimize cloud‑native data pipelines using Apache Spark, Kafka, and Kubernetes on AWS.
- Lead the integration of machine‑learning models into production, ensuring reproducibility, monitoring, and performance at scale.
- Collaborate with cross‑functional teams to modernize legacy systems, improve resiliency, and implement automation and CI/CD practices.
- Establish governance, security, and data‑quality standards across the platform while mentoring engineering teams.
Requirements
- 10+ years of experience in data engineering, AI/ML platform design, and cloud architecture (AWS preferred).
- Strong proficiency in Python and big‑data processing frameworks such as Apache Spark.
- Hands‑on experience with streaming technologies like Kafka and container orchestration using Kubernetes.
- Proven ability to translate complex business problems into scalable, secure, and maintainable technical solutions.
- Excellent communication and leadership skills to influence stakeholders and guide multidisciplinary teams.
Skills
pythonapache sparkkafkaawsmachine learningkubernetes