onsite
Lead Cloud Data and AI/ML Engineer, AVP - State Street
ML Engineer
Lead Cloud Data and AI/ML Engineer driving end‑to‑end data solutions on AWS and Databricks, delivering high‑impact business outcomes with advanced analytics and ML capabilities.
About the role
Key Responsibilities
- Lead end‑to‑end data engineering workstreams, delivering scalable cloud solutions that drive business value.
- Research, evaluate, and prototype new AWS services and Databricks features to enhance performance and cost efficiency.
- Design and implement data pipelines, lakehouse architectures, and ML workflows using Python and Spark.
- Document best practices, deployment strategies, and operational guidelines for production environments.
- Collaborate with cross‑functional teams to translate business requirements into technical specifications.
Requirements
- Bachelor’s degree in Computer Science, Information Systems, or related field.
- 5+ years of experience as a Data Engineer with strong cloud (AWS) expertise.
- Hands‑on experience with Databricks, Spark, and Python for data processing and ML.
- Knowledge of AWS services such as S3, Glue, Redshift, Athena, and Lambda.
- Excellent communication skills and a proven ability to mentor and influence stakeholders.
Skills
awsdatabrickspythonmachine learning