onsite
22802-CoE - AI -Senior Data Scientist - QualityAI
Data Scientist
Senior AI Assurance Engineer responsible for designing and executing testing, validation, monitoring, and governance processes for machine learning and generative AI systems, ensuring reliability, safety, compliance, and ethical alignment.
About the role
Key Responsibilities
- Design and implement comprehensive testing and validation frameworks for ML and generative AI models across development, deployment, and production stages.
- Develop monitoring pipelines to track model performance, drift, and bias, and trigger remediation actions when thresholds are exceeded.
- Collaborate with data scientists, ML engineers, product owners, security, legal, and compliance teams to define AI risk assessments and governance policies.
- Create documentation and audit trails that demonstrate compliance with regulatory standards and internal ethical guidelines.
- Automate reproducible evaluation workflows using Python, statistical testing libraries, and cloud services (e.g., AWS SageMaker, CloudWatch).
Requirements
- 5+ years of experience in machine learning model development, validation, or AI risk management.
- Strong proficiency in Python and statistical analysis tools (e.g., pandas, scipy, scikit‑learn).
- Hands‑on experience with AI governance frameworks, bias detection techniques, and model monitoring in production.
- Familiarity with cloud platforms, preferably AWS, for deploying and scaling validation pipelines.
- Excellent communication skills to translate technical findings into actionable recommendations for cross‑functional stakeholders.
Skills
pythonmachine learningaws