remote
Staff Software Engineer - AI Agent Evaluations - ID.me
Software Engineer
Seeking a Staff Software Engineer to focus on AI agent evaluations. This role involves developing and implementing systems for assessing AI performance using Python and machine learning techniques.
About the role
Key Responsibilities
- Design, develop, and maintain systems for evaluating AI agent performance.
- Implement machine learning models and algorithms for agent assessment.
- Analyze evaluation data to identify areas for AI improvement.
- Collaborate with AI research and engineering teams to define evaluation metrics.
- Contribute to the overall software engineering best practices within the team.
- Develop and deploy scalable solutions for AI agent testing.
Requirements
- Proven experience in software engineering, with a focus on AI or machine learning.
- Proficiency in Python and relevant ML libraries (e.g., TensorFlow, PyTorch).
- Experience with data analysis and interpretation of evaluation results.
- Strong understanding of AI agent development and evaluation methodologies.
- Familiarity with cloud platforms and CI/CD pipelines is a plus.
Skills
pythonmachine learningdata analysis