remote
FT/PT Remote AI Prompt Engineering & Evaluation - Will Train - DataAnnotation.tech
Software Engineer
Remote AI Prompt Engineer & Evaluator crafting and assessing chatbot conversations, shaping AI behavior with Python and NLP tools, while managing data annotation tasks on a flexible schedule.
About the role
Key Responsibilities
- Design, write, and refine prompts to guide chatbot responses across diverse scenarios.
- Interact with live chatbot instances to evaluate performance, identify gaps, and suggest improvements.
- Annotate conversation data, tagging intent, sentiment, and quality metrics for training pipelines.
- Collaborate with engineering and research teams to iterate on model behavior and documentation.
- Track and report on key quality indicators, providing actionable insights for continuous improvement.
Requirements
- Strong written communication skills with a keen eye for detail.
- Experience with NLP concepts and familiarity with chatbot frameworks (e.g., OpenAI GPT, Rasa).
- Proficiency in Python for data manipulation and scripting.
- Ability to work independently, manage multiple projects, and meet quality benchmarks.
- Passion for AI, learning new tools, and contributing to cutting‑edge conversational systems.
Skills
natural language processing