hybrid
Prompt Engineer - Aceolution
Prompt Engineer
Prompt Engineer to develop, evaluate, and deploy frontier generative AI systems with agentic workflows and structured output design.
About the role
Key Responsibilities
- Tune and test client APIs within a prompt-engineering pod, including agentic and tool-calling components
- Analyze overnight QA logs to identify discrepancies between tool outputs and human-validated baselines
- Categorize errors (hallucinations, context misses, boundary failures) and form hypotheses on root causes
- Refactor prompts by adding constraints, updating few-shot examples, or requesting RAG layer updates
- Run regression tests against the Golden Dataset before deploying prompt changes
- Deploy approved changes to the live orchestration layer and monitor output stability
Requirements
- Hands-on production experience with at least one major LLM API (Gemini, OpenAI, or Anthropic)
- Fluency in Python with object-oriented programming skills for agent/tool-calling frameworks
- Strong analytical reasoning and structured problem-solving for hypothesis-driven prompt iteration
- Experience with prompt strategies (context window management, few-shot construction, system prompt design)
- High tolerance for ambiguity and linguistic precision for subjective decision-making
Skills
pythonllm apisprompt engineeringstructured output designregression testingapi integration