AI Prompt Engineer II

About Us Pearl is AI for professional services at global scale, combining advanced AI with verified human expertise to deliver help that is accurate, accountable, and fast. Since 2003, our network has connected millions of customers with licensed professionals across 196 countries, making real expertise available anytime, anywhere. Our Values Data driven: Data decides, not egos Courageous: We take risks and challenge the status status quo Innovative: We're constantly learning, creating, and adapting Lean: We focus on customers, using lean testing to learn how to serve them best Humble: Past success is not a guarantee of future success About the Role We are seeking an AI Prompt Engineer II who combines strategic thinking, scientific expertise, and hands-on building skills. You will join a dynamic, agile team dedicated to designing, testing, and scaling large language model (LLM) prompts that drive impactful user experiences. Leveraging your deep knowledge of Generative AI, you will enhance our AI-powered expert platform, unlocking meaningful business outcomes and shaping how AI understands customers and supports experts. What You'll Do Design, build, and develop AI agents Create complex multi-part prompting systems with parameter optimization and implement advanced prompting techniques Develop comprehensive evaluation frameworks to measure performance across multiple dimensions, comparing approaches such as retrieval-augmented generation (RAG), fine-tuning, and advanced prompting methodologies Analyze and optimize LLM performance using A/B testing, usage metrics, and strategic feedback loops Develop AI-driven workflows that improve user interactions and Customer Care support Design and refine expert playbooks to enhance knowledge sharing and operational efficiency Run experiments to validate ideas rapidly and iterate based on performance data and user insights Collaborate cross-functionally with product managers, engineers, and stakeholders to identify LLM opportunities and translate technical capabilities into business value Manage stakeholder expectations and communicate complex technical concepts effectively to both technical and non-technical audiences Implement LLMOps best practices including model governance, lifecycle management, and performance monitoring to ensure production-ready AI systems Educate and empower internal teams to build better prompts and leverage AI tools effectively What We're Looking For Master's or PhD in Computer Science, Computational Linguistics, Machine Learning, or a related field preferred Strong proficiency in Python with hands-on experience building and testing complex prompting systems Deep understanding of LLMs and advanced frameworks, with expertise across multiple LLM vendors and model versions Proven experience developing and applying evaluation frameworks to test model outputs Production experience with RAG and fine-tuned models Demonstrated ability to automate large-scale API interactions and scripting for prompt testing, minimizing manual processes Experience with LLMOps practices, including model governance, version control, performance monitoring, and lifecycle management Strong stakeholder management skills and the ability to collaborate effectively across technical and business teams Proven track record of translating complex technical concepts into actionable business insights for diverse audiences Analytical mindset with experience using Excel, Power BI, or Google Analytics Solid understanding of NLP techniques Excellent judgment with the ability to prioritize and independently drive projects forward while managing multiple stakeholder relationships Experience working in agile, sprint-based development environments; familiarity with tools such as Azure Boards or Asana Our Commitment to an Inclusive Workplace We welcome people from all backgrounds who seek the opportunity to help build a future where professional services are readily available to all. If you have curiosity, passion, and a collaborative spirit, come work with us. Pearl is committed to an inclusive workplace. Pearl is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, disability, age, or other legally protected status. AI Disclosure & Informed Consent Artificial intelligence (AI) technology may be used during the hiring process to record, transcribe, analyze, and rank interview responses. By submitting your application and participating in the interview process, you acknowledge and consent to the use of AI technology in the hiring process. For more information see our AI Disclosure and Consent Policy. #LI-Remote