Subject Matter Expert AI Trainer (LLM Prompt Testing)
About the role
We are seeking highly qualified Domain Experts (SMEs) to support the evaluation, testing, and improvement of advanced Large Language Models (LLMs). You will apply your subject matter expertise to assess AI generated responses, identify knowledge gaps, design challenging prompts, and improve model accuracy, reliability, and reasoning.
What you'll do
- Create complex, domain specific prompts to test LLM capabilities.
- Evaluate AI generated responses for factual accuracy, reasoning, relevance, and overall quality.
- Identify factual errors, logical inconsistencies, knowledge gaps, and model weaknesses.
- Develop challenging test cases and edge cases that expose model limitations.
- Provide clear, detailed, and evidence based feedback to improve model performance.
Requirements
- Master’s degree or higher in a relevant field.
- At least three years of professional, research, or teaching experience.
- Excellent written English communication skills.
- Strong analytical and critical thinking abilities.
- Exceptional attention to detail.
- Preferred: Experience working with LLMs or Generative AI.
- Preferred: Familiarity with prompt engineering, AI evaluation, or model testing.
- Preferred: Experience designing challenging prompts, identifying edge cases, or stress testing AI models.
- The ideal candidate is curious, detail oriented, and deeply knowledgeable in their field. They enjoy solving complex problems, challenging assumptions, and identifying subtle factual or reasoning errors. Experience designing prompts that uncover model limitations and improve AI performance will be a strong advantage.
About Turing
Turing is an AI company based in San Francisco that works with the world's leading AI labs to make their models better at reasoning, coding, languages and more. It also helps businesses build real AI systems, and it works with talent from over 100 countries.
AI Alerts shares third-party job opportunities for informational purposes only. We are not the employer and are not involved in the hiring process. Always verify the company and role through official channels before applying, and never pay to apply, train, onboard, process documents, or secure a job offer. Legitimate employers do not ask applicants for money. Read our Terms to learn more.