AI Output Evaluator

About the role

We are looking for a detail-oriented Independent Contractor to evaluate AI-generated outputs (images, videos, audio, and text) for a U.S.-based AI training project.

What you'll do

• Compare two AI-generated responses side-by-side and determine which one better satisfies a specific prompt based on observable evidence.
• Evaluate AI-generated outputs including images, videos, audio, and text for a U.S.-based AI training project.
• Write brief, evidence-based justifications for your choices using a strict evaluation rubric.
• Perform all work on a provided AWS Virtual Machine accessed via Remote Desktop Protocol (RDP).
• Log accurate active work hours on the AI platform.

Requirements

• Stable internet connection capable of maintaining a consistent RDP connection.
• Must only work on tasks you are authorized to do.
• Absolutely no use of ChatGPT, Claude, or any external AI tools to assist with evaluations.
• Strict confidentiality — you may not screenshot, copy, or share any task materials.
• Confirm you understand this is a 1099 Independent Contractor role with a revenue-share pay structure equivalent to $4.50 per hour.
• Comfortable with the AWS VM/RDP requirement and a maximum 14 hours per day / 40 hours per week.

AI Alerts shares third-party job opportunities for informational purposes only. We are not the employer and are not involved in the hiring process. Always verify the company and role through official channels before applying, and never pay to apply, train, onboard, process documents, or secure a job offer. Legitimate employers do not ask applicants for money. Read our Terms to learn more.