Position: AI Evaluation Specialist
Type: Contract
Compensation: $22 - $70/hour
Location: Remote
Commitment: 10-40 hrs/week
Role Responsibilities
- Review and critically assess AI-generated outputs for quality, clarity, usability, and overall user experience.
- Identify inconsistencies, weaknesses, and improvement opportunities across diverse content types and visual experiences.
- Apply structured evaluation guidelines and provide insightful, nuanced feedback to inform model improvements.
- Collaborate with cross-functional teams to define and refine quality standards, scoring criteria, and review processes.
- Maintain high accuracy and consistency across evaluations, ensuring reliable and actionable results.
- Contribute to the continuous enhancement of evaluation workflows and best practices.
Requirements
- Have native English proficiency at C1 or C2 level.
- Possess exceptional reading comprehension and acute attention to detail.
- Demonstrate strong observational skills with excellent aesthetic or editorial judgment.
- Be able to think critically and deliver consistent, high-quality evaluations in ambiguous scenarios.
- Have excellent written and verbal communication skills.
Application Process
- Easy Apply on LinkedIn
- Check email for next steps
- Participate in resume evaluation & interview stage