Position: Rubric Academy Fellowship
Type: Fellowship (One-time, Paid)
Compensation: $50–$150 (one-time stipend)
Location: Remote
Duration: 3–5 hours, self-paced
Requirements
- Independent professional with deep subject-matter expertise in any domain
- Strong analytical thinking and ability to articulate how quality is evaluated in your field
- High professional integrity and reliance on personal judgment and domain standards
- Comfortable working independently in a self-guided learning environment
- Interest in understanding how AI evaluation and benchmarking systems are designed
- Ability to engage thoughtfully with conceptual frameworks related to prompts, rubrics, and evaluation quality
- No prior AI experience required
Role Responsibilities
- Complete a self-guided, paid Academy covering core concepts used in AI evaluation
- Learn the principles behind prompt design and how context shapes AI outputs
- Understand the concept of a “Golden Response” and how experts define ideal outcomes in their domain
- Review how evaluation rubrics and scoring systems are structured in AI benchmarking environments
- Optionally complete a practice task demonstrating applied understanding of the concepts
- Decide whether to opt in for eligibility for Mercor’s specialized, high-paying expert opportunities
- Maintain full autonomy over how professional judgment and expertise are applied
Application process: (Takes 20 min)
- Upload resume
- AI interview based on your resume (15 min)
- Submit form