About The Job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Internet-Native Bilingual Evaluator Expert (Spanish – Spain)
Type: Contract
Compensation: $30–$40/hour
Location: Remote
Commitment: 10–20 hours/week
Role Responsibilities
Must-Have
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Internet-Native Bilingual Evaluator Expert (Spanish – Spain)
Type: Contract
Compensation: $30–$40/hour
Location: Remote
Commitment: 10–20 hours/week
Role Responsibilities
- Evaluate AI-generated responses for naturalness, fluency, cultural appropriateness, and internet authenticity.
- Analyse content from social media, forums, and online communities to assess AI model outputs.
- Identify issues with slang, memes, abbreviations, and code-switching in Spanish internet culture.
- Create detailed rubrics and guidelines for evaluating bilingual and internet-native communication.
- Test language models using real-world multilingual prompts and provide structured feedback.
- Collaborate with project leads to improve evaluation frameworks and maintain dataset consistency.
Must-Have
- Native or near-native fluency in Spanish (Spain) and professional fluency in English.
- Deep familiarity with Spain-based internet culture and online communities.
- Active engagement with platforms like YouTube, TikTok, Reddit, Discord, X, Instagram, Twitch, or Forocoches.
- Strong understanding of Peninsular Spanish slang, memes, and internet humor.
- Strong writing, analytical, and critical thinking skills.
- Available to commit 10–20 hours per week.
- Experience in content moderation, localization, translation, linguistics, social media, journalism, or AI evaluation.
- Experience evaluating user-generated content or digital communications.
- Familiarity with differences between Spain Spanish and Latin American Spanish online discourse.
- Interest in AI, language models, and internet culture research.
- Upload resume
- AI interview based on your resume
- Submit form
- For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
- For any help or support, reach out to: [email protected]