Position: Bilingual Spanish Generalist Evaluator Expert
Type: Hourly Contract
Compensation: $25–$30/hour
Location: Remote (Spain or Mexico)
Commitment: 20+ hours/week | 2+ months
Role Responsibilities
- Create detailed prompts in Spanish and/or English with multiple constraints and clear instructions, ensuring natural phrasing and real-world relevance for Spanish-speaking users.
- Develop high-quality Spanish/English prompt–golden answer pairs to train and evaluate advanced language models.
- Define evaluation standards and build comprehensive rubrics aligned with Spanish linguistic nuance, tone, and cultural conventions.
- Run prompts through AI models and assess outputs for accuracy, fluency, and cultural alignment in Spanish, comparing results against English when required.
- Collaborate in QA review processes to ensure consistency, rigor, and reliability across Spanish-language benchmarks.
- Deliver structured, high-quality written work within project timelines.
Requirements
- Native-level fluency in written Spanish with strong reading and writing proficiency in English.
- BS or BA from a reputable institution (completed or in progress).
- Strong writing, analytical, and critical thinking skills.
- Ability to work independently and meet deadlines in a remote environment.
- Significant familiarity with ChatGPT or similar AI tools.
- Able to reliably produce culturally accurate Spanish specific to these regions.
Application Process
- Upload resume
- Interview
- Submit form