About The Job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Financial AI Evaluator
Type: Contract
Compensation: $105/hour
Location: Remote
Role Responsibilities
Must-Have
,
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Financial AI Evaluator
Type: Contract
Compensation: $105/hour
Location: Remote
Role Responsibilities
- Write and refine prompts to guide model behavior in financial contexts.
- Evaluate LLM-generated responses to finance-related queries for accuracy and clarity.
- Conduct fact-checking using trusted public sources and financial references.
- Annotate model responses by identifying strengths and areas for improvement.
- Assess tone and appropriateness of responses for real-world financial use cases.
- Apply consistent evaluation standards by following clear taxonomies and guidelines.
Must-Have
- 5+ years of professional experience in Finance.
- Bachelor's, Master's, or PhD degree in Finance, Accounting, Economics, or related fields.
- Experience in Investment Banking, Corporate Finance, Accounting & Auditing, or Asset Management.
- Significant experience using large language models.
- Excellent writing skills and strong attention to detail.
- Experience with RLHF, model evaluation, or data annotation.
- Experience writing or editing high-quality financial content.
- Familiarity with evaluation rubrics or quality scoring systems.
- Upload resume
- AI interview based on your resume
- Submit form
- For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
- For any help or support, reach out to: [email protected]
,