Position: Software Engineering Evaluator
Type: Contract
Compensation: $150/hr
Location: Remote
Commitment: Minimum 10 hours/week, up to 40 hours/week (partial PST overlap required)
Role Responsibilities
- Curate, build, and correct real-world code examples across multiple programming languages.
- Evaluate AI-generated code for efficiency, scalability, reliability, and correctness.
- Design automated verification mechanisms to validate software engineering solutions.
- Assess AI capabilities across the full software development lifecycle.
- Collaborate with researchers and cross-functional teams to improve AI-driven coding systems.
Requirements
- Strong professional software engineering experience.
- Continuous full-time experience at a top-tier product company.
- Strong expertise in full-stack development and production-grade system design.
- Deep understanding of software architecture, debugging, and code quality assessment.
- Excellent written and verbal communication skills.
- Access to a desktop or laptop computer
Application Process (45 min)
- Upload resume
- Automated coding exercise
- Interview