Systems Engineer (Coding Agent Experience) [$85/hr]
About The Role
About The Role
- Contributors help evaluate and improve frontier AI coding models through structured technical assessments
- The work focuses on realistic systems engineering workflows and model evaluation.
- Spots are limited and filling quickly on a first come, first serve basis
- Use frontier AI coding agents to complete and evaluate complex engineering tasks
- Review model-generated code, architecture decisions, and systems implementations
- Identify bugs, edge cases, performance bottlenecks, and failure modes
- Compare outputs from multiple frontier models and assess their strengths and weaknesses
- Apply professional engineering judgment to realistic systems engineering scenarios
- Sprint based project that runs in 12-24 hour stretches based on client requirement
- 2+ years of professional systems engineering experience
- Experience with distributed systems, networking, operating systems, storage systems, infrastructure software, or database internals
- Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools
- Ability to evaluate model-generated systems designs and implementations
- Experience building highly scalable and performance-critical systems is preferred
- $400 per accepted task
- Typical tasks take approximately 1 3 hours after ramp-up
- No fixed task limits
- Compensation is tied to accepted work