Company Description
Impacter Pathway develops innovative, brain-based assessment and skill development tools to transform student voice into measurable growth in key human competencies such as purpose, grit, curiosity, and compassion. Utilizing advanced Natural Language Processing (NLP) and machine learning, our platform analyzes real-time spoken reflections to deliver data on students' character, communication, and future-ready skills. Designed for students in grades TK–12, IMPACTER empowers educators to go beyond test scores and surveys to understand each student holistically and take meaningful action based on insights.
Role Description
We are seeking experienced K-12 educators or assessment specialists to join our Human-in-the-Loop (HITL) scoring pipeline as a Reader. In this role, your expert judgment serves as the "ground truth" that trains and calibrates our AI models. This isn't typical "grading." You will interpret the nuance and depth of student reflections using research-backed rubrics co-developed with partners like Harvard’s Making Caring Common Project. You will listen to and read student responses to identify the specific cognitive and emotional "moves" that signal growth in human competencies.
Key Responsibilities
- Expert Scoring: Apply IMPACTER’s 0–4 point rubrics to open-ended student responses (audio and text) with high precision and fidelity.
- Nuance Detection: Identify the difference between surface-level responses and deep, authentic student reflection.
- Model Calibration: Provide the high-fidelity labels required to maintain and improve our transformer-based scoring models.
- Norming & Alignment: Participate in periodic calibration sessions to ensure inter-rater reliability and combat scoring drift.
Qualifications
- K-12 Expertise: 3+ years of experience in the classroom, school counseling, or academic assessment.
- Assessment Mastery: Proven experience with rubric-based, holistic scoring (e.g., AP Reader, SAT Scorer, or similar state-level assessment experience).
- Ear for Student Voice: Ability to detect reasoning depth and self-reflection in natural, unscripted student language.
- Detail-Oriented: A commitment to accuracy and the ability to differentiate between rubric levels with precision.
- Tech-Fluent: Comfortable working in digital scoring environments and interested in the intersection of pedagogy and AI.
- Education: Bachelor’s degree in Education, Psychology, Linguistics, or a related field.