Vacancy Description
We are sharing a specialised part-time consulting opportunity for detail-oriented evaluators with experience interpreting JSON-formatted outputs, applying structured grading rubrics, and assessing human data or AI evaluation tasks consistently.
This urgent project supports a short-term evaluation sprint focused on grading AI-generated outputs against detailed task criteria. Selected professionals will review written instructions, interpret JSON-based responses, and assess each output independently using predefined rubrics. Strong accuracy, consistency, and careful attention to small details are essential.
Key Responsibilities
JSON Output Review
- Read, parse, and interpret AI-generated outputs presented in JSON format
- Understand nested fields, structured values, and relationships between output components
- Identify missing, inconsistent, malformed, or incorrectly represented information<...