Agentic coding annotator (online/offline tasks)

About Turing:
Turing is one of the world’s fastest-growing AI companies, accelerating the advancement and deployment of powerful AI systems. Turing helps customers in two ways: working with the world’s leading AI labs to advance frontier model capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality, STEM, and frontier knowledge; and leveraging that work to build real-world AI systems that solve mission-critical priorities for companies.
Role Overview:
We are looking for strong, detail-oriented software practitioners to help evaluate and improve datasets for agentic coding models.
This role involves working with realistic coding tasks in an agentic coding harness, reviewing model trajectories, verifying solutions, and producing high-quality annotations.
Depending on the assignment, the work may include:
Online evaluations: Manually interacting with blinded models on predefined tasks, then ranking and grading resulting trajectories<...