LLM Evaluation Product Operations Specialist – TikTok

We are looking for a sharp and organized Product Operations specialist to join TikTok's Tako team. You will play a key role in building and operationalizing the evaluation framework for Tako's in‑app AI chatbot experience, bridging user insights, data analysis, and cross‑functional execution to drive continuous product improvement.

• Own the end‑to‑end design and implementation of the AI chatbot experience evaluation framework within Tako; support ongoing product iteration and optimization.
• Leverage user research and data analysis to uncover user needs; define the ideal experience quality standard for the product and drive improvements in model capability and user satisfaction.
• Collaborate with strategy and algorithm teams to build a scenario‑based evaluation metrics system for Tako; deliver analytical insights and recommendations to improve and retain search users.
• Partner with international d...