jobs in Thoth AI

全职 Coding Agent Evaluation Specialist -- Malaysia 工作, 薪水, Thoth AI 公司招聘中 - Ricebowl

Coding Agent Evaluation Specialist -- Malaysia

Thoth AI

Malaysia

分享
保存

工作地点

  • Malaysia

职位描述

岗位职责

Apply and adapt coding rubrics to evaluate LLM code responses and agent trajectories (correctness, code quality, efficiency, security, tool usage)

Run and test code, reproduce issues, and verify outcomes against test cases and acceptance criteria

Identify and attribute errors (reasoning, implementation, tool use, environment) and write structured feedback

Complete rubric interpretation and golden-task training; pass the post-training qualification before starting work

重要安全守则

申请工作时,切勿提供您的银行或信用卡详细资料。不要转账或完成无关的在线调查问卷。如果您发现可疑内容,请举报此招聘广告。

了解更多