Thoth AI Hiring! Full Time Senior Coding Expert-- Malaysia in - Ricebowl

Job Title：Coding Expert (Rubric Design & Adjudication)

Key Responsibilities：Design and refine evaluation rubrics, verifiers and test criteria for coding agent tasks built from real engineering workflows (e.g., bug fixing, feature implementation, code review, refactoring, repo-level tasks, terminal / tool use)

Define verifiable outcomes (unit tests, execution results, expected repo state); review full agent trajectories (commands, edits, tool calls, outputs) on complex cases

Adjudicate ambiguous or disputed cases and give final expert approval

Run failure analysis (planning, tool use, execution, environment) and write actionable improvement feedback