Design and execute persona and role-playing evaluation frameworks, covering metrics such as identity recognition, role consistency, multi-turn stability, and style consistency.
Domain expert: You've scaled AI products in production and design for LLM failure modes such as hallucination, context degradation, prompt injection and latency under load.
Domain expert: You’ve scaled AI products in production and design for LLM failure modes such as hallucination, context degradation, prompt injection and latency under load.
Collaborate with data scientists to improve feature selection, feature engineering, and enable end-to-end AI workflows from model training to deployment and monitoring.