Real-world Feedback Loops: Leverage multi-channel user feedback and real-world task data as primary research signals; design experiments and datasets to continuously improve agent and retrieval performance in production scenarios
2-8+ Year hands-on experience with LLM, RAG and AI agent systems in production
Collaborate with platform engineering and application teams to identify operational requirements, provide feedback on reusable infrastructure building blocks, and continuously improve the reliability and operability of the environment.
Must be a U.S. Citizen with the ability to obtain and maintain the required Public Trust level clearance.
Bachelor's Degree and 8 years of experience, or a High School diploma/equivalent and 12 years of experience.
...
Manage and optimize cloud infrastructure (AWS, Alicloud) for performance, cost, and reliability
Develop Devops platform like online load test, change management system
Leverage LLMs or AI frameworks (OpenAI, Dify, Agno, LangChain) to enhance automation in infrastructure operations, including intelligent alert triage, RCA (Root Cause Analysis), and chat-based operations (ChatOps)
...