Evaluate inference engines (vLLM, TensorRT-LLM, Triton Inference Server) and publish recommendations balancing performance, cost, and resilience. Provide hands-on support to agency teams applying these to their workloads.
Evaluate inference engines (vLLM, TensorRT-LLM, Triton Inference Server) and publish recommendations balancing performance, cost, and resilience. Provide hands-on support to agency teams applying these to their workloads.
Analyze and provide input for the requirements and provide impact assessment for new features or bug fixes. Make high-level design and establish technical standards.
Collaborate with specialist and operation teams to improve security systems, automated tools, and threat detection capabilities, enhancing operational efficiency and automation.