Evaluate inference engines (vLLM, TensorRT-LLM, Triton Inference Server) and publish recommendations balancing performance, cost, and resilience. Provide hands-on support to agency teams applying these to their workloads.
Evaluate inference engines (vLLM, TensorRT-LLM, Triton Inference Server) and publish recommendations balancing performance, cost, and resilience. Provide hands-on support to agency teams applying these to their workloads.
Evaluate inference engines (vLLM, TensorRT-LLM, Triton Inference Server) and publish recommendations balancing performance, cost, and resilience. Provide hands-on support to agency teams applying these to their workloads.
Design, develop, test, debug, and maintain high-quality software applications, ensuring proper technical documentation and adherence to best practices.
Preparation and submission of deliverables throughout the software development lifecycles such as Business Rules, Software Requirement Specifications, Software Architecture Document, Design Specification, Interface Specifications, Source Codes, Testing Specification, Operation and Maintenance Manual, Training Manual and others documents as required in the standard adopted by the Authority;