Evaluate inference engines (vLLM, TensorRT-LLM, Triton Inference Server) and publish recommendations balancing performance, cost, and resilience. Provide hands-on support to agency teams applying these to their workloads.
Evaluate inference engines (vLLM, TensorRT-LLM, Triton Inference Server) and publish recommendations balancing performance, cost, and resilience. Provide hands-on support to agency teams applying these to their workloads.
4+ years as a software engineer, data engineer, or AI/ML practitioner writing technical design documents, data pipeline documentation, or API specifications