Performance & Optimization: Lead efforts in system performance monitoring, tuning, and optimization, ensuring high availability, low latency, and efficient resource utilization. Identify and resolve system-wide issues in databases, caching layers, message queues, and other backend components.
Model Integration & Optimization: Integrate state-of-the-art LLMs and foundational models via commercial APIs or self-hosted inference setups. Implement strategies to manage model latency, token constraints, context windows, and fallback mechanisms.