Experienced in event-driven and asynchronous design patterns, with familiarity in messaging and streaming technologies such as Amazon SQS, SNS, and Kinesis
Model Integration & Optimization: Integrate state-of-the-art LLMs and foundational models via commercial APIs or self-hosted inference setups. Implement strategies to manage model latency, token constraints, context windows, and fallback mechanisms.