Model Integration & Optimization: Integrate state-of-the-art LLMs and foundational models via commercial APIs or self-hosted inference setups. Implement strategies to manage model latency, token constraints, context windows, and fallback mechanisms.
Work closely with ML engineers to proactively identify and resolve technical challenges , while also contributing directly to the implementation of those improvements. This includes troubleshooting and optimizing machine learning workflows for maximum efficiency and performance, architecting and executing cutting-edge technologies/methodologies for accelerating ML development end-to-end from concept to deployment & maintenance.
Build and maintain automated test coverage (including regression and integration testing) and support continuous improvement in engineering standards and quality controls.
Collaborate closely with diverse stakeholders, including business users and IT professionals, to understand requirements and translate them into practical technical solutions.
Build and maintain automated test coverage (including regression and integration testing) and support continuous improvement in engineering standards and quality controls.
4+ years as a software engineer, data engineer, or AI/ML practitioner writing technical design documents, data pipeline documentation, or API specifications
4+ years as a software engineer, data engineer, or AI/ML practitioner writing technical design documents, data pipeline documentation, or API specifications