Maintain and improve existing controls standards and documentation for equipment manuals and Technical Documents (P&ID, Functional specification drawing and etc).
Participate in Data Center and mission-critical infrastructure projects, gaining exposure to cooling systems, sustainability initiatives, operational resilience, and optimization strategies.
Participate in Data Center and mission-critical infrastructure projects, gaining exposure to cooling systems, sustainability initiatives, operational resilience, and optimization strategies.
Efficiency: Designing and implementing software platforms and monitoring frameworks for efficient, automated, and intelligent service-oriented architecture (SOA) governance.
Participate in intelligent traffic management and large-scale platform development, with exposure to systems managing millions of machines and handling high concurrency. Improve code quality and system reliability through code review, automated testing, observability, and performance optimization.
Follow up on cutting-edge technologies such as global large model inference, GPU high-performance computing, distributed parallelism, and cache optimization, benchmark against mainstream inference frameworks such as vLLM and TensorRT-LLM, complete the implementation of solutions and technological innovation, continuously iterate and optimize the performance and cost advantages of the inference system, and build the core technological barriers of the team.
For inference track, develop the Volcano Ark MaaS (Model-as-a-Service) inference platform, optimizing the performance, cost efficiency, and reliability of large language model inference across hyperscale heterogeneous GPU clusters.
Architecture for data at the scale of hundreds of billions: Conducting in-depth research and innovation in all aspects, from large-scale offline computing and performance and scheduling optimization of distributed systems to building high-availability, high-throughput, and low-latency online services.
Collaborate with the business and algorithm teams to identify performance issues, provide full stack performance analysis, bottleneck diagnosis, and optimization solutions, consolidate general-purpose performance optimization components, toolchains, and platform capabilities, and empower multiple internal business.