SGLang is a high-performance serving framework for large language models (LLMs) and vision-language models (VLMs). By co-designing the backend runtime and a frontend language, it delivers faster and more controllable interactions. See the SGLang repository and documentation for details.
This directory contains SGLang deployment guides for different MiniCPM versions. Use the links below to jump to the specific version.
| Version | English | 中文 |
|---|---|---|
| MiniCPM-V 4.6 (latest) | Guide | 指南 |
| MiniCPM-V 4.5 | Guide | 指南 |
| MiniCPM-V 4.0 | Guide | 指南 |
| MiniCPM-o 4.5 | Guide | 指南 |