接入 API · 个人 AI 解读连接自己的模型解读资讯,浏览新闻无需配置。
返回资讯列表
算力与芯片官方来源国际

SGLang 发布: v0.5.13

SGLang 发布 · 来源更新
今日摘要使用自己的 API,仅供个人查看

来源摘要

## Highlights **New Model Support**: - **Autoregressive**: [Nemotron 3 Ultra](https://docs.sglang.io/cookbook/autoregressive/NVIDIA/Nemotron3-Ultra) (Day-0, [blog](https://www.lmsys.org/blog/2026-06-04-nvidia-run-nemotron-3-ultra/)), [Step-3.7-Flash](https://docs.sglang.io/cookbook/autoregressive/StepFun/Step-3.7-Flash), Command A+ - **Diffusion**: [Cosmos3](https://docs.sglang.io/cookbook/diffusion/Cosmos/Cosmos3), [LingBot-World](https://docs.sglang.io/cookbook/diffusion/LingBot-World/LingBot-World), [SANA-WM](https://docs.sglang.io/cookbook/diffusion/SANA-WM/SANA-WM), [Ernie-Image](https://docs.sglang.io/cookbook/diffusion/Ernie-Image/Ernie-Image), [FLUX.2-Klein 4B/9B](https://docs.sglang.io/cookbook/diffusion/FLUX/FLUX), [Ideogram 4](https://docs.sglang.io/cookbook/diffusion/Ideogram/Ideogram4) **Spec V2 is now the default speculative-decoding path**: Tree drafting with topk > 1 is production-ready across the triton / FA3 / MLA / aiter backends, including `page_size > 1` and Mamba/hybrid-linear models ([#26997](https://github.com/sgl-project/sglang/pull/26997), [#26972](https://github.com/sgl-project/sglang/pull/26972), [#27463](https://github.com/sgl-project/sglang/pull/27463)). Spec V1 is deprecated, with EAGLE/MTP now running on the unified V2 worker ([#25464](https://github.com/sgl-project/sglang/pull/25464)), and topk = 1 drafting is faster ([#26397](https://github.com/sgl-project/sglang/pull/26397), [#26424](https://github.com/sgl-project/sglang/pull/26424)). **Lower per-step scheduler overhead**: Unified async value passing through FutureMap plus moving prefill input transfer onto the forward stream reduced per-step launch overhead and improved stability under high concurrency ([#25945](https://github.com/sgl-project/sglang/pull/25945), [#25879](https://githu

阅读原始来源
来源
SGLang 发布 · 官方来源
来源发布
2026/06/13 08:17
来源更新
2026/06/13 08:18
首次采集
2026/09/19 12:56

本文为公开信息索引与摘要,详情及后续变化请以原始来源为准。

把 AI 雷达放到桌面

在支持安装的浏览器中,可以将本站作为应用打开。

安装入口取决于浏览器;应用和网站使用同一份最新内容。

查看完整安装指南