接入 API · 个人 AI 解读连接自己的模型解读资讯,浏览新闻无需配置。
返回资讯列表
算力与芯片官方来源国际

SGLang 发布: v0.5.14

SGLang 发布 · 来源更新
今日摘要使用自己的 API,仅供个人查看

来源摘要

# Highlights New Model Support: [GLM-5.2](https://docs.sglang.io/cookbook/autoregressive/GLM/GLM-5.2), [LiquidAI LFM2.5](https://docs.sglang.io/cookbook/autoregressive/LiquidAI/LFM2.5), [Kimi-K2.7-Code](https://docs.sglang.io/cookbook/autoregressive/Moonshotai/Kimi-K2.7-Code), [Poolside Laguna-M.1](https://docs.sglang.io/cookbook/autoregressive/Poolside/Laguna-M.1), [DiffusionGemma](https://docs.sglang.io/cookbook/autoregressive/Google/DiffusionGemma), Zyphra ZAYA1, MiMo-V2-ASR **DeepSeek-V4 on GB300 since Day 0**: 5x higher throughput at the same interactivity, serving DeepSeek-V4 on NVIDIA GB300 with SGLang ([blog](https://pytorch.org/blog/serving-deepseek-v4-on-gb300-with-sglang-5x-higher-throughput-at-the-same-interactivity-since-day-0/)). **Waterfill & LPLB MoE load balancing**: Two dispatch-time load-balancing methods for DeepEP expert parallelism: Waterfill for shared-expert dispatch and LPLB for redundant expert replicas, improving throughput for DeepSeek-V3/R1 and DeepSeek-V4 ([blog](https://www.lmsys.org/blog/2026-06-26-waterfill-lplb)). **KDA CuteDSL prefill kernel on Blackwell (SM100)**: New CuteDSL prefill kernel for Kimi-Linear (KDA), 1.08-1.52x faster than the Triton path via a reusable scratch workspace, plus a cuda-graph padding fix ([#27488](https://github.com/sgl-project/sglang/pull/27488)); see the [Kimi-Linear cookbook](https://docs.sglang.io/cookbook/autoregressive/Moonshotai/Kimi-Linear). **Linear-attention prefix-cache memory savings**: An int8 checkpoint pool stores recurrent states compactly in the Mamba radix cache, substantially increasing prefix-cache capacity for KDA / GDN models ([#28185](https://github.com/sgl-project/sglang/pull/28185)); the speculative conv-window intermediate cache is deduplicated with a sliding-window layout, halving

阅读原始来源
来源
SGLang 发布 · 官方来源
来源发布
2026/06/27 06:57
来源更新
2026/06/27 07:02
首次采集
2026/09/19 12:56

本文为公开信息索引与摘要,详情及后续变化请以原始来源为准。

把 AI 雷达放到桌面

在支持安装的浏览器中,可以将本站作为应用打开。

安装入口取决于浏览器;应用和网站使用同一份最新内容。

查看完整安装指南