SGLang 发布: v0.5.15

来源摘要

# Highlights **GLM-5.2 NVFP4, tuned for production**: We took time this cycle to tune GLM-5.2 NVFP4 on Blackwell for optimized production serving. It now runs at **500+ tok/s/user on 8x B300, 450 on 4x GB300** (bs=1). Run GLM-5.2 with our [cookbook](https://docs.sglang.io/cookbook/autoregressive/GLM/GLM-5.2). * **Spec V2 by default**: zero-overhead scheduling via CUDA-graphable DSA draft-extend, dropped D2H/H2D syncs, fused metadata ops. +11% end-to-end TPS ([#29413](https://github.com/sgl-project/sglang/pull/29413), [#29343](https://github.com/sgl-project/sglang/pull/29343), [#29166](https://github.com/sgl-project/sglang/pull/29166), [#29077](https://github.com/sgl-project/sglang/pull/29077)). * **IndexShare MTP**: reuses the indexer top-k across draft steps, up to 1.9x lower draft-step cost at long context ([#29959](https://github.com/sgl-project/sglang/pull/29959), [#29787](https://github.com/sgl-project/sglang/pull/29787), [#29654](https://github.com/sgl-project/sglang/pull/29654)). * **TopK V2**: fuses top-k selection with the page-table transform, runtime k up to 2048 ([#30274](https://github.com/sgl-project/sglang/pull/30274), [#26788](https://github.com/sgl-project/sglang/pull/26788)). * **Indexer prologue fusion**: 12 kernels to 4, ~8% faster decode at bs=1 ([#27705](https://github.com/sgl-project/sglang/pull/27705)). * **GEMM**: shape-specialized JIT router GEMM + CuteDSL BF16 GEMM for Blackwell ([#21531](https://github.com/sgl-project/sglang/pull/21531), [#30117](https://github.com/sgl-project/sglang/pull/30117)). * **FlashInfer autotune**: now covers draft-model graphs ([#29595](https://github.com/sgl-project/sglang/pull/29595)). **New Model Support**: [Hunyuan 3 (Hy3)](https://docs.sglang.io/cookbook/autoregressive/Tencent/Hy3), Hierarchical Reasoning Model