关注本地模型部署、推理引擎、量化和工作站运行工具。
# vLLM v0.25.0 Release Notes ## Highlights This release features 558 commits from 232 contributors (64 new)! * **Model Runner V2 is now the default for all dense models** (#44443). Building on quantized-model support from the previous release, MRv2 is now the
# Patch release v5.13.1 This patch is focused on enabling `transformers` for the latest release of vllm! - Be more defensive with remap_legacy_layer_types for custom models (#47245) from @hmellor - Fix custom code which doesn't know about the new linear layer
This is a patch release on top of [v1.27.0](https://github.com/microsoft/onnxruntime/releases/tag/v1.27.0), containing targeted bug fixes, a CUDA QMoE decode-path optimization, and CI/build infrastructure fixes. ## Bug Fixes - [MLAS] Fixed an `igemm` regressio
# Highlights **GLM-5.2 NVFP4, tuned for production**: We took time this cycle to tune GLM-5.2 NVFP4 on Blackwell for optimized production serving. It now runs at **500+ tok/s/user on 8x B300, 450 on 4x GB300** (bs=1). Run GLM-5.2 with our [cookbook](https://do
# Release v5.13.0 ## New Model additions ### KimiK 2.5, 2.6, and 2.7 This release includes the architecture for Kimi 2.5 which is used by 2.5-2.7: Kimi K2.5 is an open-source, native multimodal agentic model that advances practical capabilities in long-horizon
### Added - 💭 **Streamed reasoning display.** Models that emit thinking or reasoning now show that content as it streams, and it renders correctly in the chat overview and in exported conversations. [Commit](https://github.com/open-webui/open-webui/commit/0b7
# vLLM v0.24.0 Release Notes ## Highlights This release features 571 commits from 256 contributors (77 new)! * **MiniMax-M3**: Added support for the new **MiniMax-M3** model (#45381), with a fast follow-on of BF16/FP8 indexer via MSA (#45892), MXFP4 support (#
### Fixed - 🤝 **Shared folder read-only chats no longer sign users out.** Opening or reading chats from shared folders now keeps the current session active when a resource-level access error is returned, instead of incorrectly showing "Session expired. Please
### Added - 🤝 **Share folders with your team.** You can now share a folder and the chats inside it with specific users, groups, or everyone, with read or write access; people you share with see shared folders in their sidebar and open the chats in a read-only
# Highlights New Model Support: [GLM-5.2](https://docs.sglang.io/cookbook/autoregressive/GLM/GLM-5.2), [LiquidAI LFM2.5](https://docs.sglang.io/cookbook/autoregressive/LiquidAI/LFM2.5), [Kimi-K2.7-Code](https://docs.sglang.io/cookbook/autoregressive/Moonshotai
# Summary of improvements * Fixed issue ID 187077: YOLO26 fails to compile on GPU * Resolved an issue in NPU plugin with shared L0 command queue causing violation of app/inference priorities You can find OpenVINO™ toolkit 2026.2.1 release here: * [Download arc
## What's Changed * ci(webui): add format and build checks by @Premsenareddy in https://github.com/agentscope-ai/agentscope/pull/1821 * feat(omni): streaming audio + live captions for DashScope/OpenAI omni by @qbc2016 in https://github.com/agentscope-ai/agents
# Patch release v5.12.1 Updated the lower bound for PEFT and a fix for auto tokenizer to properly resolve the mistral tokenizer (when `mistral-common` is installed). This is similar to v.5.10.3 minus the fixes that were already included in the main release - v
Release v0.5.13.post1
# vLLM v0.23.0 Release Notes Please note that Minimax M3 is not yet supported in this version. Please follow [vLLM recipe](https://recipes.vllm.ai/MiniMaxAI/MiniMax-M3) for usage guides for M3. ## Highlights This release features 408 commits from 200 contribut
## Highlights **New Model Support**: - **Autoregressive**: [Nemotron 3 Ultra](https://docs.sglang.io/cookbook/autoregressive/NVIDIA/Nemotron3-Ultra) (Day-0, [blog](https://www.lmsys.org/blog/2026-06-04-nvidia-run-nemotron-3-ultra/)), [Step-3.7-Flash](https://d
## Highlights This release features 8 commits from 6 contributors (1 new)! v0.22.1 is a patch release on top of v0.22.0 with targeted bug fixes plus a couple of additions: new model support for JetBrains' Mellum v2, zentorch-accelerated quantized linear infere
### Added - 📦 **Official knowledge base sync tool.** A new companion tool from Open WebUI, oikb, keeps a knowledge base in sync with a local directory, GitHub repo, S3 bucket, Confluence space, or any of more than 40 other sources, uploading only new and chan
# ROCm 7.2.4 release notes ROCm 7.2.4 is a quality release focused on performance and stability fixes for AI inference workloads on AMD Instinct GPUs. - [Release highlights](#release-highlights) - [ROCm binaries](#rocm-binaries) ## Release highlights The follo
### Summary of major features and improvements * #### More GenAI coverage and framework integrations to minimize code changes * New models supported: Gemma 4 E2B and Gemma 4 E4B * Only on CPUs & GPUs: Qwen3-Coder-Next, Qwen3.5, Qwen3.6, Trinity-mini, LFM2-24B-
v0.5.12.post1 is a stability patch on top of v0.5.12. It cherry-picks 12 fixes — primarily for DeepSeek V4 — onto the release branch. # Bug Fixes ## DeepSeek V4 * DSV4-Pro emits garbled text during single-token decode on B200/B300 (fix `deep_gemm` UE8M0 scale-
### Added - 🛡️ **Redirect-based SSRF protection.** All outbound HTTP requests now block 3xx redirects by default via a new `AIOHTTP_CLIENT_ALLOW_REDIRECTS` environment variable, preventing redirect-based SSRF where a public URL silently redirects to internal
### Fixed - 📜 **Chat scroll position on load.** Opening a chat conversation now reliably scrolls to the bottom of the message history, fixing a regression caused by `content-visibility: auto` where estimated element sizes prevented the initial scroll from rea
### Summary of major features and improvements * #### More GenAI coverage and framework integrations to minimize code changes * New models supported on CPUs & GPUs: Qwen3 VL * New models supported on CPUs: GPT-OSS 120B * Preview: Introducing the OpenVINO backe
### Summary of major features and improvements * #### More GenAI coverage and framework integrations to minimize code changes * New models supported on CPUs & GPUs: GPT-OSS-20B, MiniCPM-V-4_5-8B, and MiniCPM-o-2.6 * New models supported on NPUs: MiniCPM-o-2.6
* Preview: NPU compiler integration with the NPU plugin enables ahead-of-time and on-device compilation without relying on OEM driver updates. This feature is enabled by default in this release package. * Known Issues * Component: optimum; ID: 179936 Descripti
> **_NOTE:_** Please continue using OpenVINO 2025.4 release unless you require the specific bug fixes addressed in the 2025.4.1 version. # Summary of improvements * Preview: Mixture of Experts (MoE) models optimized for CPUs and GPUs, validated for GPT-OSS 20B
### Summary of major features and improvements * #### More GenAI coverage and framework integrations to minimize code changes * **New models supported:** * On CPUs & GPUs: **Qwen3-Embedding-0.6B, Qwen3-Reranker-0.6B, Mistral-Small-24B-Instruct-2501.** * On NP
This release is meant to fix the following issues (regressions / silent correctness): ### Tracked Regressions Significant Memory Regression in F.conv3d with bfloat16 Inputs in PyTorch 2.9.0 ([#166643](https://github.com/pytorch/pytorch/issues/166643)) This rel
# PyTorch 2.8.0 Release Notes - [Highlights](#highlights) - [Backwards Incompatible Changes](#backwards-incompatible-changes) - [Deprecations](#deprecations) - [New Features](#new-features) - [Improvements](#improvements) - [Bug fixes](#bug-fixes) - [Performan
