Ollama 发布: v0.34.1-rc2: API: Deprecate typical_p (#18448)
Drop support for creating new models with typical_p parameters, while retaining support for existing GGUF models with the setting.
接入 API · 个人 AI 解读连接自己的模型解读资讯，浏览新闻无需配置。
本地 AI 部署
关注本地模型部署、推理引擎、量化和工作站运行工具。
120 条资讯按来源发布或更新时间排序
Ollama 发布: v0.34.1-rc1
mlx: add mlx patch to docker build context (#18440)
Claude Code 发布: v2.1.269
## What's changed - Added `claude plugin eval`: run a plugin's eval suite against Claude Code and get scored, reproducible results (JSON + HTML report); see `claude plugin eval --help` - Added `/output-style [name]` to list and switch output styles, including
vLLM 发布: v0.29.0
# v0.29.0 ## Highlights This release features 594 commits from 277 contributors (91 new)! * **Model Runner V2 is now the default for all models** (#53183), completing the rollout that began with pooling models (#48290). MRV2 also gained CUDA graph memory profi
ONNX Runtime 发布: ONNX Runtime v1.30.0
ONNX Runtime 1.30.0 expands generative AI inference, improves CPU and GPU performance, adds Go bindings, and strengthens runtime reliability. These notes cover changes since ONNX Runtime 1.29.1. ## Highlights - Expanded CUDA inference support with variable-len
d-Matrix Adopts NVIDIA NVLink Fusion for Rack-Scale XPU Deployment
AI inference chipmaker d-Matrix today announced it will use NVLink Fusion to connect its next-generation Raptor XPUs to NVIDIA’s AI infrastructure platform — joining a growing roster of ecosystem partners. By connecting Raptor to NVIDIA NVLink scale-up and Spe
Ollama 发布: v0.34.0
## Use Ollama models in ChatGPT Desktop Ollama models can now be used directly in ChatGPT Desktop, so you can keep your existing workflow while running open models. Setup is available from the Ollama app on MacOS. This release also improves structured output p
ONNX Runtime 发布: ONNX Runtime v1.29.1
This is a patch release on top of [v1.29.0](https://github.com/microsoft/onnxruntime/releases/tag/v1.29.0), containing GroupQueryAttention capability and KV-cache layout improvements, plugin Execution Provider performance tooling updates, and targeted graph an
DeepSeek-V4.1-Flash Release
来源标注日期：2026-09-10（未提供具体时刻）。 Today, we officially release the DeepSeek-V4.1-Flash model. It is the smallest model in our new architecture family, with native multimodal visual understanding. The new architecture is designed for a higher capability ceiling, fast
High-Throughput Structure Prediction with BioNeMo Inference Runtime
Biomolecular structure prediction is now often run at proteome scale, where the goal is to move an entire worklist through the pipeline efficiently. NVIDIA...
When to Use Encode-Prefill-Decode Disaggregation to Accelerate Multimodal Model Serving
Encode-prefill-decode (EPD) disaggregation is an inference optimization technique for multimodal models that separates the vision encoder stage from the prefill...
SGLang 发布: v0.5.19
# Highlights *786 PRs from 214 contributors.* **New models in this release** (see the [cookbook](https://docs.sglang.io/cookbook) for all supported models): | Model | Type | PRs | Cookbook | |---|---|---|---| | Qwen3.8 (2.4T-A95B) | Autoregressive | [#35758](h
CrewAI 发布: 1.15.19
## What's Changed ### Features - Add Clipper integrations client - Add `now()` to the CEL expression environment - Record how a crew run ended for every user - Report machine size as a coarse band, not a core count - Add injectable client for CrewAI platform t
Ollama 发布: v0.33.3
## What's Changed * gemma4 now supports images and audio on MLX engine * Report cached prompt tokens * Honor GGUF model defined default parameters * MLX, MLX-C, llama.cpp update ## New Contributors * @marcelpetrick made their first contribution in https://gith
Sparks Fly: NVIDIA Accelerates Local AI at IFA 2026
Frontier intelligence is going local. At IFA 2026, NVIDIA, Microsoft and its partners are teaming up to provide faster inference and new tools that make agents easier to set up and run locally on NVIDIA hardware. New compact NVIDIA RTX Spark Windows PCs are al
ONNX Runtime 发布: ONNX Runtime v1.28.2
This is a patch release on top of [v1.28.1](https://github.com/microsoft/onnxruntime/releases/tag/v1.28.1), containing a targeted fix for Compile API model serialization. ## Highlights ### Bug Fixes - Fixed Compile API callback serialization to prevent duplica
Co-Designing AI Models Using Speculative Decoding for Faster LLM Inference
This post is the third in a series on AI model co-design. It explores how to accelerate LLM inference while maintaining accuracy using speculative decoding and...
NVIDIA PAIR Virtual Inference Router Expands Available Compute on Your Local Network
AI agents are learning to do more by working together. A lead agent can break a complex task into smaller jobs and assign those jobs to specialized subagents....
Degraded performance on platform.claude.com and Claude for Microsoft Office 365
Sep 1, 18:07 UTC Resolved - This issue has been resolved. Sep 1, 17:52 UTC Monitoring - We are seeing success rates recover across affected services. Core inference and the API are not impacted. Sep 1, 17:05 UTC Investigating - We are investigating reports of
How NVIDIA Groq 3 LPX Unlocks Ultrafast Interactivity at Long Context on NVIDIA Vera Rubin
NVIDIA Groq 3 LPX is the interactive AI inference accelerator for the NVIDIA Vera Rubin platform. At the core of the platform is NVIDIA Vera Rubin NVL72, the...
How to Size GPUs for AI Inference and TCO Without Overspending
The surge in AI adoption is transforming everything from chatbots to content generation. Still, a common pain point remains: How can organizations confidently...
Open WebUI 发布: v0.11.3
### Added - ♿ **Accessibility mode reaches the menus.** Accessibility mode now marks the menu entry you are pointing at and the model already chosen with a stronger background, across the dropdown menus, their submenus, and the model picker together with its f
Open WebUI 发布: v0.11.2
### Added - 🖼️ **Richer previews for terminal files.** Word documents and slide decks produced in the terminal are now previewed as the finished document rather than an approximation, and every document preview gains a page strip down the side with numbered t
Ollama 发布: v0.33.2
## What's Changed * Ollama's app now follows the system appearance again, restoring dark mode support * Fixed the macOS app to properly hand off to an already-running instance instead of starting a second one * The Claude Desktop proxy no longer interrupts in-
Deploy an Open Model from Checkpoint to Inference in Two Commands with NVIDIA TensorRT Model Connect
Open AI models are evolving faster than ever, but bringing them into native applications can still require model-specific conversion, preprocessing,...
Ollama 发布: v0.33.1
## What's Changed * MLX: Qwen3.8 Flash Next support * cmake: make external compat patches idempotent * MLX and llama.cpp update * mlxrunner: add structured output support * mlxrunner: avoid Metal GPU timeouts when loading models from slow storage ## New Contri
Transformers 发布: Release: v5.16.0
# Release v5.16.0 ## New Model additions ### Qwen4-Exp Qwen4-Exp builds on Qwen3.5's hybrid text and multimodal architecture with three key components: GatedResidual (GR), Qwen Sparse Attention (QSA), and Per-Layer Embedding (PLE). GR is a Qwen-developed resid
Intel OpenVINO 发布: 2026.3.1
### Summary of major features and improvements * Functionally enabled Muse-Glimmer-30B model: * Model card and IR available: [OpenVINO/Muse-Glimmer-30B-int4-ov · Hugging Face](https://huggingface.co/OpenVINO/Muse-Glimmer-30B-int4-ov) * Notebooks to try: * [Mus
vLLM 发布: v0.28.0
# v0.28.0 ## Highlights This release features 584 commits from 270 contributors (76 new)! * **Kimi-K3 performance push**: a major optimization effort for Kimi-K3 across the stack — Decode Context Parallel (DCP) support (#50484), fused FlashKDA decode and prefi
Ollama 发布: v0.33.0
## What's Changed ### Claude Desktop Developers can now easily configure Claude Desktop to seamlessly work with Ollama as a third-party gateway provider. ### Improved caching * Fixed a hang where agent clients that cancel long prefills * Prefill restore points