xAI’s Grok 4.6 is now available in Amazon Bedrock

AWS 机器学习 · 发布 2026/09/22 02:30

今日摘要使用自己的 API，仅供个人查看

来源摘要

xAI's Grok 4.6 is now available in Amazon Bedrock: a frontier model for long-running agents, coding, and knowledge work, with a 500K token context window and four reasoning effort levels. It runs on both the bedrock-mantle and bedrock-runtime endpoints, with Converse API and cross-Region inference support.

阅读原始来源

来源: AWS 机器学习 · 官方来源
来源发布: 2026/09/22 02:30
首次采集: 2026/09/22 05:59

本文为公开信息索引与摘要，详情及后续变化请以原始来源为准。

Simplifying Model Serving Across Multiple GPUs with NVIDIA TensorRT Multi-Device Integration in NVIDIA Dynamo-Triton

The compute and memory demands of generative AI increasingly exceed what a single GPU can provide. NVIDIA TensorRT multi-device inference is a new capability...

来源更新 2026/09/22 05:51国际查看原文

算力与芯片llama.cpp 发布官方来源

llama.cpp 发布: b11081

test-llama-archs : make tensor data stdev configurable and improve help (#29133) * test-llama-archs : make tensor data stdev configurable Assisted-by: pi:llama.cpp/DeepSeek-V4-Flash-Vision-Exp * test-llama-archs : expand usage and add examples Assisted-by: pi:

来源更新 2026/09/22 03:54国际查看原文

算力与芯片llama.cpp 发布官方来源

llama.cpp 发布: b11080

tests/test-backend-ops : allow regex entries in the -o filter (#29204) * tests/test-backend-ops : allow regex entries in the -o filter so far -o only accepted a comma separated list of exact op names or full test case strings. entries that are not plain op nam

来源更新 2026/09/22 03:21国际查看原文

算力与芯片llama.cpp 发布官方来源

llama.cpp 发布: b11078

args: add env vars for temperature, top-p, min-p and penalties (#27380) Allow configuring --temp, --top-p, --min-p, --repeat-penalty, --presence-penalty and --frequency-penalty via LLAMA_ARG_* so llama-server can be fully controlled from an EnvironmentFile (e.

来源更新 2026/09/22 02:52国际查看原文

算力与芯片NVIDIA 开发者官方来源

Benchmarking LLM Inference at Scale with AIPerf

You’re deploying a model on a system. It starts up, prompts are getting responses. Now the hard question: Is this fast? Your instincts might lead you to send...

来源更新 2026/09/22 02:45国际查看原文