跳到主要內容

NVIDIA Cosmos 3 Edge評測:40億參數機器人大腦跑進單張GPU | NVIDIA Cosmos 3 Edge Review: A 4B Robot Brain On One GPU

By Kit 小克 | AI Tool Observer | 2026-07-27

🇹🇼 NVIDIA Cosmos 3 Edge評測:40億參數機器人大腦跑進單張GPU

NVIDIA Cosmos 3 Edge 是 NVIDIA 在 SIGGRAPH 2026(7/20,洛杉磯)發表的開源世界模型,重點不是「更大」,而是「更小卻能跑在邊緣裝置上」。這是第一個小到能在邊緣硬體即時做機器人控制、同時還能理解眼前場景的開源世界模型,直接挑戰過去「模型能力」跟「邊緣效率」只能二選一的假設。

規格:4B 參數,15Hz 即時控制

Cosmos 3 Edge 核心只有 40 億參數,能吃進文字、圖片、影片、音訊與動作資料,理解物理場景後直接輸出機器人動作,在 Jetson Thor 上達到 15Hz、每次推論產生 32 個動作。架構上用了兩個 transformer 塔(自回歸 + 擴散)共享多模態注意力層,同時處理「理解」跟「生成動作」兩件事。

它還搭配一個 20 億參數的推理模組(由 NVIDIA Nemotron 驅動),可以獨立跑在 Jetson Orin 8GB 這種入門邊緣裝置上——等於把資料中心等級的推理能力真的搬到了工廠、倉庫、醫院現場,不用每次都把資料丟回雲端。

誰在測試它

  • Agile Robots、Doosan Robotics — 工業自動化機械手臂
  • Siemens — 智慧產線整合
  • Skild AI — 通用機器人策略蒸餾

NVIDIA 同時聲稱它在 VANTAGE-Bench(視覺分析基準)40 億參數級別排名第一,機器人策略學習表現也領先同級模型。權重、推理程式碼跟後訓練配方已經完整開源在 Hugging Face 上,可以在 Jetson、RTX PRO、DGX 甚至一般 GeForce RTX GPU 上跑。

為什麼這件事值得注意

過去做具身智慧(physical AI),機器人要嘛用小模型犧牲推理能力,要嘛把運算丟雲端犧牲延遲跟隱私。Cosmos 3 Edge 想證明的是這條路可以不用二選一——但要注意,NVIDIA 自己公布的基準測試,第三方獨立驗證還很少,「排名第一」目前主要是官方說法。而且這套東西高度綁定 NVIDIA 自家硬體生態(Jetson/RTX/DGX),對非 NVIDIA 邊緣裝置的開發者來說幫助有限。

好不好用,試了才知道。


🇺🇸 NVIDIA Cosmos 3 Edge Review: A 4B Robot Brain On One GPU

NVIDIA Cosmos 3 Edge is the open-weight world model NVIDIA unveiled at SIGGRAPH 2026 (July 20, Los Angeles) — and the headline isn't scale, it's the opposite. It's the first open world model small enough to run real-time robot control on edge hardware while still reasoning about the scene in front of it, directly challenging the old assumption that you have to trade model capability for edge efficiency.

The Specs: 4B Params, 15Hz Real-Time Control

The core model is just 4 billion parameters. It ingests text, images, video, audio, and action data, reasons about the physical scene, and outputs robot actions directly — hitting 15Hz with 32 actions per inference on a Jetson Thor. The architecture pairs two transformer towers (autoregressive + diffusion) sharing multimodal attention layers, handling perception and action generation together instead of as separate stages.

It ships with a companion 2B-parameter reasoning module (powered by NVIDIA Nemotron) that can run independently on hardware as modest as a Jetson Orin 8GB — meaning data-center-grade reasoning is now something you can actually deploy on a factory floor without shipping data back to the cloud.

Who's Already Testing It

  • Agile Robots, Doosan Robotics — industrial robotic arms
  • Siemens — smart factory integration
  • Skild AI — general-purpose robot policy distillation

NVIDIA claims it ranks #1 on VANTAGE-Bench for vision analytics among 4B-parameter models and leads in robot policy learning against similar-sized models. Weights, inference code, and post-training recipes are fully open on Hugging Face, deployable on Jetson, RTX PRO, DGX, and even consumer GeForce RTX GPUs.

Why This Matters

Physical AI has historically forced a choice: run a small model on-device and lose reasoning power, or offload to the cloud and eat the latency and privacy cost. Cosmos 3 Edge is NVIDIA's attempt to prove you don't have to choose — but the benchmark numbers are NVIDIA's own, and independent third-party validation is still thin. It's also tightly coupled to NVIDIA's hardware stack (Jetson/RTX/DGX), so it offers less to developers targeting non-NVIDIA edge silicon.

好不好用,試了才知道。

Sources / 資料來源

延伸閱讀 / Related Articles


AI 工具觀察站 — 每日精選 AI Agent 與工具趨勢
AI Tool Observer — Daily curated AI Agent & tool trends

留言

這個網誌中的熱門文章

Cursor vs GitHub Copilot vs Claude Code:AI 程式助手大比拼 | AI Coding Assistants Compared: Cursor vs GitHub Copilot vs Claude Code

Claude Code 實測:AI 幫你寫程式到底行不行? | Claude Code Review: Can AI Really Code for You?

Google Ironwood TPU v7 推理專用晶片解析:效能追平 NVIDIA、成本低 44%,AI 晶片戰爭正式開打 | Google Ironwood TPU v7 Explained: Matching NVIDIA Performance at 44% Lower Cost — The AI Chip War Heats Up