跳到主要內容

GPT-Red解析:OpenAI靠AI互打,提示注入攻擊率砍到剩0.05% | GPT-Red: OpenAI's AI Red-Teams Its Own Models

By Kit 小克 | AI Tool Observer | 2026-07-26

🇹🇼 GPT-Red解析:OpenAI靠AI互打,提示注入攻擊率砍到剩0.05%

GPT-Red 是 OpenAI 內部打造的自動化紅隊 AI,專門用來攻擊自家模型、挖出提示注入(prompt injection)漏洞。根據 OpenAI 於 2026 年 7 月中公布的研究,GPT-Red 在測試中找到有效攻擊手法的成功率高達 84%,遠勝人類紅隊測試員的 13%;而經過 GPT-Red 反覆鍛鍊後,新版旗艦模型 GPT-5.6 Sol 對直接提示注入攻擊的失敗率已降到僅剩 0.05%

GPT-Red 怎麼練成:AI 對打 AI 的自我對弈

GPT-Red 的訓練方式是自我對弈強化學習(self-play RL):一個攻擊模型與一群防禦模型同時訓練,攻擊方只要成功誘導防禦方偏離原始任務(例如洩漏機密資料、竄改程式碼、產生有害輸出)就能拿到獎勵,防禦方則因抵擋成功、完成任務而獲得獎勵。雙方在無數輪對抗中互相進化,攻擊手法越來越刁鑽,防禦也越來越紮實。

關鍵數據:提示注入攻擊率暴跌

  • 舊版 GPT-5.1 面對進階攻擊,成功率一度高達 95%
  • GPT-5.6 Sol 經 GPT-Red 鍛鍊後,同類攻擊成功率降到 10% 以下
  • 經典的「假思維鏈(fake chain-of-thought)」誘導攻擊,成功率同樣從 95% 摔到不到一成
  • 直接提示注入的失敗率僅 0.05%,等於千次攻擊只有半次得逞

為什麼這件事對開發者很重要

提示注入是目前 AI Agent 最現實的資安風險——只要在網頁、郵件或文件裡藏一句話,就可能騙過代理人執行未授權操作。GPT-Red 的意義在於把「紅隊測試」這件原本仰賴人力、成本高又覆蓋率有限的工作自動化並規模化,讓防禦速度追上攻擊手法演進的速度。這對正在把 ChatGPT Agent、Operator 等工具接進生產環境的團隊來說,是一個具體可驗證的安全性進步,而不只是行銷話術。

當然,0.05% 不代表零風險——面對足夠多次嘗試,或是尚未被 GPT-Red 涵蓋的全新攻擊手法,防線仍可能被突破。企業導入 AI Agent 時,還是該搭配權限最小化、輸出稽核等傳統防禦層,而非單靠模型本身的韌性。

好不好用,試了才知道。


🇺🇸 GPT-Red: OpenAI's AI Red-Teams Its Own Models

GPT-Red is OpenAI's internal automated red-teaming AI, built specifically to attack its own models and hunt for prompt injection vulnerabilities. According to research OpenAI published in mid-July 2026, GPT-Red found successful attack techniques 84% of the time in testing, versus just 13% for human red-teamers. After being hardened through repeated rounds against GPT-Red, the new flagship model GPT-5.6 Sol now fails to direct prompt injection attacks only 0.05% of the time.

How GPT-Red Was Trained: AI vs. AI Self-Play

GPT-Red is trained via self-play reinforcement learning: an attacker model and a pool of defender models train simultaneously. The attacker is rewarded for successfully diverting a defender from its original task -- leaking confidential data, sabotaging code, or producing harmful output. The defender is rewarded for resisting the attack and completing its task anyway. Over countless rounds, attacks get sharper and defenses get tougher in lockstep.

The Numbers: Prompt Injection Success Rates Collapse

  • Older GPT-5.1 saw advanced attack success rates as high as 95%
  • GPT-5.6 Sol, hardened by GPT-Red, brought the same attacks down to under 10%
  • The classic "fake chain-of-thought" attack also fell from 95% success to under 10%
  • Direct prompt injection now fails only 0.05% of the time -- roughly one in two thousand attempts

Why This Matters for Developers

Prompt injection is the most realistic security risk facing AI agents today -- a single hidden instruction buried in a webpage, email, or document can trick an agent into taking unauthorized actions. What makes GPT-Red notable is that it automates and scales red-teaming, a job that previously depended on expensive, limited-coverage human testers, letting defenses keep pace with how fast attack techniques evolve. For teams shipping agentic tools like ChatGPT Agent or Operator into production, this is a concrete, measurable security improvement rather than marketing language.

That said, 0.05% isn't zero -- given enough attempts, or a genuinely novel technique GPT-Red hasn't seen, defenses can still be breached. Teams deploying AI agents should still pair model robustness with traditional layers: least-privilege permissions, output auditing, and human review for high-stakes actions.

You won't know until you try it.

Sources / 資料來源

延伸閱讀 / Related Articles


AI 工具觀察站 — 每日精選 AI Agent 與工具趨勢
AI Tool Observer — Daily curated AI Agent & tool trends

留言

這個網誌中的熱門文章

Cursor vs GitHub Copilot vs Claude Code:AI 程式助手大比拼 | AI Coding Assistants Compared: Cursor vs GitHub Copilot vs Claude Code

Claude Code 實測:AI 幫你寫程式到底行不行? | Claude Code Review: Can AI Really Code for You?

Stanford 研究登上《Science》:11 個 AI 模型有 47% 機率說你對,即使你錯了 | Stanford Study in Science: AI Models Validate Harmful Behavior 47% of the Time — Sycophancy Is a Real Problem