↓ Skip to main content

AI Tools

Anthropic Never Published a SWE-bench Pro Score for Opus 5. So Where's the 79.2% Coming From?

·901 words·5 mins

A 79.2% SWE-bench Pro figure for Claude Opus 5 has been circulating since launch — but Anthropic’s own announcement never cites one, and Scale AI’s actual public leaderboard doesn’t list Opus 5, Fable 5, Mythos 5, or even Opus 4.8. The number traces back to a secondary aggregator whose own methodology page warns against treating it as verified.

Qwen3.8-Max Finally Ships a Benchmark Table — and It's a Mixed Picture

·1128 words·6 mins

Alibaba’s Qwen3.8-Max went from a bare parameter count to a full benchmark table on August 3 — $2/$6 per million tokens, 67.7% SWE-bench Pro, and a two-point Terminal-Bench 2.1 win over Claude Fable 5. Every number is still self-reported: no independent lab has scored it yet, and open weights remain a promise for the week of August 10.

GitHub Copilot Bolts On Grok 4.5 While Microsoft Promises to Someday Unify the Mess

·933 words·5 mins

GitHub added xAI’s Grok 4.5 to Copilot on July 28 — a 500K-context model bolted onto an already multi-model picker. A day later, Satya Nadella told investors Microsoft is building one unified app to merge Copilot Chat, GitHub Copilot, Copilot Cowork, and Autopilot, sometime in 2026. That roadmap gap is the whole story.

MCP's Stateless Spec Just Shipped for Real — and This Time It Wasn't Late

·1171 words·6 mins

The Model Context Protocol’s 2026-07-28 specification finalized on schedule, locking in a stateless protocol core, Multi Round-Trip Requests, header-based gateway routing, and hardened OAuth — with Tier 1 SDKs already at general availability and close to half a billion downloads a month across them.

Kimi K3's Weights Are Open. Its License Isn't What Anyone Reported.

·1051 words·5 mins

Moonshot AI shipped Kimi K3’s full weights on July 27 — 2.8T total parameters, 104B active, 1M context, the largest open-weight release to date. But the license isn’t the ‘Modified MIT’ terms that circulated before launch: it’s a bespoke document with a $20M MaaS revenue gate and a mandatory UI-branding clause above 100M MAU, and several outlets reported the permissive version anyway.

SharedRoot: Anthropic Closed the Claude Cowork Sandbox-Escape Report as 'Informative'

·1039 words·5 mins

Security firm Accomplish disclosed SharedRoot on July 23: a six-step exploit chain that escapes Claude Cowork’s local macOS sandbox and reads/writes anywhere on the host filesystem, affecting an estimated 500,000 local-execution users. Anthropic closed the report as ‘Informative’ without shipping a fix — the exposure is only sidestepped because Cowork now defaults to cloud execution, leaving anyone who opts into local mode still exposed.

AI Coding Agents Beat SQL Injection. Authorization at Scale Is the New Failure Mode.

·1085 words·6 mins

A new Theori study built 28 apps with five frontier AI models and confirmed 434 exploitable vulnerabilities after deduplication and PoC testing. SQL injection and XSS were nearly absent — but resource-exhaustion bugs, hardcoded secrets, and authorization gaps that double in larger codebases (11% to 28%) are the new failure modes agentic coding tools haven’t solved.

Claude Code v2.1.215–216: /verify and /code-review Stop Auto-Running, and a Worktree Isolation Bug Gets Closed

·1140 words·6 mins

Claude Code v2.1.215 stops auto-running /verify and /code-review, putting review invocation back under explicit developer control. v2.1.216 follows a day later with a real isolation fix — worktree-isolated subagents could redirect git into the shared checkout via git -C or GIT_DIR — plus a quadratic-slowdown fix and a new sandbox.filesystem.disabled setting.