Skip to content
All tags

#source-evaluation

3 posts

Checking a Retelling: A Circulating Account of OpenAI's Red-Team Report Against the Original

Most of this retelling's facts match the original; the differences cluster in three places: turning "directed" into "worked out on their own," adding details the original does not have, and adding a pessimistic tone the original lacks.

AI Tools That Attack Others and Their Dual-Use Risk: How to Read the Evidence on Strix, Shannon, HexStrike and ARTEX

AI penetration-testing tools use an LLM as the attacker against ordinary software. They share two problems: the tool is itself an attack surface (a target can take it over through prompt injection, and HexStrike's server has no authentication), and once open-sourced, its use cannot be controlled (the same tool serves authorized testing and attacks alike, and the anti-abuse settings of ARTEX and HexStrike are defaults the operator can edit). When you read news that a tool was abused, ask who said so and whether the evidence is independent. The ARTEX incident has several vendor analyses, but some of them examine overlapping attacker infrastructure or cite each other, so they are not independent pieces of evidence.

How to Judge a Security Tool's Claims: OWASP Lists, Benchmarks and a Checklist for 'Merged into a Big Vendor'

When you see 'covers OWASP 10 of 10', 'merged into Microsoft and Cisco' or '9X% detection', ask five things: who said it, what the term means, who set the questions, what is being measured, and where the primary source is. The earlier posts and a few cases added here each happen to show one: Microsoft's toolkit itself says 7 full and 3 partial; of ATR's (an open-source set of agent threat-detection rules) merged PRs into Microsoft and Cisco, the three checked were all opened by its author; Cisco's own detection rate and an independent study's differ several-fold; common benchmarks score models or agents, not tools.