1Gemini 4 Carbon
No. 1 — Gemini 4 Carbon. On the lists of 8 of 10 AIs; median place there: 1.5. It has the best published scores at finding and fixing flaws, though only Google ran the tests and almost nobody can use it.
Did you know
Fairwind applicants face background checks. Approved teams must be internal security, incident-response or penetration-testing staff, and their organizations must track how the model is used. Dual-use work such as malware analysis is allowed only for defensive or academic purposes.
- What it is
- Google's top security model, open only to vetted Fairwind defenders.
- Its edge
- Highest fix rate here, 71% on CWE-bench, and 88.2% at finding flaws.
- Who it suits
- Suits vetted Fairwind security teams; small firms and the public cannot get it yet.
- CWE-bench flaws fixed71.0% on CWE-bench
Why it is here
The version with cyber limits removed goes only to Google's own teams and security groups cleared through Fairwind. Fairwind had 650+ organizations at launch, and the public gets the model "as soon as possible" with no date given.
Keep in mind
Bloomberg reported that Google employees with access say the model does worse on real coding tasks than the benchmarks suggest. Google told Bloomberg that this is inaccurate. I found no independent hands-on tests.