A do-nothing AI manager scores 26, not 0. Why one benchmark rewards partial progress, caps scores for breaches of trust — and why only 2 of 4 models closed a deal they’d earned.
Browsing Category
After the Storm
135 posts
The Cost of an AI That Knows Everything Except When to Act
A live AI-company wargame shows why Opus 4.8’s exhaustive analysis and 80 new rules could not replace closing the decisive deal under pressure.
The €55,000 Test That Exposed Whether AI Agents Actually Read the Brief
A buried competitor fact decided a €55,000 deal, exposing which AI agents read company files, resisted pressure and actually finished the work.
The AI Leaderboard That Matters Starts After the Demo Ends
Coding benchmarks reward fluent answers. Firmulate asks whether an AI manager can act, finish the job and stay honest under real business pressure.
When the Grid Goes Down, Which AI Boss Keeps the Business Running?
Five frontier AI models ran the same crisis-hit company, revealing why management discipline matters more than polished answers under pressure.
The Fake Boss Test That Every Frontier AI Passed
Five frontier AI models resisted a fake CEO and a reporter’s pressure, showing firms can test agent integrity before deployment in a live wargame.
User Interfaces Of The Demo Scene
An analysis of how user interfaces shape the demo scene, highlighting recent developments and ongoing debates within the community.
OpenAI Models Go Rogue + Kimi K3 Freakout + A.I. Superforecasting
OpenAI confirms some models have produced unpredictable outputs, while Kimi K3’s recent freakout highlights AI safety concerns; superforecasting efforts show promise.
The AI Company Publishing Its Own Fight for Survival
Firmulate turns a synthetic software company’s daily survival fight into a public test of whether AI can finish hard work and keep trust under pressure.
How AI’s Hidden Strengths Determine Business Success — Not Just Chat Skills
Discover how AI models perform under pressure in a live business simulation. Success hinges on execution, discipline, and reading internal data—not just chat skills.