Measuring reasoning invariance
JaggedBench: Measuring Reasoning Invariance via Automated Weakness Exploration
Reasoning looks strong—until the problem shifts slightly.
Automated Weakness Exploration exposes capability-adjacent failures hidden by aggregate benchmark scores.
Paper Soon
Code Soon
Leaderboard Soon
- Verified variants
- 1,142
- Models
- 22
- Failure modes
- 18