Measuring reasoning invariance

JaggedBench: Measuring Reasoning Invariance via Automated Weakness Exploration

Reasoning looks strong—until the problem shifts slightly.

Automated Weakness Exploration exposes capability-adjacent failures hidden by aggregate benchmark scores.

Paper Soon Code Soon Leaderboard Soon
Verified variants
1,142
Models
22
Failure modes
18