1M Novel Understanding Bench

A personal benchmark for evaluating ultra-long-context (million-token) comprehension using long-form web-novel reading comprehension as the task.

Source data & novel on GitHub ↗

Methodology

Leaderboard

Ongoing · Season 3 · NUB-5M Read-only agents · highest reasoning effort

All Models

View past seasons →

Problems

To avoid spoilers, the novel title and problems are not shown on this page.

Open GitHub repository ↗