Back to search
100
MCP live MCP 2026-07-28 http

Nonobench

mauricekleine/nonobench

An open-source benchmark of how well LLMs solve nonogram puzzles, from 5x5 to 20x20. Query every result through a REST API or MCP server.

Watch this dependency Share evidence report
Uptime
100.0%
5 direct probes · 30d
Response
523ms
last probe
Tools
11
callable
Resources
0
readable
Prompts
0
available
Primary URL
https://www.nonobench.com/mcp
Score: 100/100
Handshake verified by our own probe.
pass Answers the MCP handshake 50/50
The handshake and the list calls succeeded on the primary URL.
pass Lists tools, resources or prompts 30/30
11 tools, 0 resources, 0 prompts returned.
pass 3 or more catalogue items 10/10
11 items in total; 3 or more earns these points.
pass Describes itself 10/10
137 characters; more than 30 earns these points.

Tools · 11

get_leaderboard

Models ranked by accuracy; defaults to all effort levels for compatibility.

list_providers

Provider ids, names, families and variant counts.

list_families

Model families, available efforts and best variants.

compare_models

Side-by-side core overall and per-size accuracy, cost, latency and token results for model or family names.

get_model_results

Accuracy, cost, latency and token use for one model, broken down by grid size.

list_puzzles

The benchmark puzzles with their ids and row/column clues.

get_puzzle

One puzzle, including the clue text models were prompted with. The reference solution is only included on request; some puzzles have several valid solutions.

check_solution

Check a grid against a puzzle's clues, using the same rule as the benchmark grader. Reports which rows and columns do not match.

get_puzzle_results

Per-model outcomes for one puzzle. Answers are omitted unless requested.

get_model_puzzles

Which puzzles one model solved, missed, timed out on, or has not run.

list_runs

Individual benchmark runs (one model on one puzzle), optionally with the raw prompt and model output.

How to use

Claude Desktop or claude.ai: add a custom connector (Customize → Connectors; on Team and Enterprise plans an owner adds it under Organization settings → Connectors) with this server URL: https://www.nonobench.com/mcp

Cursor or Cline: add to your MCP config:

{
  "mcpServers": {
    "nonobench": {
      "url": "https://www.nonobench.com/mcp",
      "transport": "http"
    }
  }
}