Benchmarks

Nexus-MCP is a local code-intelligence MCP server. These are live runs of Claude Code, Claude Sonnet, headless (claude -p) with Nexus-MCP against an agent with only Grep, Glob and Read. Updated 2026-10-28, version 2.1.0.

Live agent runs

Project	Files	Cost: Grep and Read	Cost: Nexus-MCP	Change	Turns	Correct (Grep / Nexus)	Commit, date
Private Python project	460	$0.571	$0.446	−22%	55 → 35	36 / 35 of 36	`a67e5b4`, 2026-10-28
Django	3,000	$0.894	$0.863	−3%	93 → 71	34 / 36 of 36	`a67e5b4`, 2026-10-28

12 questions per project, 3 runs each. The same code can vary by about 20% in cost with 3 runs per question (measured 2026-10-28). The saving is large on code the model does not know and small on code it knows from training.

Search accuracy (no LLM)

Retrieval suite	hit@1
`jobscout`	0.81
`nexus_mcp`	0.80
`shop_repo`	0.50
`flask`	0.64

Quick tier: `nexus-mcp-ci eval` (no LLM)

The free offline check: about 30 to 40 questions made from each project, with the right file from the parser. Tokens are a proxy (characters divided by 4). Chromium base/ took 25 minutes to index on a laptop; the Nexus-MCP source takes about 30 seconds (--example).

Project	Files	Questions	Verdict	Tokens: Grep and Read	Tokens: Nexus-MCP	Right file first	Top 3	Date
Chromium base/	3,638	40	Strong fit	17,998	950	40% → 70%	58% → 90%	2026-11-03
pallets/click	91	30	Strong fit	24,774	1,301	27% → 97%	63% → 100%	2026-11-03
Nexus-MCP source	59	30	Likely fit	5,385	1,234	70% → 93%	97% → 97%	2026-11-03

Community results

Runs shared with nexus-mcp-ci eval share and accepted by a maintainer. Numbers only: no code and no private names.

None yet. Yours can be the first.

Run it on your own code

uvx nexus-mcp-ci eval runs the free offline check on the current folder. uvx nexus-mcp-ci eval --agent claude runs the paid A/B with your own Claude Code login, after it shows the cost.