Skip to content
← Compared

Mouse-1 vs Darwin-27B-ZTC

Mouse-1 has the higher average on the four public tool benchmarks, driven by phishing detection. Darwin is far ahead on When2Call and ships open weights.

Mouse-1 is the more balanced model: 84.9% against 81.1% on the four public tool benchmarks, with a 21.7-point lead on phishing detection. Darwin is the better pick if When2Call-style triage is all you need and you want to host the weights yourself.

Darwin-27B-ZTC comes from FINAL-Bench. It is a 27B open-weight model that reads decisions off a zero-token head, with a fitted calibration temperature, released on Hugging Face in October 2026. Mouse-1 is a hosted decision API.

At a glance

Mouse-1Darwin-27B-ZTC
Public tool benchmarks (avg of 4)84.9%81.1%
PhishNChips72.3%50.6%
When2Call85.8%92.2%
How you run itHosted APISelf-host (~54 GB BF16)
WeightsClosedOpen, Apache 2.0
Zero data retentionDefaultYours to run
Calibration fitting, fine-tuning/v1/calibrations, /v1/tuningsDo it yourself
Prompt-injection resultsPublished: 0% flippedNone published

Public tool benchmarks

Public tool benchmarks

Average of BFCL, API-Bank, When2Call and PhishNChips (%) · Higher is better

Public tool benchmarks, Average of BFCL, API-Bank, When2Call and PhishNChips (%)
Mouse-184.9%
Darwin-27B-ZTC81.1%
BFCL

Function calling, exact match (%) · Higher is better

BFCL, Function calling, exact match (%)
Mouse-197.6%
Darwin-27B-ZTC96.7%
API-Bank

Next API out of 53 (%) · Higher is better

API-Bank, Next API out of 53 (%)
Darwin-27B-ZTC84.8%
Mouse-183.7%
When2Call

Answer, call, ask or decline (%) · Higher is better

When2Call, Answer, call, ask or decline (%)
Darwin-27B-ZTC92.2%
Mouse-185.8%
PhishNChips

Phishing or legitimate email (%) · Higher is better

PhishNChips, Phishing or legitimate email (%)
Mouse-172.3%
Darwin-27B-ZTC50.6%

The two models fail in different places. Darwin is the best When2Call model in this comparison set (92.2%), but scores 50.6% on PhishNChips, where 50% is a coin flip. So on phishing-or-legitimate emails it is close to guessing. Mouse-1 is less extreme: lower on When2Call, much higher on PhishNChips, slightly higher on BFCL.

For an agent that reads inbound text and decides what is safe, the phishing gap is the one to weigh. It is the same kind of judgment as "is this instruction in a web page trying to steer me?"

One caution from Darwin's own card: it was trained in part on the train and dev splits of public decision benchmarks. Benchmark scores can flatter a model trained that close to the test distribution. The board also notes that Darwin's answers near a tie vary slightly between runs.

How we measured

  • Darwin's scores are from the Jev Decision Index board as of October 20, 2026. Mouse-1 is not on the board; its scores come from our own run of the board's kit on the same rows.
  • We have not run Darwin through our agent decision suites.

Sources

Checked October 20, 2026.

See also: Mouse-1 vs Torchcast Decision 27B · Mouse-1 vs Decider 31B · All comparisons

FAQ

Is Mouse-1 better than Darwin-27B-ZTC?

On average across the four public tool benchmarks of the Jev Decision Index, yes: 84.9% against 81.1%. Mouse-1 leads on BFCL and by a wide margin on PhishNChips (72.3% vs 50.6%). Darwin leads on When2Call (92.2% vs 85.8%) and API-Bank.

Is there a hosted API for Darwin-27B-ZTC?

We found none as of October 20, 2026. Darwin is published as Apache 2.0 weights (about 54 GB in BF16) for you to serve. Mouse-1 is a hosted API.

What is Darwin-27B-ZTC trained on?

Its model card says it is a full fine-tune of FINAL-Bench's Darwin-27B-RSI with a zero-token readout head, trained partly on the train and dev splits of public decision benchmarks.