Mistral: Mistral Nemo

Mistral: Mistral Nemo

Mistralai · pinned mistralai/mistral-nemo

Reproducibility

gateway_id:: mistralai/mistral-nemo
version_pinned:: mistralai/mistral-nemo
released_at:: 19 Jul 2024
last run:: 01 May 2026
temperature:: 0
top_p:: 1
seed:: unsupported
prompt_template_hash:: 5a732017979c

Score (WFT + Prompt): 21 / 40
Average of WFT and Prompt
WFT score: 22 / 40
43/80 raw
Prompt score: 19 / 40
Mean 0.473
WFT mean: 0.542
WFT stdev (sigma): 0.006
Result: Fail

Change from previous run

No earlier published WFT run yet.

Confidence interval

19.1-24.1

95% interval around 21.7 / 40, based on 130/240 answers.

Strong domains

WFT-Basis54% · 130/240

Weak domains

WFT-Basis54% · 130/240

Latest WFT run error types

Aggregated error categories only; no question text or raw model output.

Refusal rate: 0%
Parser errors: 0%

Type	Count	Rate
Parserfouten	0	0%
Refusals	0	0%
Timeouts	0	0%
Retry releases	0	0%
Failed jobs	0	0%

Score by CDFD learning objective

Objective	Correct	Total	%
WFT-Basis	130	240	54% below pass threshold

Score by advice product

Reis

68%

Zorg

63%

Rechtsbijstand

60%

AVP

35%

Auto

30%

Woning

23%

Advice product	Reviews	%
Reis	2	68% above pass threshold
Zorg	3	63% below pass threshold
Rechtsbijstand	1	60% below pass threshold
AVP	1	35% below pass threshold
Auto	1	30% below pass threshold
Woning	3	23% below pass threshold

Run history

Date	WFT score	Run
01 May 2026	22 / 40	combined

Model version policy

These fields show which model route, parser and dataset belong to this score.

Field	Value
Provider	Mistralai
Gateway	mistralai/mistral-nemo
Exact API model name	mistralai/mistral-nemo
Provider release date	19 Jul 2024
Test date	01 May 2026
Endpointtype	router
Model alias or snapshot	mistralai/mistral-nemo
Provider can silently change	onbekend
Seed supported	No
Tools disabled	Yes
System prompt	Empty
Parser version