PERIT-STT · Leaderboard

Speech recognition, measured against human experts

Ranked by word error rate. Switch tabs to see accuracy, the kind of error, robustness on hard clips, clip length, and what each model costs to run.

Back to the overview Put your model on the board

Rank	Model	Word Error Rate	Character Error Rate	Word Accuracy	Exact Match Rate	Price per 1,000 min	Median Latency
01	qwen3-asr-flash-2026-02-10Qwen	0.91%0.56–1.33	0.50%	99.09%	78.0%	$2.03	9.3 s
02	transcribe-1Fish Audio	1.28%0.79–1.83	0.74%	98.72%	70.0%	$6.27	7.1 s
03	mai-transcribe-1.5Microsoft	1.33%0.88–1.84	0.63%	98.67%	71.0%	$6.27	7.5 s
04	qwen3-asr-0.6bQwen	1.36%0.90–1.94	0.64%	98.64%	71.0%	$0.20	6.7 s
05	qwen3-asr-1.7bQwen	1.36%0.87–1.86	0.75%	98.64%	70.0%	$0.45	5.8 s
06	chirp-3Google	1.45%1.01–1.94	0.78%	98.55%	65.0%	$16.72	9.9 s
07	mai-transcribe-2Microsoft	1.45%0.99–1.94	0.80%	98.55%	69.0%	$1.74	7.8 s
08	universal-3-5-proAssemblyAI	1.48%1.01–1.94	0.70%	98.52%	67.0%	$3.75	10.3 s
09	muse-voice-transcribe-1.0Meta	1.48%1.00–2.11	0.75%	98.52%	66.0%	$3.01	10.0 s
10	gpt-transcribeOpenAI	1.59%1.07–2.15	0.91%	98.41%	68.0%	$4.70	8.3 s
11	grok-stt-1.0xAI	1.65%1.19–2.20	0.83%	98.35%	62.0%	$1.67	7.5 s
12	gpt-4o-mini-transcribeOpenAI	1.82%1.22–2.42	1.06%	98.18%	66.0%	$1.75	10.5 s
13	voxtral-mini-transcribeMistral AI	1.96%1.42–2.52	1.07%	98.04%	55.0%	$2.89	8.6 s
14	parakeet-tdt-0.6b-v3NVIDIA	1.99%1.45–2.55	1.03%	98.01%	61.0%	$1.50	7.0 s
15	nova-3Deepgram	2.06%1.55–2.64	1.19%	97.94%	51.5%	$4.30	8.0 s
16	whisper-1OpenAI	2.13%1.55–2.76	1.22%	97.87%	58.0%	$6.27	8.3 s
17	voxtral-mini-3b-2507Mistral AI	2.24%1.56–3.04	1.43%	97.76%	57.0%	$1.00	7.3 s
18	voxtral-small-24b-2507-sttMistral AI	2.27%1.60–3.08	1.32%	97.73%	53.0%	$3.00	9.4 s
19	whisper-large-v3-turboOpenAI	2.33%1.76–3.04	1.42%	97.67%	49.0%	$0.23	8.5 s
20	whisper-large-v3OpenAI	2.35%1.75–3.08	1.49%	97.65%	50.0%	$1.59	7.6 s
21	nemotron-3.5-asr-streaming-multilingual-0.6bNVIDIA	3.12%2.31–4.08	1.59%	96.88%	52.0%	$0.20	10.0 s
Accuracy Word Error Rate (WER) 3.12%#21/22 WER 95% CI (low) 2.31%#21/22 WER 95% CI (high) 4.08%#21/22 Word Accuracy 96.88%#21/22 Character Error Rate (CER) 1.59%#21/22 Strict WER 6.83%#21/22 Match Error Rate (MER) 3.11%#21/22 Word Information Lost (WIL) 4.48%#21/22 Word Information Preserved (WIP) 95.52%#21/22 Error breakdown Substitution Rate 1.39%#22/22 Deletion Rate 1.50%#21/22 Insertion Rate 0.23%#5/22 Sentence Error Rate (SER) 48.0%#18/22 Exact Match Rate 52.0%#18/22 Length Ratio 0.987×#21/22 Robustness Mean WER 4.81%#19/22 Median WER 0.00%#1/22 P90 WER 9.54%#21/22 Severe Error Rate 1.0%#7/22 Empty Output Rate 1.0%#19/22 Success Rate 100.0%#1/22 By clip length WER - short audio (under 5 s) 3.05%#16/22 WER - medium audio (5 to 15 s) 4.12%#21/22 WER - long audio (over 15 s) 2.25%#22/22 Cost & speed Price per 1,000 min $0.20#1/22 Total Cost $0.0041#1/22 Median Latency 10.0 s#19/22 P95 Latency 54.2 s#4/22 Real-Time Factor (median) 0.96×#18/22
22	gpt-4o-transcribeOpenAI	3.94%2.64–5.75	2.92%	96.06%	47.0%	$3.44	6.8 s

Blue marks the best value in each column. Open a model for all 29 metrics and where it places on each.Showing 22 of 22

Best on each axis

The winners, one question at a time.

Most accurate: 0.91%Word Error Rate (WER)qwen3-asr-flash-2026-02-10Qwen
Lowest character error: 0.50%Character Error Rate (CER)qwen3-asr-flash-2026-02-10Qwen
Most exact matches: 78.0%Exact Match Rateqwen3-asr-flash-2026-02-10Qwen
Most robust: 4.08%P90 WERqwen3-asr-flash-2026-02-10Qwen
Fewest dropped words: 0.34%Deletion Ratemai-transcribe-1.5Microsoft
Fewest invented words: 0.17%Insertion Ratevoxtral-small-24b-2507-sttMistral AI
Lowest price: $0.20Price per 1,000 minnemotron-3.5-asr-streaming-multilingual-0.6bNVIDIA · tied with qwen3-asr-0.6b
Fastest: 5.8 sMedian Latencyqwen3-asr-1.7bQwen

Glossary

What every column means.

Rates are pooled across all clips unless the name says mean, median or P90. Every metric is computed after the same normalization on both the reference and the model output.

Accuracy

Word- and character-level agreement with the reference, after normalization — and without it.

Word Error Rate (WER)% · lower is better: Headline metric. (substituted + deleted + inserted words) / words in the ground truth, after normalization. Pooled across all clips.
WER 95% CI (low)% · lower is better: Lower bound of the 95% bootstrap confidence interval for WER.
WER 95% CI (high)% · lower is better: Upper bound of the 95% bootstrap confidence interval for WER.
Word Accuracy% · higher is better: 100 − WER (floored at 0).
Character Error Rate (CER)% · lower is better: Same as WER but counted on characters; more forgiving of near-miss spellings.
Strict WER% · lower is better: WER with minimal normalization (only lowercase and punctuation removal). Shows how closely raw output matches the ground-truth style.
Match Error Rate (MER)% · lower is better: Errors / (errors + correct words). Bounded at 100% even with heavy hallucination.
Word Information Lost (WIL)% · lower is better: Share of word-level information lost between ground truth and output.
Word Information Preserved (WIP)% · higher is better: 100 − WIL.

Error breakdown

What kind of mistake a model makes: the wrong word, a dropped word, or an invented one.

Substitution Rate% · lower is better: Wrong words, as a share of ground-truth words.
Deletion Rate% · lower is better: Missed words (omissions), as a share of ground-truth words.
Insertion Rate% · lower is better: Extra words not spoken (fabrications / hallucinations), as a share of ground-truth words.
Sentence Error Rate (SER)% · lower is better: Share of clips with at least one word error.
Exact Match Rate% · higher is better: Share of clips transcribed perfectly after normalization.
Length Ratiox · closer to 1 is better: Output word count / ground-truth word count. Above 1 suggests hallucination, below 1 suggests skipped speech.

Robustness

How the error is spread across clips — the typical one, the hardest tenth, the outright failures.

Mean WER% · lower is better: Average of per-clip WER (every clip weighted equally).
Median WER% · lower is better: WER of the typical clip.
P90 WER% · lower is better: WER on the hardest 10% of clips; measures robustness.
Severe Error Rate% · lower is better: Share of clips with WER of 50% or more.
Empty Output Rate% · lower is better: Share of clips where the model returned no words.
Success Rate% · higher is better: Share of requests that returned a transcript.

By clip length

WER split by clip duration. Short clips give a model the least context to recover from.

WER - short audio (under 5 s)% · lower is better: WER on short clips.
WER - medium audio (5 to 15 s)% · lower is better: WER on medium-length clips.
WER - long audio (over 15 s)% · lower is better: WER on long clips.

Cost & speed

Billed cost and request time. Latency was measured under concurrent load and is indicative only.

Price per 1,000 minUSD · lower is better: Effective cost to transcribe 1,000 minutes of audio, from actual billing.
Total CostUSD · lower is better: Actual billed cost for the full benchmark run.
Median Latencys · lower is better: Median request time. Measured under concurrent load; indicative only.
P95 Latencys · lower is better: 95th percentile request time. Measured under concurrent load; indicative only.
Real-Time Factor (median)x · lower is better: Processing time / audio duration. Measured under concurrent load; indicative only.

Want your model on this board?

We run it on the same audio, through the same normalization, and publish it next to the other 22.

Enter the next run Read the method