🎤 Voice Transcription Model Comparison

Legend: highlighted = added/changed words | [deleted] = missing words | WER = Word Error Rate (lower is better)

Audio Clip (4.4903125s)

Reference (Gold)

Make a fully featured PyTorch alternative.

Scribe v1 (ElevenLabs) 🟢 WER: 0.00% • 0.89s

Make a fully - featured , PyTorch alternative .

Scribe v1 (ElevenLabs) 🟢 WER: 0.00% • 0.87s

Make a fully - featured , PyTorch alternative .

aqua voice 🟡 WER: 16.67% • 1.70s

Make a fully featured Python alternative .

Large v3 Turbo 🟡 WER: 16.67% • 2.11s

Make a fully featured Python alternative .

Voxtral Mini (Mistral) 🟡 WER: 16.67% • 0.29s

make a fully featured Python alternative .

Flow 🟡 WER: 16.67% • 0.00s

Make a fully - featured Python alternative .

Audio Clip (5.909s)

Reference (Gold)

This is a hard problem. Ultra think

aqua voice 🟢 WER: 0.00% • 1.74s

This is a hard problem . Ultra think .

Large v3 Turbo 🟢 WER: 0.00% • 1.53s

This is a hard problem . Ultra think .

Flow 🟢 WER: 0.00% • 0.00s

This is a hard problem . Ultra think .

Voxtral Mini (Mistral) 🟢 WER: 14.29% • 0.54s

This is a hard problem . Ultra thing .

Scribe v1 (ElevenLabs) 🟢 WER: 14.29% • 0.62s

this is a hard problem . Ultra - thin .

Parakeet V3 🟡 WER: 28.57% • 0.10s

This is a hard problem . Ультрафинк .

Audio Clip (5.9303125s)

Reference (Gold)

Oh, I’ve just run this through GPT-5 and it was fantastic.

Large v3 Turbo 🟢 WER: 7.69% • 1.54s

Oh , I [’ ve] just run this through GPT - 5 and it was fantastic .

Scribe v1 (ElevenLabs) 🟢 WER: 7.69% • 0.99s

Oh , I [’ ve] just run this through GPT - 5 and it was fantastic .

Parakeet V3 🟡 WER: 15.38% • 0.11s

Oh , I [’ ve] just ran this through GPT - 5 and it was fantastic .

Voxtral Mini (Mistral) 🟡 WER: 15.38% • 0.53s

Oh , I [’ ve] just ran this through GPT - 5 and it was fantastic .

aqua voice 🟡 WER: 15.38% • 1.14s

Oh , I [’ ve] just ran this through GPT - 5 and it was fantastic .

aqua voice 🟡 WER: 15.38% • 1.16s

Oh , I [’ ve] just ran this through GPT - 5 and it was fantastic .

Flow 🟡 WER: 15.38% • 0.00s

Oh , I [’ ve] just ran this through GPT - 5 and it was fantastic .

Audio Clip (6.591625s)

Reference (Gold)

Claude Sonnet 4.5 announcement.

Scribe v1 (ElevenLabs) 🟡 WER: 20.00% • 2.90s

Cloud Sonnet 4 . 5 announcement .

Large v3 Turbo 🔴 WER: 40.00% • 1.53s

Odsonet 4 . 5 announcement .

Parakeet V3 🔴 WER: 80.00% • 0.46s

Cloud sonnet for tot five announcement .

Audio Clip (15.2743125s)

Reference (Gold)

GPT-5 is much better than Claude. o3, Grok, and other models are tried on life-related matters like law, business, healthcare, and gym advice.

Voxtral Mini (Mistral) 🟢 WER: 4.00% • 4.90s

GPT - 5 is much better than Claude , O3 , Grok [,] and other models I tried on life - related matters like law , business , healthcare [,] and gym advice .

aqua voice 🟢 WER: 4.00% • 1.69s

GPT - 5 is much better than Claude . o3 , Groq , and other models are tried on life - related matters like law , business , healthcare , and gym advice .

Flow 🟢 WER: 12.00% • 0.00s

GPT - 5 is much better than Claude . o4 - mini , Grok , and other models are tried on life - related matters like : loan business , healthcare , and gym advice .

Large v3 Turbo 🟢 WER: 12.00% • 1.66s

GPT - 5 is much better than cloth . O3 , Grog and other models are tried on life - related matters like loan , business , healthcare [,] and gym advice .

Scribe v1 (ElevenLabs) 🟡 WER: 16.00% • 1.36s

And GPT - 5 is much better than Claude . All three Grok [,] and other models I tried on life - related matters like law , business , healthcare , and gym advice .

Parakeet V3 🟡 WER: 20.00% • 0.40s

And GPD5 is much better than Claude . O three , Groc , and other models are tried on life [-] related matters like law , business , healthcare . and gym advice .

Audio Clip (16.639625s)

Reference (Gold)

There are plenty of old models GPT-4o, GPT-4.1, and o3. All are much worse than GPT-5.

Scribe v1 (ElevenLabs) 🟢 WER: 5.00% • 1.19s

There are plenty of old models , GPT - 4o , GPT [-] 4 . 1 , and 03 . All are much worse than GPT - 5 .

Flow 🟢 WER: 10.00% • 0.00s

There are plenty of old models : GPT - 4o , GPT - 4 . 1 , and GPT - 3 . All are much worse than GPT - 5 !

Voxtral Mini (Mistral) 🟡 WER: 15.00% • 1.18s

There are plenty of old models GPT - 4 . 0 , GPT - 4 . 1 [,] and 03 . All are much worse than GPT - 5 .

Large v3 Turbo 🔴 WER: 30.00% • 2.33s

There are plenty of old modules GPT - 4 . 0 , GPT - 4 . 1 [,] and GPT - 3 . 0 are much worse than GPT - 5 .

Parakeet V3 🔴 WER: 40.00% • 0.30s

There are plenty of old models GPT - 4 . 0 , GPT [-] 4 . 1 [,] and O3 . [All are much worse than GPT] - 5 .

Audio Clip (22.293s)

Reference (Gold)

I often find Claude Sonnet 4.5 to be quite good at coding and failing miserably when you ask it to provide business advice or to use its knowledge for you.

Scribe v1 (ElevenLabs) 🟢 WER: 0.00% • 1.61s

I often find Claude Sonnet 4 . 5 to be quite good at coding , and failing miserably when you ask it to provide business advice or to use its knowledge , for you .

aqua voice 🟢 WER: 3.23% • 1.57s

I often find Claude Sonnet 4 . 5 to be quite good at coding and failing miserably when you ask it to provide business advice or to use it knowledge for you .

Large v3 Turbo 🟢 WER: 3.23% • 1.71s

I often find Claude Sonnet 4 . 5 to be quite good at coding and failing miserably when you ask it to provide business advice or to use it knowledge for you .

Flow 🟢 WER: 3.23% • 0.00s

I often find Claude ' s Sonnet 4 . 5 to be quite good at coding and failing miserably when you ask it to provide business advice or to use its knowledge for you .

Voxtral Mini (Mistral) 🟢 WER: 6.45% • 0.79s

I often find Claude ' s Sonnet 4 . 5 to be quite good at coding and failing miserably when you ask it to provide business advice or to use it knowledge for you .

Parakeet V3 🟡 WER: 19.35% • 0.40s

I often find clothes on at four . five to be quite good at coding and failing miserably when you ask it to provide business advice or to use it knowledge for you .