I benchmarked whether ASR captures a dictated phone number exactly, in German and French. Whisper: 34% exact. Same text written down: 91% [P]
VoxEntity-EU scores whether a speech system captures a dictated name, phone number, email, date, postal address or reference code exactly, in German and French.
Proof1 community thread
Key points
- A transcript can read perfectly and still carry the wrong phone number.
- The caller says +33 6 05 36 23 71, Whisper writes +33 6 75 36 23 71 on a simulated phone line, the sentence looks fine, and every form downstream now stores a wrong number.
- same correct text into the extractor (ceiling): 90.8% [87.5, 94.2]
- Absolute numbers are synthesizer-conditional, so results are published per TTS family.
Sources (1)
- [1]I benchmarked whether ASR captures a dictated phone number exactly, in German and French. Whisper: 34% exact. Same text written down: 91% [P]r/MachineLearning (top, daily) · Oct 15, 09:14 AM
VoxEntity-EU scores whether a speech system captures a dictated name, phone number, email, date, postal address or reference code exactly, in German and French.
A transcript can read perfectly and still carry the wrong phone number.
Extractive summary: sentences quoted from the sources.
Before this
- Oct 15, 2026Local and Distributed Large LLM Inference with MLX and RDMA on Mac Studio
- Oct 14, 2026Video to surface normals-map with NormalCrafter
- Oct 14, 2026I built an open-source dubber that keeps each actor’s own voice, fully local (OmniVoice + Whisper, 6 GB+ NVIDIA)
- Oct 14, 2026I created custom nodes for Fish Audio Drama 3 - Works with as little as 8GB VRAM - Quantized weights on HF
- Oct 14, 2026Introducing Timestral
- Oct 13, 2026Run fast, private agents on-device with LFM2.5-24B-A2B
