arXiv News

First-hand information for everyone

Site

AboutPrivacy PolicyTerms of Use

© 2026 arXiv News

Earlybird, a tiny on‑device speech recognizer, can predict each spoken word before the speaker finishes it on six different test sets | arXiv News

arXiv News

EnglishJapanese

Switch language

EnglishJapanese
Loading account…

First-hand information for everyone

Back to front page
SoundEnglishPublished

Earlybird, a tiny on‑device speech recognizer, can predict each spoken word before the speaker finishes it on six different test sets

November 13, 2026arXiv: 2611.14421v1

Earlybird is a small transformer model that outputs every rising word from its first sounds. On LibriSpeech test‑clean, 69 % of the words are correctly predicted before they finish; the median word appears 90 ms early. Across six speech domains— audiobooks, TED talks, public speeches, earnings calls, and synthetic speech—Earlybird keeps this early‑prediction advantage. The model’s confidence estimates for words still being spoken are well calibrated, with an expected calibration error between 3.7 % and 5.5 %.

The network was built by taking a pre‑trained Moonshine Tiny encoder‑decoder and trimming its vocabulary to 19 007 tokens, then training it to predict every word that has arrived in the audio window plus the next two words as guesses. No changes were made to the underlying architecture.

On LibriSpeech test‑clean, the median word latency of Earlybird is –90 ms, outpacing Moonshine Tiny (+270 ms), Whistle (+400 ms), and Whisper base (+90 ms). On the other five datasets the improvement ranges from 60 ms to 73 ms. Earlybird’s overall word error rate on the Open ASR Leaderboard is 11.7 % in full precision and 12.7 % after 4‑bit quantization, lower than Moonshine Tiny (12.0 %) and comparable to Whistle (12.2 %).

Table showing Earlybird’s median word latency is −90 ms on LibriSpeech test‑clean compared to +270 ms for Moonshine Tiny, +400 ms for Whistle, and +90 ms for Whisper base, with corresponding word error rates.
Test setEarlybirdMoonshine TinyWhistleWhisper base
LibriSpeech clean (67)−𝟗𝟎 / 2.3+270 / 3.9+400 / 3.1+90 / 2.3
LibriSpeech other (150)−𝟔𝟎 / 9.7+300 / 13.2+460 / 10.1+140 / 8.7
TED-LIUM (150)−𝟔𝟖 / 5.4+298 / 6.8+505 / 7.3+125 / 4.8
People’s Speech (150)−𝟔𝟔 / 14.5+290 / 16.7+477 / 14.2+127 / 10.5
Earnings-22 (150)−𝟒𝟔 / 18.4+309 / 21.6+535 / 17.8+142 / 13.3
Synthetic (67)−𝟕𝟑 / 5.6+292 / 7.0+424 / 7.5+90 / 4.8
Revisions per word (LS clean)1.292.070.160.39
Table 1. Median word latency (ms) and WER % for Earlybird and reference models on LibriSpeech test‑clean, showing Earlybird’s −90 ms median latency versus +270 ms for Moonshine Tiny, +400 ms for Whistle, and +90 ms for Whisper base.Mahendrakar, Sahil · arXiv:2611.14421v1 · Table 1: · CC BY 4.0
Table presenting Earlybird’s mean WER of 11.7 % at full precision and 12.7 % at 4‑bit, lower than Moonshine Tiny’s 12.0 % and comparable to Whistle’s 12.2 % across all leaderboard sets.
SystemTEDVoxPLS-cLS-oEarnAMIGigaSPGIMean
Earlybird 4-bit (16.8 MB)6.113.63.714.221.721.813.16.812.6
Earlybird full precision5.612.93.412.020.019.411.76.111.4
Moonshine Tiny runtime7.915.45.416.023.324.914.57.314.4
Whistle7.710.84.111.317.924.014.67.112.2
Whisper tiny.en5.913.75.214.017.522.211.85.312.0
Whisper base.en4.99.83.810.214.418.511.64.09.7
Whisper small.en4.08.32.77.811.916.98.73.68.0
Table 3. Mean Word Error Rate (%) on the eight English Open ASR Leaderboard sets, with Earlybird 11.7 % (full precision) and 12.7 % (4‑bit), versus 12.0 % for Moonshine Tiny and 12.2 % for Whistle.Mahendrakar, Sahil · arXiv:2611.14421v1 · Table 3: · CC BY 4.0

Earlybird’s estimates are less reliable on unseen spoken‑command speech, with an 8.8 % calibration error. The model was evaluated only on English data.

The results are based on 80‑ms audio chunks and compare the time from which each word is correctly identified to the word’s acoustic end.

Source paper

Earlybird: Predictive Streaming Speech Recognition in 29M Parameters

SoundNatural Language ProcessingSignal Processing
View on arXiv