arXiv News

First-hand information for everyone

Site

AboutPrivacy PolicyTerms of Use

© 2026 arXiv News

arXiv News

EnglishJapanese

Switch language

EnglishJapanese
Loading account…

First-hand information for everyone

Back to front page
Natural Language ProcessingEnglishPublished

Coupling‑based decoding shrinks the number of steps a diffusion language model takes to commit tokens, cutting the accuracy penalty to just 1.1 percentage points

November 8, 2026arXiv: 2611.08307v1

A new decoding strategy uses the model itself to measure how committing one token changes the confidence of another – a quantity called coupling. By probing just the local block of the current forward pass, the method avoids a full extra pass for every candidate token. The approach keeps the same mean‑field energy rule but swaps the similarity penalty for this coupling.

Across three language models and four datasets, the method requires far fewer decoding steps than the previous mean‑field baseline and is faster in most settings, even when the key‑value cache is used. The average accuracy loss is only 1.1 percentage points. Shuffling the couplings or using a uniform bonus removes this advantage, confirming that the measured interaction between tokens is crucial.

Each scoring step with block‑local probes costs roughly 1.2 to 1.5 times a plain mean‑field step, so the wall‑clock speed‑up is somewhat lower than the step‑count gain. Still, the method achieves 26 % to 55 % fewer steps, making the extra per‑step cost offset by the reduced overall iteration count.

The technique relies on no extra training or model – the original diffusion model provides the necessary predictions. It simply recomputes the block for each candidate token and reads the changed confidence at other positions, a cheap operation validated by a Pearson correlation of 0.96 with a full forward‑pass probe.

Verified fact evidence: measured coupling, mean‑field comparison, diffusion model capability, and step‑cost limitation.

Source paper

Measured Coupling for Parallel Decoding in Diffusion Language Models

Natural Language ProcessingArtificial Intelligencecs.DCMachine Learningcs.PF
View on arXiv
Coupling‑based decoding shrinks the number of steps a diffusion language model takes to commit tokens, cutting the accuracy penalty to just 1.1 percentage points | arXiv News