arXiv News

First-hand information for everyone

Site

AboutPrivacy PolicyTerms of Use

© 2026 arXiv News

Inversion‑free image editing preserves identity while achieving counterfactual goals | arXiv News

arXiv News

EnglishJapanese

Switch language

EnglishJapanese
Loading account…

First-hand information for everyone

Back to front page
Machine LearningEnglishPublished

Inversion‑free image editing preserves identity while achieving counterfactual goals

November 11, 2026arXiv: 2611.12815v1

Researchers compared two ways to tweak image attributes in pretrained neural backbones. The first uses a noisy image, inverts it to a hidden state, edits that state, then reconstructs an image. The second skips the hidden state entirely. Instead it moves the real image in small steps guided by differences in the model’s velocity field, so the image always stays on the training manifold.

Diagram comparing inversion and inversion‑free transport in a counterfactual editing pipeline
Fig. 1. Visual 1 illustrates the two transport mechanisms used in the inversion‑free pipeline: left, inversion carries the factual image to a latent state and back; right, the inversion‑free map moves the image directly using accumulated velocity differences, keeping it on the image manifold.Vishnubhatla, Saketh, Ma, Pingchuan, Wan, Shu, Beigi, Alimohammad, Harrison, Andre, Raglin, Adrienne et al. · arXiv:2611.12815v1 · Fig. 1: · CC BY 4.0

On CelebA, the methods that perform inversion – SD3‑inv and FlowEdit – hit higher F1 scores on three of four attributes. However, the inversion‑free FlowEdit preserves identity better, showing lower LPIPS scores and a smaller visual shift from the original image. The experiment used a frozen 2‑Billion‑parameter SD3 backbone, the same for both pipelines, isolating the transport step.

Table of CelebA counterfactual statistics, showing effectiveness, realism, and identity preservation for explicit inversion methods and the inversion‑free FlowEdit. Best results are in bold, runners‑up underlined; † marks indicate excluded entries.
Effectiveness F1 ↑Realism FID ↓Identity LPIPS ↓
MethodBackboneagb​rb​lagb​rb​lagb​rb​l
Explicit inversion — encoder; DDIM for Causal-Adapter, flow-ODE for SD3-inv
VAEdeep-SCM0.3900.9900.2840.00460.063.459.957.40.2830.2950.2830.284†
HVAEdeep-SCM0.2460.7420.4760.1222.25.925.631.70.026†0.0760.1380.229†
GANdeep-SCM0.4710.9890.2730.34022.126.623.024.30.2560.3630.2620.285
Causal-AdapterSD1.5 + adapter0.5300.9970.4240.4978.29.08.017.70.1660.2460.1190.240
SD3-invSD3 (2B, frozen)0.8560.9370.5220.40533.147.033.137.40.3690.4640.3510.397
Inversion Free
FlowEditSD3 (2B, frozen)0.8660.9270.2150.03910.89.63.93.50.0780.1240.0550.049†
TABLE II. CelebA counterfactual metrics grouped by whether the exogenous state is recovered. The table lists effectiveness (F1 ↑), realism (FID ↓) and identity preservation (LPIPS ↓) for explicit inversion methods (SD3‑inv, FlowEdit) and for the inversion‑free FlowEdit. For each column, the best value is bolded and the runner‑up underlined; entries marked † are excluded from the ranking. The header row labels each attribute group a, g, b​r, b​l. Vishnubhatla, Saketh, Ma, Pingchuan, Wan, Shu, Beigi, Alimohammad, Harrison, Andre, Raglin, Adrienne et al. · arXiv:2611.12815v1 · TABLE II: · CC BY 4.0

While inversion might appear more powerful, it introduces discretisation error. In a finite‑time inversion‑regeneration loop the error never cancels, leading to larger perceptual differences after a counterfactual change. The inversion‑free pipeline avoids this source of drift by accumulating velocity differences directly, a design that experimental results confirmed preserves identity.

Modeling counterfactuals without an explicit latent state is therefore a viable alternative when the goal is identity‑preserving edits. Ongoing work will test such pipelines on medical imaging, where higher‑fidelity edits are critical.

Source paper

Inversion-Free High-Dimensional Counterfactual Inference

Machine Learning
View on arXiv