Generative robot control, simplified

Beyond Future Prediction

Denoising as Generative Adaptation
for Robot Control

What if the value of generative pretraining for control lies not in predicting the future, but in the denoising trajectory itself?

Zanyi Wang1 Yuheng Lei2 Dengyang Jiang3 Ping Luo2 Mengdi Wang4 Zhixuan Liang4,2 ✉ Shilong Liu4 ✉

1UC San Diego2HKU3HKUST4Princeton University

Paper teaser comparing future prediction, future-target co-training, and NowWAM current denoising
01 / The idea

Does generative co-training help because it predicts what comes next—or because it keeps generative learning coupled to action learning?

↳

Our controlled comparison shows that past and future targets perform comparably. The native denoising trajectory, not forward temporal semantics alone, is the effective interface.

02 / Method

Train along the trajectory.
Act at its clean endpoint.

One visual stream supports both current-frame denoising and action learning. At deployment, the policy reads the clean current observation with no visual rollout.

NOWWAM
NowWAM training and inference diagram from the paper
01

Current, not future

The current visual latent is the generative target and the context used by the action expert.

02

Native denoising

Training samples the action-facing representation across the pretrained DiT trajectory.

03

Clean control

Inference evaluates the same representation at σ = 0, without an auxiliary visual stream.

03 / What we learn

Three findings.
One simpler view.

Rather than reproducing the full experiment table, we isolate the evidence that answers the paper’s central question.

01

Temporal direction

Past ≈ future

Forward prediction is not uniquely privileged: a past target performs on par with future targets.

Past t−1683.80 Future t+3283.70
03

Generative backbone

T2I is sufficient

Strong control adaptation does not require a video-generative or image-editing backbone.

Z-Image · T2I87.8 FLUX2-Klein87.7

LIBERO-Plus87.7%

RoboCasa · 100-shot64.9%

Visual tokens784 → 392

Training step1.8× faster

Citation

Build on
NowWAM.

@article{wang2026nowwam,
  title   = {Beyond Future Prediction: Denoising as Generative Adaptation for Robot Control},
  author  = {Wang, Zanyi and Lei, Yuheng and Jiang, Dengyang and Luo, Ping and Wang, Mengdi and Liang, Zhixuan and Liu, Shilong},
  journal = {arXiv preprint arXiv:2609.28339},
  year    = {2026}
}