Pixel-space continuous-token autoregressive (AR) generation directly models images as sequences of raw pixel patches, avoiding discrete tokenization or a separately pretrained tokenizer. However, it faces coupled challenges: high-dimensional patch generation causes large single-step errors, and teacher-forced training creates a train--inference gap that makes these errors accumulate across AR steps. Existing fixes such as $x$-prediction and input noise injection only partially mitigate these issues. Exact rollout training better matches inference-time conditions, but is impractical due to prohibitively slow sequential sampling. We propose \emph{Parallel Rollout Approximation} (PRA), a scalable framework that addresses both challenges jointly. PRA generates low-dimensional intermediate states instead of high-dimensional pixel patches, then maps them back to pixel-space tokens with a pixel decoder, preserving a pixel-in, pixel-out AR interface. It also constructs inference-like pixel inputs through the same intermediate-state-to-pixel path used at inference, independently across positions, approximating the pixel-feedback interface encountered during inference-time rollout while retaining parallel teacher-forced training. On class-conditional ImageNet-1K generation at $256\times256$ resolution, PRA-S with 135M parameters achieves an FID of 2.58, surpassing the previous billion-scale pixel-space AR result of 3.60. Scaling to PRA-L with 511M parameters further improves FID to 1.94, establishing a new state of the art among pixel-space AR models. Beyond generation, PRA achieves higher ImageNet classification probing accuracy than other AR and diffusion baselines, suggesting its potential for unified pixel-space image generation and understanding.
HorizonDrive: Self-Corrective Autoregressive World Model for Long-horizon Driving Simulation
Wuhan University(武汉大学);The University of Tokyo(东京大学);Horizon Robotics;Tsinghua University(清华大学);University of Science and Technology of China(中国科学技术大学);The Chinese University of Hong Kong(香港中文大学)
FARMER: Flow AutoRegressive Transformer over Pixels
University of Science and Technology of China(中国科学技术大学);Australian National University(澳大利亚国立大学);National University of Singapore(新加坡国立大学);University of Science(科学技术大学)
Motion-Aware Caching for Efficient Autoregressive Video Generation
Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University(多媒体可信感知与高效计算重点实验室,中国教育部,厦门大学);Max Planck Institute for Intelligent Systems(智能系统马克斯·普朗克研究所);ELLIS Institute Tübingen(图宾根ELLIS研究所);Tübingen AI Center(图宾根人工智能中心)
Auto DragGAN: Editing the Generative Image Manifold in an Autoregressive Manner
Foundation Model Research Center, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所基础模型研究中心);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Wuhan AI Research(武汉人工智能研究院)
本文提出 Auto DragGAN,首次采用基于回归的网络学习 StyleGAN 潜在码在拖拽过程中的变化模式,通过自回归方式分解移动过程,在像素级粒度上实现了最先进的推理速度与图像编辑性能。