Autoregressive large language models (LLMs) scale well by expressing diverse tasks as sequences of discrete natural-language tokens and training with next-token prediction, which unifies comprehension and generation under self-supervision. Extending this paradigm to multimodal data requires a shared, discrete representation across modalities. However, most vision-language models (VLMs) still rely on a hybrid interface: discrete text tokens paired with continuous Vision Transformer (ViT) features. Because supervision is largely text-driven, these models are often biased toward understanding and cannot fully leverage large-scale self-supervised learning on non-text data. Recent work has explored discrete visual tokenization to enable fully autoregressive multimodal modeling, showing promising progress toward unified understanding and generation. Yet existing discrete vision tokens frequently lose information due to limited code capacity, resulting in noticeably weaker understanding than continuous-feature VLMs. We present Kelix, a fully discrete autoregressive unified model that closes the understanding gap between discrete and continuous visual representations.
Technical Report for ICML 2024 TiFA Workshop MLLM Attack Challenge: Suffix Injection and Projected Gradient Descent Can Easily Fool An MLLM
School of Computing, National University of Singapore(新加坡国立大学计算机学院);School of Computer Science and Technology, Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳)计算机科学与技术学院)
Technical Report for Valence-Arousal Estimation on Affwild2 Dataset
Georgia Institute of Technology(佐治亚理工学院);Anonymous University(匿名大学)
在这项工作中,我们描述了我们的方法来解决ABAW FG-2020竞赛的效价唤醒估计挑战。比赛组织者提供了一个野外Aff-Wild 2数据集,供参与者分析现实生活中的情感行为。我们使用MIMAMO Net \cite{deng2020mimamo}模型来获得关于微运动和宏运动的信息以改进视频情感识别,并且在重新选择的验证集上实现了0.415和0.511的效价和唤醒的一致性相关系数(CCC)。
The Dem@Care Experiments and Datasets: a Technical Report
Information Technologies Institute, Centre for Research & Technology(信息技术研究所,研究与技术中心);School of Medicine, Aristotle University of Thessaloniki(亚里士多德大学医学院)
Team AcieLee: Technical Report for EPIC-SOUNDS Audio-Based Interaction Recognition Challenge 2023
Southwest University(西南大学);Samsung Research China-Beijing(SRC-B)(三星中国研究院-北京);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所)