语言大模型 / LLM

Assessing Social Alignment: Do Personality-Prompted Large Language Models Behave Like Humans?

Ivan Zakazov, Mikolaj Boronski, Lorenzo Drudi, Robert West

机构 * EPFL（苏黎世联邦理工学院） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

Comments Accepted to NeurIPS 2024 Workshop on Behavioral Machine Learning

Revisiting Replay and Gradient Alignment for Continual Pre-Training of Large Language Models

Istabrak Abbes, Gopeshh Subbaraj, Matthew Riemer, Nizar Islah, Benjamin Therien, Tsuguchika Tabaru, Hiroaki Kingetsu, Sarath Chandar, Irina Rish

机构 * Université de Montréal（蒙特利尔大学） ； Mila – Quebec AI Institute（魁北克人工智能研究院） ； Chandar Research Lab（Chandar研究实验室） ； IBM Research（IBM研究院） ； Fujitsu Research（富士通研究院） ； Polytechnique Montréal（蒙特利尔理工学院） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Contextual Graph Transformer: A Small Language Model for Enhanced Engineering Document Information Extraction

Karan Reddy, Mayukha Pal

专题命中 预训练与数据 ：language model(title,abstract)；small language model(title)；pretraining(abstract)；分类 cs.CL、cs.LG

WarriorMath: Enhancing the Mathematical Ability of Large Language Models with a Defect-aware Framework

Yue Chen, Minghua He, Fangkai Yang, Pu Zhao, Lu Wang, Yu Kang, Yifei Dong, Yuefeng Zhan, Hao Sun, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang

机构 * Peking University（北京大学） ； Microsoft（微软） ； KTH Royal Institute of Technology（皇家理工学院） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

How Does Controllability Emerge In Language Models During Pretraining?

Jianshu She, Xinyue Li, Eric Xing, Zhengzhong Liu, Qirong Ho

机构 * Mohamed bin Zayed University of Artificial Intelligence（莫扎德·本·扎耶德人工智能大学） ； Carnegie Mellon University（卡内基梅隆大学） 纠错

专题命中 预训练与数据 ：language model(title,abstract)；pretraining(title)；分类 cs.AI、cs.LG

VAULT: Vigilant Adversarial Updates via LLM-Driven Retrieval-Augmented Generation for NLI

Roie Kazoom, Ofir Cohen, Rami Puzis, Asaf Shabtai, Ofer Hadar

专题命中 预训练与数据 ：LLM(title,abstract)；分类 cs.AI、cs.LG

Balancing Information Accuracy and Response Timeliness in Networked LLMs

Yigit Turkmen, Baturalp Buyukates, Melih Bastopcu

机构 * School of Computer Science University of Birmingham Birmingham, UK（计算机科学学院 布拉姆斯希尔大学 布拉姆斯希尔英国） 纠错

专题命中 预训练与数据 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

Large-Scale Diverse Synthesis for Mid-Training

Xuemiao Zhang, Chengying Tu, Can Ren, Rongxiang Weng, Hongfei Yan, Jingang Wang, Xunliang Cai

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；post-training(abstract)；分类 cs.CL

Thinker-DDM: Modeling Deliberation for Machine Translation with a Drift-Diffusion Process

Hongbin Na, Zimu Wang, Mieradilijiang Maimaiti, Tong Chen, Wei Wang, Tao Shen, Ling Chen

机构 * Australian AI Institute, University of Technology Sydney（澳大利亚人工智能研究院，悉尼技术大学） ； Xi’an Jiaotong-Liverpool University（西安交通大学利物浦大学） ； Chinese Academy of Sciences（中国科学院） 纠错

专题命中 预训练与数据 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

Comments Under review

TESPEC: Temporally-Enhanced Self-Supervised Pretraining for Event Cameras

Mohammad Mohammadi, Ziyi Wu, Igor Gilitschenski

机构 * University of Toronto（多伦多大学） ； Vector Institute（向量研究所） 纠错

专题命中 预训练与数据 ：pretraining(title)；分类 cs.LG

Comments Accepted at IEEE/CVF International Conference on Computer Vision (ICCV) 2025

Extrapolation by Association: Length Generalization Transfer in Transformers

Ziyang Cai, Nayoung Lee, Avi Schwarzschild, Samet Oymak, Dimitris Papailiopoulos

专题命中 预训练与数据 ：language model(abstract)；pretraining(abstract)；分类 cs.CL、cs.AI

Comments 23 pages, 20 figures

TRACEALIGN -- Tracing the Drift: Attributing Alignment Failures to Training-Time Belief Sources in LLMs

Amitava Das, Vinija Jain, Aman Chadha

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.AI

Multi-Operator Few-Shot Learning for Generalization Across PDE Families

Yile Li, Shandian Zhe

专题命中 预训练与数据 ：pretraining(abstract)；prompting(abstract)；分类 cs.LG

PRIMAL: Physically Reactive and Interactive Motor Model for Avatar Learning

Yan Zhang, Yao Feng, Alpár Cseke, Nitin Saini, Nathan Bajandas, Nicolas Heron, Michael J. Black

机构 * Meshcapade ； Max Planck Institute for Intelligent Systems（马克斯·普朗克智能系统研究所） ； Stanford University（斯坦福大学） 纠错

专题命中 预训练与数据 ：foundation model(abstract)；pretraining(abstract)；分类 cs.AI

Comments ICCV'25 camera ready; main paper and appendix; 19 pages in total

Enhancing Talk Moves Analysis in Mathematics Tutoring through Classroom Teaching Discourse

Jie Cao, Abhijit Suresh, Jennifer Jacobs, Charis Clevenger, Amanda Howard, Chelsea Brown, Brent Milne, Tom Fischaber, Tamara Sumner, James H. Martin

机构 * School of Computer Science, University of Oklahoma（俄克拉荷马大学计算机科学学院） ； Institute of Cognitive Science, University of Colorado Boulder（科罗拉多大学博尔德分校认知科学研究所） 纠错

专题命中 预训练与数据 ：pretraining(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to COLING'2025

TEACH: Text Encoding as Curriculum Hints for Scene Text Recognition

Xiahan Yang, Hui Zheng

专题命中 预训练与数据 ：language model(abstract)；pretraining(abstract)

Comments 9 pages (w/o ref), 5 figures, 7 tables

HOLa: Zero-Shot HOI Detection with Low-Rank Decomposed VLM Feature Adaptation

Qinqian Lei, Bo Wang, Robby T. Tan

机构 * National University of Singapore（国立新加坡大学） ； University of Mississippi（密苏里大学） ； ASUS Intelligent Cloud Services (AICS)（ASUS智能云服务（AICS）） 纠错

专题命中 预训练与数据 ：LLM(abstract)；language model(abstract)

Comments Accepted by ICCV 2025

Real-time Generation of Various Types of Nodding for Avatar Attentive Listening System

Kazushi Kato, Koji Inoue, Divesh Lala, Keiko Ochi, Tatsuya Kawahara

机构 * Kyoto University（京都大学） 纠错

专题命中 预训练与数据 ：pretraining(abstract)

Comments Accepted by 27th ACM International Conference on Multimodal Interaction (ICMI '25), Long paper