语言大模型 / LLM

Explain Like I'm Five: Using LLMs to Improve PDE Surrogate Models with Text

Cooper Lorsung, Amir Barati Farimani

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.LG

Comments 22 pages, 15 figures, 7 tables

How does a Language-Specific Tokenizer affect LLMs?

Jean Seo, Jaeyoon Kim, SungJoo Byun, Hyopil Shin

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Features

Michael Tschannen, Alexey Gritsenko, Xiao Wang, Muhammad Ferjad Naeem, Ibrahim Alabdulmohsin, Nikhil Parthasarathy, Talfan Evans, Lucas Beyer, Ye Xia, Basil Mustafa, Olivier Hénaff, Jeremiah Harmsen, Andreas Steiner, Xiaohua Zhai

专题命中 预训练与数据 ：language model(abstract)；pretraining(abstract)；分类 cs.AI

Comments Model checkpoints are available at https://github.com/google-research/big_vision/tree/main/big_vision/configs/proj/image_text/README_siglip2.md

From Conversation to Automation: Leveraging LLMs for Problem-Solving Therapy Analysis

Elham Aghakhani, Lu Wang, Karla T. Washington, George Demiris, Jina Huh-Yoo, Rezvaneh Rezapour

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments 18 pages

Data to Defense: The Role of Curation in Customizing LLMs Against Jailbreaking Attacks

Xiaoqun Liu, Jiacheng Liang, Luoxi Tang, Muchao Ye, Weicheng Ma, Zhaohan Xi

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.AI

CViT: Continuous Vision Transformer for Operator Learning

Sifan Wang, Jacob H Seidman, Shyam Sankaran, Hanwen Wang, George J. Pappas, Paris Perdikaris

专题命中 预训练与数据 ：foundation model(abstract)；pretraining(abstract)；分类 cs.LG

Comments 36 pages, 10 tables, 19figures

Granite Vision: a lightweight, open-source multimodal model for enterprise Intelligence

Granite Vision Team, Leonid Karlinsky, Assaf Arbelle, Abraham Daniels, Ahmed Nassar, Amit Alfassi, Bo Wu, Eli Schwartz, Dhiraj Joshi, Jovana Kondic, Nimrod Shabtay, Pengyuan Li, Roei Herzig, Shafiq Abedin, Shaked Perek, Sivan Harary, Udi Barzelay, Adi Raz Goldfarb, Aude Oliva, Ben Wieles, Bishwaranjan Bhattacharjee, Brandon Huang, Christoph Auer, Dan Gutfreund, David Beymer, David Wood, Hilde Kuehne, Jacob Hansen, Joseph Shtok, Ken Wong, Luis Angel Bathen, Mayank Mishra, Maksym Lysak, Michele Dolfi, Mikhail Yurochkin, Nikolaos Livathinos, Nimrod Harel, Ophir Azulai, Oshri Naparstek, Rafael Teixeira de Lima, Rameswar Panda, Sivan Doveh, Shubham Gupta, Subhro Das, Syed Zawad, Yusik Kim, Zexue He, Alexander Brooks, Gabe Goodhart, Anita Govindjee, Derek Leist, Ibrahim Ibrahim, Aya Soffer, David Cox, Kate Soule, Luis Lastras, Nirmit Desai, Shila Ofek-koifman, Sriram Raghavan, Tanveer Syeda-Mahmood, Peter Staar, Tal Drory, Rogerio Feris

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.AI

Salamandra Technical Report

Aitor Gonzalez-Agirre, Marc Pàmies, Joan Llop, Irene Baucells, Severino Da Dalt, Daniel Tamayo, José Javier Saiz, Ferran Espuña, Jaume Prats, Javier Aula-Blasco, Mario Mina, Iñigo Pikabea, Adrián Rubio, Alexander Shvets, Anna Sallés, Iñaki Lacunza, Jorge Palomar, Júlia Falcão, Lucía Tormo, Luis Vasquez-Reina, Montserrat Marimon, Oriol Pareras, Valle Ruiz-Fernández, Marta Villegas

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Fine-Tuned LLMs are "Time Capsules" for Tracking Societal Bias Through Books

Sangmitra Madhusudan, Robert Morabito, Skye Reid, Nikta Gohari Sadr, Ali Emami

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments 9 pages (excluding references), accepted to NAACL 2025

WirelessGPT: A Generative Pre-trained Multi-task Learning Framework for Wireless Communication

Tingting Yang, Ping Zhang, Mengfan Zheng, Yuxuan Shi, Liwen Jing, Jianbo Huang, Nan Li

专题命中 预训练与数据 ：foundation model(abstract)；pretraining(abstract)；分类 cs.LG

Comments 8 pages, 4 figures

Case2Code: Scalable Synthetic Data for Code Generation

Yunfan Shao, Linyang Li, Yichuan Ma, Peiji Li, Demin Song, Qinyuan Cheng, Shimin Li, Xiaonan Li, Pengyu Wang, Qipeng Guo, Hang Yan, Xipeng Qiu, Xuanjing Huang, Dahua Lin

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments Code and datasets are available at https://github.com/choosewhatulike/case2code

Alpaca against Vicuna: Using LLMs to Uncover Memorization of LLMs

Aly M. Kassem, Omar Mahmoud, Niloofar Mireshghallah, Hyunwoo Kim, Yulia Tsvetkov, Yejin Choi, Sherif Saad, Santu Rana

专题命中 预训练与数据 ：LLM(abstract)；prompting(abstract)；分类 cs.CL

CraftRTL: High-quality Synthetic Data Generation for Verilog Code Models with Correct-by-Construction Non-Textual Representations and Targeted Code Repair

Mingjie Liu, Yun-Da Tsai, Wenfei Zhou, Haoxing Ren

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Cross-Lingual Transfer for Low-Resource Natural Language Processing

Iker García-Ferrero

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments Doctoral Thesis: University of the Basque Country UPV/EHU

Detecting harassment and defamation in cyberbullying with emotion-adaptive training

Peiling Yi, Arkaitz Zubiaga, Yunfei Long

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Exponential Family Attention

Kevin Christian Wibisono, Yixin Wang

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.LG

Comments 47 pages

Enhancing Biomedical Relation Extraction with Directionality

Po-Ting Lai, Chih-Hsuan Wei, Shubo Tian, Robert Leaman, Zhiyong Lu

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Towards A Litmus Test for Common Sense

Hugo Latapie

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.AI

AI in Support of Diversity and Inclusion

Çiçek Güven, Afra Alishahi, Henry Brighton, Gonzalo Nápoles, Juan Sebastian Olier, Marie Šafář, Eric Postma, Dimitar Shterionov, Mirella De Sisto, Eva Vanmassenhove

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.AI

Comments 14 pages, 2 figures

Selective Attention Merging for low resource tasks: A case study of Child ASR

Natarajan Balaji Shankar, Zilai Wang, Eray Eren, Abeer Alwan

专题命中 预训练与数据 ：foundation model(abstract)；pretraining(abstract)；分类 cs.CL

Comments To appear in ICASSP 2025

KaLM-Embedding: Superior Training Data Brings A Stronger Embedding Model

Xinshuo Hu, Zifei Shan, Xinping Zhao, Zetian Sun, Zhenyu Liu, Dongfang Li, Shaolin Ye, Xinyuan Wei, Qian Chen, Baotian Hu, Haofen Wang, Jun Yu, Min Zhang

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments Technical Report. 23 pages, 6 figures, 10 tables

Con-ReCall: Detecting Pre-training Data in LLMs via Contrastive Decoding

Cheng Wang, Yiwei Wang, Bryan Hooi, Yujun Cai, Nanyun Peng, Kai-Wei Chang

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

SYNAPSE: SYmbolic Neural-Aided Preference Synthesis Engine

Sadanand Modak, Noah Patton, Isil Dillig, Joydeep Biswas

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.LG

Comments Accepted (oral) at AAAI 25

ADKGD: Anomaly Detection in Knowledge Graphs with Dual-Channel Training

Jiayang Wu, Wensheng Gan, Jiahao Zhang, Philip S. Yu

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.AI

Comments Preprint. 11 figures, 6 tables

Advancing Singlish Understanding: Bridging the Gap with Datasets and Multimodal Models

Bin Wang, Xunlong Zou, Shuo Sun, Wenyu Zhang, Yingxu He, Zhuohan Liu, Chengwei Wei, Nancy F. Chen, AiTi Aw

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments Open-Source: https://github.com/AudioLLMs/Singlish

CL3DOR: Contrastive Learning for 3D Large Multimodal Models via Odds Ratio on High-Resolution Point Clouds

Keonwoo Kim, Yeongjae Cho, Taebaek Hwang, Minsoo Jo, Sangdo Han

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.AI

How to Select Pre-Trained Code Models for Reuse? A Learning Perspective

Zhangqian Bi, Yao Wan, Zhaoyang Chu, Yufei Hu, Junyi Zhang, Hongyu Zhang, Guandong Xu, Hai Jin

专题命中 预训练与数据 ：language model(abstract)；pretraining(abstract)；分类 cs.CL

Comments Accepted by IEEE SANER 2025

Mixture of Experts Meets Prompt-Based Continual Learning

Minh Le, An Nguyen, Huy Nguyen, Trang Nguyen, Trang Pham, Linh Van Ngo, Nhat Ho

专题命中 预训练与数据 ：pretraining(abstract)；prompting(abstract)；分类 cs.LG

Comments Accepted to NeurIPS 2024, 30 pages

OmniChat: Enhancing Spoken Dialogue Systems with Scalable Synthetic Data for Diverse Scenarios

Xize Cheng, Dongjie Fu, Xiaoda Yang, Minghui Fang, Ruofan Hu, Jingyu Lu, Bai Jionghao, Zehan Wang, Shengpeng Ji, Rongjie Huang, Linjun Li, Yu Chen, Tao Jin, Zhou Zhao

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Unfolding the Headline: Iterative Self-Questioning for News Retrieval and Timeline Summarization

Weiqi Wu, Shen Huang, Yong Jiang, Pengjun Xie, Fei Huang, Hai Zhao

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL