语言大模型 / LLM - arXivDaily 专题

2410.18957 2024-10-25 cs.CL 77%

Bridge-Coder: Unlocking LLMs' Potential to Overcome Language Gaps in Low-Resource Code

Jipeng Zhang, Jianshu Zhang, Yuanzhe Li, Renjie Pi, Rui Pan, Runtao Liu, Ziqiang Zheng, Tong Zhang

专题命中预训练与数据：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

Comments 15 pages, 3 figures

2410.16736 2024-10-23 cs.CL 77%

Forewarned is Forearmed: Leveraging LLMs for Data Synthesis through Failure-Inducing Exploration

Qintong Li, Jiahui Gao, Sheng Wang, Renjie Pi, Xueliang Zhao, Chuan Wu, Xin Jiang, Zhenguo Li, Lingpeng Kong

专题命中预训练与数据：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

2402.11137 2024-10-22 cs.LG 77%

TuneTables: Context Optimization for Scalable Prior-Data Fitted Networks

Benjamin Feuer, Robin Tibor Schirrmeister, Valeriia Cherepanova, Chinmay Hegde, Frank Hutter, Micah Goldblum, Niv Cohen, Colin White

专题命中预训练与数据：large language model(abstract)；language model(abstract)；pretraining(abstract)；分类 cs.LG

Comments NeurIPS 2024 Poster

2305.14328 2024-10-22 cs.CL 77%

Benchmarking Machine Translation with Cultural Awareness

Binwei Yao, Ming Jiang, Tara Bobinac, Diyi Yang, Junjie Hu

专题命中预训练与数据：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

2405.15585 2024-10-21 cs.CL 77%

Synergizing In-context Learning with Hints for End-to-end Task-oriented Dialog Systems

Vishal Vivek Saley, Rocktim Jyoti Das, Dinesh Raghu, Mausam

专题命中预训练与数据：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

Comments EMNLP2024 Camera-Ready Version

2410.10210 2024-10-16 cs.CL 77%

Minimum Tuning to Unlock Long Output from LLMs with High Quality Data as the Key

Yingda Chen, Xingjun Wang, Jintao Huang, Yunlin Mao, Daoze Zhang, Yuze Zhao

专题命中预训练与数据：large language model(abstract)；language model(abstract)；foundation model(abstract)；分类 cs.CL

2410.09623 2024-10-15 cs.CL 77%

Quebec Automobile Insurance Question-Answering With Retrieval-Augmented Generation

David Beauchemin, Zachary Gagnon, Ricahrd Khoury

专题命中预训练与数据：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

Comments Accepted to NLLP 2024 EMNLP workshop

2410.07391 2024-10-11 cs.AI 77%

The Cognitive Capabilities of Generative AI: A Comparative Analysis with Human Benchmarks

Isaac R. Galatzer-Levy, David Munday, Jed McGiffin, Xin Liu, Danny Karmon, Ilia Labzovsky, Rivka Moroshko, Amir Zait, Daniel McDuff

专题命中预训练与数据：large language model(abstract)；language model(abstract)；foundation model(abstract)；分类 cs.AI

2410.06898 2024-10-10 cs.CL 77%

Generative Model for Less-Resourced Language with 1 billion parameters

Domen Vreš, Martin Božič, Aljaž Potočnik, Tomaž Martinčič, Marko Robnik-Šikonja

专题命中预训练与数据：large language model(abstract)；language model(abstract)；pretraining(abstract)；分类 cs.CL

2410.03197 2024-10-07 cs.CL 77%

Cross-lingual Transfer for Automatic Question Generation by Learning Interrogative Structures in Target Languages

Seonjeong Hwang, Yunsu Kim, Gary Geunbae Lee

专题命中预训练与数据：large language model(abstract)；language model(abstract)；small language model(abstract)；分类 cs.CL

Comments EMNLP 2024

2309.15656 2024-10-04 cs.CL 77%

Conversational Feedback in Scripted versus Spontaneous Dialogues: A Comparative Analysis

Ildikó Pilán, Laurent Prévot, Hendrik Buschmeier, Pierre Lison

专题命中预训练与数据：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

Comments Updated version for SIGdial 2024

Journal ref In Proceedings of SIGdial 2024, pp. 440-457. Kyoto, Japan (2024)

2408.12186 2024-10-03 stat.ML cs.LG 77%

Transformers are Minimax Optimal Nonparametric In-Context Learners

Juno Kim, Tai Nakamaki, Taiji Suzuki

专题命中预训练与数据：large language model(abstract)；language model(abstract)；pretraining(abstract)；分类 cs.LG

Comments NeurIPS 2024; 40 pages, 3 figures

2308.09895 2024-09-24 cs.PL cs.LG 77%

Knowledge Transfer from High-Resource to Low-Resource Programming Languages for Code LLMs

Federico Cassano, John Gouwar, Francesca Lucchetti, Claire Schlesinger, Anders Freeman, Carolyn Jane Anderson, Molly Q Feldman, Michael Greenberg, Abhinav Jangda, Arjun Guha

专题命中预训练与数据：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.LG

2404.11568 2024-09-12 cs.LG 77%

On the Scalability of GNNs for Molecular Graphs

Maciej Sypetkowski, Frederik Wenkel, Farimah Poursafaei, Nia Dickson, Karush Suri, Philip Fradkin, Dominique Beaini

专题命中预训练与数据：language model(abstract)；foundation model(abstract)；pretraining(abstract)；分类 cs.LG

2408.14972 2024-08-28 cs.CL 77%

AgentMonitor: A Plug-and-Play Framework for Predictive and Secure Multi-Agent Systems

Chi-Min Chan, Jianxuan Yu, Weize Chen, Chunyang Jiang, Xinyu Liu, Weijie Shi, Zhiyuan Liu, Wei Xue, Yike Guo

专题命中预训练与数据：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

2310.08750 2024-08-26 cs.LG 77%

Search-Adaptor: Embedding Customization for Information Retrieval

Jinsung Yoon, Sercan O Arik, Yanfei Chen, Tomas Pfister

专题命中预训练与数据：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.LG

Comments Published in 2024 ACL Main Conference

2408.05793 2024-08-13 cs.CL 77%

SAGA: A Participant-specific Examination of Story Alternatives and Goal Applicability for a Deeper Understanding of Complex Events

Sai Vallurupalli, Katrin Erk, Francis Ferraro

专题命中预训练与数据：large language model(abstract)；language model(abstract)；pretraining(abstract)；分类 cs.CL

Comments Accepted to Findings of the Association for Computational Linguistics 2024

2408.03256 2024-08-07 cs.CL 77%

Synthesizing Text-to-SQL Data from Weak and Strong LLMs

Jiaxi Yang, Binyuan Hui, Min Yang, Jian Yang, Junyang Lin, Chang Zhou

专题命中预训练与数据：large language model(abstract)；language model(abstract)；instruction tuning(abstract)；分类 cs.CL

Comments 12 pages, 7 figures, ACL 2024

2406.07867 2024-08-05 cs.CV cs.AI cs.HC 77%

Let's Go Real Talk: Spoken Dialogue Model for Face-to-Face Conversation

Se Jin Park, Chae Won Kim, Hyeongseop Rha, Minsu Kim, Joanna Hong, Jeong Hun Yeo, Yong Man Ro

专题命中预训练与数据：large language model(abstract)；language model(abstract)；pretraining(abstract)；分类 cs.AI

Comments Accepted to ACL 2024 (Oral)

2402.18819 2024-08-05 cs.LG 77%

Dual Operating Modes of In-Context Learning

Ziqian Lin, Kangwook Lee

专题命中预训练与数据：large language model(abstract)；language model(abstract)；pretraining(abstract)；分类 cs.LG

Comments 54 pages, 23 figures

2407.08699 2024-07-17 cs.LG 77%

Mitigating Catastrophic Forgetting in Language Transfer via Model Merging

Anton Alexandrov, Veselin Raychev, Mark Niklas Müller, Ce Zhang, Martin Vechev, Kristina Toutanova

专题命中预训练与数据：large language model(abstract)；language model(abstract)；pretraining(abstract)；分类 cs.LG

2403.15042 2024-07-16 cs.CL 77%

LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement

Nicholas Lee, Thanakul Wattanawong, Sehoon Kim, Karttikeya Mangalam, Sheng Shen, Gopala Anumanchipalli, Michael W. Mahoney, Kurt Keutzer, Amir Gholami

专题命中预训练与数据：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

Comments ACL 2024

2407.00497 2024-07-02 cs.CL 77%

LLMs-as-Instructors: Learning from Errors Toward Automating Model Improvement

Jiahao Ying, Mingbao Lin, Yixin Cao, Wei Tang, Bo Wang, Qianru Sun, Xuanjing Huang, Shuicheng Yan

专题命中预训练与数据：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

2406.12570 2024-06-19 cs.CL 77%

Applying Ensemble Methods to Model-Agnostic Machine-Generated Text Detection

Ivan Ong, Boon King Quek

专题命中预训练与数据：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

2402.10738 2024-06-18 cs.CL 77%

Let's Learn Step by Step: Enhancing In-Context Learning Ability with Curriculum Learning

Yinpeng Liu, Jiawei Liu, Xiang Shi, Qikai Cheng, Yong Huang, Wei Lu

专题命中预训练与数据：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

2401.02906 2024-06-18 cs.CR cs.CL cs.CV 77%

MLLM-Protector: Ensuring MLLM's Safety without Hurting Performance

Renjie Pi, Tianyang Han, Jianshu Zhang, Yueqi Xie, Rui Pan, Qing Lian, Hanze Dong, Jipeng Zhang, Tong Zhang

专题命中预训练与数据：large language model(abstract)；language model(abstract)；pretraining(abstract)；分类 cs.CL

2406.09462 2024-06-17 cs.CV cs.AI 77%

SViTT-Ego: A Sparse Video-Text Transformer for Egocentric Video

Hector A. Valdez, Kyle Min, Subarna Tripathi

专题命中预训练与数据：language model(abstract)；foundation model(abstract)；pretraining(abstract)；分类 cs.AI

2401.10186 2024-06-07 cs.CL 77%

Beyond Traditional Benchmarks: Analyzing Behaviors of Open LLMs on Data-to-Text Generation

Zdeněk Kasner, Ondřej Dušek

专题命中预训练与数据：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

Comments Accepted to ACL 2024 Main Conference

2402.09989 2024-05-30 cs.CV cs.CL 77%

LLMs as Bridges: Reformulating Grounded Multimodal Named Entity Recognition

Jinyuan Li, Han Li, Di Sun, Jiahao Wang, Wenkun Zhang, Zan Wang, Gang Pan

专题命中预训练与数据：large language model(abstract)；language model(abstract)；pretraining(abstract)；分类 cs.CL

Comments Accepted to Findings of ACL 2024

2405.07703 2024-05-20 cs.CL 77%

OpenLLM-Ro -- Technical Report on Open-source Romanian LLMs

Mihai Masala, Denis C. Ilie-Ablachim, Dragos Corlatescu, Miruna Zavelca, Marius Leordeanu, Horia Velicu, Marius Popescu, Mihai Dascalu, Traian Rebedea

专题命中预训练与数据：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

1. 预训练与数据 12429 篇

Bridge-Coder: Unlocking LLMs' Potential to Overcome Language Gaps in Low-Resource Code

Forewarned is Forearmed: Leveraging LLMs for Data Synthesis through Failure-Inducing Exploration

TuneTables: Context Optimization for Scalable Prior-Data Fitted Networks

Benchmarking Machine Translation with Cultural Awareness

Synergizing In-context Learning with Hints for End-to-end Task-oriented Dialog Systems

Minimum Tuning to Unlock Long Output from LLMs with High Quality Data as the Key

Quebec Automobile Insurance Question-Answering With Retrieval-Augmented Generation

The Cognitive Capabilities of Generative AI: A Comparative Analysis with Human Benchmarks

Generative Model for Less-Resourced Language with 1 billion parameters

Cross-lingual Transfer for Automatic Question Generation by Learning Interrogative Structures in Target Languages

Conversational Feedback in Scripted versus Spontaneous Dialogues: A Comparative Analysis

Transformers are Minimax Optimal Nonparametric In-Context Learners

Knowledge Transfer from High-Resource to Low-Resource Programming Languages for Code LLMs

On the Scalability of GNNs for Molecular Graphs

AgentMonitor: A Plug-and-Play Framework for Predictive and Secure Multi-Agent Systems

Search-Adaptor: Embedding Customization for Information Retrieval

SAGA: A Participant-specific Examination of Story Alternatives and Goal Applicability for a Deeper Understanding of Complex Events

Synthesizing Text-to-SQL Data from Weak and Strong LLMs

Let's Go Real Talk: Spoken Dialogue Model for Face-to-Face Conversation

Dual Operating Modes of In-Context Learning

Mitigating Catastrophic Forgetting in Language Transfer via Model Merging

LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement

LLMs-as-Instructors: Learning from Errors Toward Automating Model Improvement

Applying Ensemble Methods to Model-Agnostic Machine-Generated Text Detection

Let's Learn Step by Step: Enhancing In-Context Learning Ability with Curriculum Learning

MLLM-Protector: Ensuring MLLM's Safety without Hurting Performance

SViTT-Ego: A Sparse Video-Text Transformer for Egocentric Video

Beyond Traditional Benchmarks: Analyzing Behaviors of Open LLMs on Data-to-Text Generation

LLMs as Bridges: Reformulating Grounded Multimodal Named Entity Recognition

OpenLLM-Ro -- Technical Report on Open-source Romanian LLMs