语言大模型 / LLM

RAVEN: Multitask Retrieval Augmented Vision-Language Learning

Varun Nagaraj Rao, Siddharth Choudhary, Aditya Deshpande, Ravi Kumar Satzoda, Srikar Appalaraju

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.AI

Annotating FrameNet via Structure-Conditioned Language Generation

Xinyue Cui, Swabha Swayamdipta

专题命中 预训练与数据 ：language model(abstract)；prompting(abstract)；分类 cs.CL

Comments This paper has been accepted to ACL 2024

BiPFT: Binary Pre-trained Foundation Transformer with Low-rank Estimation of Binarization Residual Polynomials

Xingrun Xing, Li Du, Xinyuan Wang, Xianlin Zeng, Yequan Wang, Zheng Zhang, Jiajun Zhang

专题命中 预训练与数据 ：foundation model(abstract)；pretraining(abstract)；分类 cs.LG

Journal ref Proceedings of the AAAI Conference on Artificial Intelligence. 2024, 38(14): 16094-16102

Text Grafting: Near-Distribution Weak Supervision for Minority Classes in Text Classification

Letian Peng, Yi Gu, Chengyu Dong, Zihan Wang, Jingbo Shang

专题命中 预训练与数据 ：LLM(abstract)；prompting(abstract)；分类 cs.CL

MC$^2$: Towards Transparent and Culturally-Aware NLP for Minority Languages in China

Chen Zhang, Mingxu Tao, Quzhe Huang, Jiuheng Lin, Zhibin Chen, Yansong Feng

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments ACL 2024 https://github.com/luciusssss/mc2_corpus

Compute Better Spent: Replacing Dense Layers with Structured Matrices

Shikai Qiu, Andres Potapczynski, Marc Finzi, Micah Goldblum, Andrew Gordon Wilson

专题命中 预训练与数据 ：language model(abstract)；foundation model(abstract)；分类 cs.LG

Comments ICML 24. Code available at https://github.com/shikaiqiu/compute-better-spent

Towards Understanding Task-agnostic Debiasing Through the Lenses of Intrinsic Bias and Forgetfulness

Guangliang Liu, Milad Afshari, Xitong Zhang, Zhiyu Xue, Avrajit Ghosh, Bidhan Bashyal, Rongrong Wang, Kristen Johnson

专题命中 预训练与数据 ：language model(abstract)；pretraining(abstract)；分类 cs.CL

GOMAA-Geo: GOal Modality Agnostic Active Geo-localization

Anindya Sarkar, Srikumar Sastry, Aleksis Pirinen, Chongjie Zhang, Nathan Jacobs, Yevgeniy Vorobeychik

专题命中 预训练与数据 ：foundation model(abstract)；pretraining(abstract)；分类 cs.AI

Comments 23 pages, 17 figures

Mobile-Agent-v2: Mobile Device Operation Assistant with Effective Navigation via Multi-Agent Collaboration

Junyang Wang, Haiyang Xu, Haitao Jia, Xi Zhang, Ming Yan, Weizhou Shen, Ji Zhang, Fei Huang, Jitao Sang

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments 22 pages, 11 figures, 10 Tables

That's Optional: A Contemporary Exploration of "that" Omission in English Subordinate Clauses

Ella Rabinovich

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments ACL2024 (main conference), 8 pages

ReMatch: Retrieval Enhanced Schema Matching with LLMs

Eitam Sheetrit, Menachem Brief, Moshik Mishaeli, Oren Elisha

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.AI

Ensuring Ground Truth Accuracy in Healthcare with the EVINCE framework

Edward Y. Chang

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.AI

Comments 23 pages, 4 tables, 4 figures

LoGAH: Predicting 774-Million-Parameter Transformers using Graph HyperNetworks with 1/100 Parameters

Xinyu Zhou, Boris Knyazev, Alexia Jolicoeur-Martineau, Jie Fu

专题命中 预训练与数据 ：language model(abstract)；pretraining(abstract)；分类 cs.LG

Comments 16 pages

Enhancing Compositional Generalization via Compositional Feature Alignment

Haoxiang Wang, Haozhe Si, Huajie Shao, Han Zhao

专题命中 预训练与数据 ：foundation model(abstract)；pretraining(abstract)；分类 cs.LG

Comments Published in Transactions on Machine Learning Research (TMLR). The code is released at https://github.com/Haoxiang-Wang/Compositional-Feature-Alignment

ProtT3: Protein-to-Text Generation for Text-based Protein Understanding

Zhiyuan Liu, An Zhang, Hao Fei, Enzhi Zhang, Xiang Wang, Kenji Kawaguchi, Tat-Seng Chua

专题命中 预训练与数据 ：language model(abstract)；pretraining(abstract)；分类 cs.CL

Comments ACL 2024, 9 pages

Searching Realistic-Looking Adversarial Objects For Autonomous Driving Systems

Shengxiang Sun, Shenzhe Zhu

专题命中 预训练与数据 ：language model(abstract)；pretraining(abstract)；分类 cs.AI

Escaping the sentence-level paradigm in machine translation

Matt Post, Marcin Junczys-Dowmunt

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Exploring the evolution of research topics during the COVID-19 pandemic

Francesco Invernici, Anna Bernasconi, Stefano Ceri

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments 16 pages, 6 figures, 1 table

Journal ref Expert Systems with Applications, Volume 252, Part A, 2024, 124028

Automated Program Repair: Emerging trends pose and expose problems for benchmarks

Joseph Renzullo, Pemma Reiter, Westley Weimer, Stephanie Forrest

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.LG

Comments 16 pages, 1 table, submitted to ACM Computing Surveys

ChuXin: 1.6B Technical Report

Xiaomin Zhuang, Yufan Jiang, Qiaozhi He, Zhihua Wu

专题命中 预训练与数据 ：language model(abstract)；pretraining(abstract)；分类 cs.CL

Comments Technical Report

Locally Differentially Private In-Context Learning

Chunyan Zheng, Keke Sun, Wenhao Zhao, Haibo Zhou, Lixin Jiang, Shaoyang Song, Chunlai Zhou

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.AI

Comments This paper was published at LREC-Coling 2024

Nyonic Technical Report

Junfeng Tian, Rui Wang, Cong Li, Yudong Zhou, Jun Liu, Jun Wang

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Is Mamba Capable of In-Context Learning?

Riccardo Grazzi, Julien Siems, Simon Schrodi, Thomas Brox, Frank Hutter

专题命中 预训练与数据 ：foundation model(abstract)；pretraining(abstract)；分类 cs.LG

"You are an expert annotator": Automatic Best-Worst-Scaling Annotations for Emotion Intensity Modeling

Christopher Bagdon, Prathamesh Karmalker, Harsha Gurulingappa, Roman Klinger

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments accepted for publication in NAACL 2024

CHisIEC: An Information Extraction Corpus for Ancient Chinese History

Xuemei Tang, Zekun Deng, Qi Su, Hao Yang, Jun Wang

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments 11 pages, 6 tables, 3 figures

Meta predictive learning model of languages in neural circuits

Chan Li, Junbin Qiu, Haiping Huang

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments 31 pages, 6 figures, codes are available in the main text with the link

Journal ref Phys. Rev. E 109, 044309 (2024)

REINFOREST: Reinforcing Semantic Code Similarity for Cross-Lingual Code Search Models

Anthony Saieva, Saikat Chakraborty, Gail Kaiser

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.AI

FewUser: Few-Shot Social User Geolocation via Contrastive Learning

Menglin Li, Kwan Hui Lim

专题命中 预训练与数据 ：language model(abstract)；prompting(abstract)；分类 cs.LG

Comments 17 pages, 3 figures, 8 tables, submitted to ECML-PKDD 2024 for review

Investigating Neural Machine Translation for Low-Resource Languages: Using Bavarian as a Case Study

Wan-Hua Her, Udo Kruschwitz

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments Preprint accepted at the 3rd Annual Meeting of the Special Interest Group on Under-resourced Languages (SIGUL 2024)

Measuring Cross-lingual Transfer in Bytes

Leandro Rodrigues de Souza, Thales Sales Almeida, Roberto Lotufo, Rodrigo Nogueira

专题命中 预训练与数据 ：language model(abstract)；pretraining(abstract)；分类 cs.CL

Comments NAACL 2024