语言大模型 / LLM

Breeze-7B Technical Report

Chan-Jan Hsu, Chang-Le Liu, Feng-Ting Liao, Po-Chun Hsu, Yi-Chang Chen, Da-Shan Shiu

专题命中 预训练与数据 ：language model(abstract)；pretraining(abstract)；分类 cs.CL

Constructing Cross-lingual Consumer Health Vocabulary with Word-Embedding from Comparable User Generated Content

Chia-Hsuan Chang, Lei Wang, Christopher C. Yang

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments accepted in the IEEE International Conference on Healthcare Informatics (IEEE ICHI 2024)

Can I Trust Your Answer? Visually Grounded Video Question Answering

Junbin Xiao, Angela Yao, Yicong Li, Tat Seng Chua

专题命中 预训练与数据 ：language model(abstract)；pretraining(abstract)；分类 cs.AI

Comments Accepted to CVPR'24. (Compared with preprint version, we mainly improve the presentation, discuss more related works, and extend experiments in Appendix.)

The Impact of Prompts on Zero-Shot Detection of AI-Generated Text

Kaito Taguchi, Yujie Gu, Kouichi Sakurai

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.AI

HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data

Qifan Yu, Juncheng Li, Longhui Wei, Liang Pang, Wentao Ye, Bosheng Qin, Siliang Tang, Qi Tian, Yueting Zhuang

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.AI

Comments Accepted by CVPR 2024

InstaSynth: Opportunities and Challenges in Generating Synthetic Instagram Data with ChatGPT for Sponsored Content Detection

Thales Bertaglia, Lily Heisig, Rishabh Kaushal, Adriana Iamnitchi

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments To appear at the 18th International AAAI Conference on Web and Social Media (ICWSM 2024) -- please cite accordingly

Syn-QA2: Evaluating False Assumptions in Long-tail Questions with Synthetic QA Datasets

Ashwin Daswani, Rohan Sawant, Najoung Kim

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments Preprint

VIXEN: Visual Text Comparison Network for Image Difference Captioning

Alexander Black, Jing Shi, Yifei Fan, Tu Bui, John Collomosse

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments AAAI 2024

From "um" to "yeah": Producing, predicting, and regulating information flow in human conversation

Claire Augusta Bergey, Simon DeDeo

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments 18 pages, 4 figures, comments welcome

Premonition: Using Generative Models to Preempt Future Data Changes in Continual Learning

Mark D. McDonnell, Dong Gong, Ehsan Abbasnejad, Anton van den Hengel

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.LG

Comments 31 pages total (14 main paper, 5 references, 12 appendices)

Poisoning Programs by Un-Repairing Code: Security Concerns of AI-generated Code

Cristina Improta

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.AI

Comments Accepted at The 1st IEEE International Workshop on Reliable and Secure AI for Software Engineering (ReSAISE), co-located with ISSRE 2023

Large Trajectory Models are Scalable Motion Predictors and Planners

Qiao Sun, Shiduo Zhang, Danjiao Ma, Jingzhe Shi, Derun Li, Simian Luo, Yu Wang, Ningyi Xu, Guangzhi Cao, Hang Zhao

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.AI

Acquiring Linguistic Knowledge from Multimodal Input

Theodor Amariucai, Alex Warstadt

专题命中 预训练与数据 ：language model(abstract)；pretraining(abstract)；分类 cs.CL

Comments in Proceedings of the BabyLM Challenge at the 27th Conference on Computational Natural Language Learning

Unified View of Grokking, Double Descent and Emergent Abilities: A Perspective from Circuits Competition

Yufei Huang, Shengding Hu, Xu Han, Zhiyuan Liu, Maosong Sun

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.LG

Comments 13 pages, 10 figures

LongWanjuan: Towards Systematic Measurement for Long Text Quality

Kai Lv, Xiaoran Liu, Qipeng Guo, Hang Yan, Conghui He, Xipeng Qiu, Dahua Lin

专题命中 预训练与数据 ：language model(abstract)；foundation model(abstract)；分类 cs.CL

Comments Update Figures

Code Needs Comments: Enhancing Code LLMs with Comment Augmentation

Demin Song, Honglin Guo, Yunhua Zhou, Shuhao Xing, Yudong Wang, Zifan Song, Wenwei Zhang, Qipeng Guo, Hang Yan, Xipeng Qiu, Dahua Lin

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Can LLMs Compute with Reasons?

Harshit Sandilya, Peehu Raj, Jainit Sushil Bafna, Srija Mukhopadhyay, Shivansh Sharma, Ellwil Sharma, Arastu Sharma, Neeta Trivedi, Manish Shrivastava, Rajesh Kumar

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments 8 pages

Exploring the Maze of Multilingual Modeling

Sina Bagheri Nezhad, Ameeta Agrawal

专题命中 预训练与数据 ：language model(abstract)；pretraining(abstract)；分类 cs.CL

JOBSKAPE: A Framework for Generating Synthetic Job Postings to Enhance Skill Matching

Antoine Magron, Anna Dai, Mike Zhang, Syrielle Montariol, Antoine Bosselut

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments Published at NLP4HR 2024 (EACL Workshop)

Probing Critical Learning Dynamics of PLMs for Hate Speech Detection

Sarah Masud, Mohammad Aflah Khan, Vikram Goyal, Md Shad Akhtar, Tanmoy Chakraborty

专题命中 预训练与数据 ：language model(abstract)；pretraining(abstract)；分类 cs.CL

Comments 20 pages, 9 figures, 14 tables. Accepted at EACL'24

Exploring the limits of decoder-only models trained on public speech recognition corpora

Ankit Gupta, George Saon, Brian Kingsbury

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

SPECTRUM: Speaker-Enhanced Pre-Training for Long Dialogue Summarization

Sangwoo Cho, Kaiqiang Song, Chao Zhao, Xiaoyang Wang, Dong Yu

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments 11 pages, 2 figures

Automatically Testing Functional Properties of Code Translation Models

Hasan Ferit Eniser, Valentin Wüstholz, Maria Christakis

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.LG

Comments 13 pages including appendix and references

Like a Good Nearest Neighbor: Practical Content Moderation and Text Classification

Luke Bates, Iryna Gurevych

专题命中 预训练与数据 ：language model(abstract)；prompting(abstract)；分类 cs.CL

Comments Accepted to EACL 2024

BootPIG: Bootstrapping Zero-shot Personalized Image Generation Capabilities in Pretrained Diffusion Models

Senthil Purushwalkam, Akash Gokul, Shafiq Joty, Nikhil Naik

专题命中 预训练与数据 ：LLM(abstract)；pretraining(abstract)；分类 cs.AI

Consistency Guided Knowledge Retrieval and Denoising in LLMs for Zero-shot Document-level Relation Triplet Extraction

Qi Sun, Kun Huang, Xiaocui Yang, Rong Tong, Kun Zhang, Soujanya Poria

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments Accepted by WWW 2024

Oolong: Investigating What Makes Transfer Learning Hard with Controlled Studies

Zhengxuan Wu, Alex Tamkin, Isabel Papadimitriou

专题命中 预训练与数据 ：language model(abstract)；pretraining(abstract)；分类 cs.CL

Comments EMNLP 2023

Quantum Transfer Learning for Acceptability Judgements

Giuseppe Buonaiuto, Raffaele Guarasci, Aniello Minutolo, Giuseppe De Pietro, Massimo Esposito

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Entity Recognition from Colloquial Text

Tamara Babaian, Jennifer Xu

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Journal ref Decision Support Systems, Volume 179, 2024,114172, ISSN 0167-9236

SyCoCa: Symmetrizing Contrastive Captioners with Attentive Masking for Multimodal Alignment

Ziping Ma, Furong Xu, Jian Liu, Ming Yang, Qingpei Guo

专题命中 预训练与数据 ：language model(abstract)；pretraining(abstract)；分类 cs.AI