语言大模型 / LLM

Unraveling Feature Extraction Mechanisms in Neural Networks

Xiaobing Sun, Jiaxi Li, Wei Lu

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments Accepted by EMNLP 2023

Interpreting Answers to Yes-No Questions in User-Generated Content

Shivam Mathur, Keun Hee Park, Dhivya Chinnappa, Saketh Kotamraju, Eduardo Blanco

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments Accepted at the Findings of EMNLP 2023

Towards Harmful Erotic Content Detection through Coreference-Driven Contextual Analysis

Inez Okulska, Emilia Wiśnios

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments Accepted for 6th Workshop on Computational Models of Reference, Anaphora and Coreference at EMNLP 2023 Conference

Equivariant Transformer is all you need

Akio Tomiya, Yuki Nagai

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.LG

Comments 7 pages, 4 figures, contribution for the 40th International Symposium on Lattice Field Theory (Lattice 2023), July 31st - August 4th, 2023, Fermi National Accelerator Laboratory

An Information-Theoretic Analysis of Compute-Optimal Neural Scaling Laws

Hong Jun Jeon, Benjamin Van Roy

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.LG

The Interpreter Understands Your Meaning: End-to-end Spoken Language Understanding Aided by Speech Translation

Mutian He, Philip N. Garner

专题命中 预训练与数据 ：language model(abstract)；pretraining(abstract)；分类 cs.CL

Comments 16 pages, 3 figures; accepted by Findings of EMNLP 2023

One For All & All For One: Bypassing Hyperparameter Tuning with Model Averaging For Cross-Lingual Transfer

Fabian David Schmidt, Ivan Vulić, Goran Glavaš

专题命中 预训练与数据 ：language model(abstract)；pretraining(abstract)；分类 cs.CL

Comments Accepted to findings of EMNLP 2023

Dobby: A Conversational Service Robot Driven by GPT-4

Carson Stark, Bohkyung Chun, Casey Charleston, Varsha Ravi, Luis Pabon, Surya Sunkari, Tarun Mohan, Peter Stone, Justin Hart

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.AI

Augmented Embeddings for Custom Retrievals

Anirudh Khatry, Yasharth Bajpai, Priyanshu Gupta, Sumit Gulwani, Ashish Tiwari

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.LG

Comments 14 pages

The Devil is in the Details: A Deep Dive into the Rabbit Hole of Data Filtering

Haichao Yu, Yu Tian, Sateesh Kumar, Linjie Yang, Heng Wang

专题命中 预训练与数据 ：language model(abstract)；foundation model(abstract)；分类 cs.LG

Comments 12 pages, 10 figures

ArguGPT: evaluating, understanding and identifying argumentative essays generated by GPT models

Yikang Liu, Ziyin Zhang, Wanyang Zhang, Shisen Yue, Xiaojing Zhao, Xinyuan Cheng, Yiwen Zhang, Hai Hu

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Improving Robustness of Neural Inverse Text Normalization via Data-Augmentation, Semi-Supervised Learning, and Post-Aligning Method

Juntae Kim, Minkyu Lim, Seokjin Hong

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments submitted to ICASSP 2024

A Methodology for Generative Spelling Correction via Natural Spelling Errors Emulation across Multiple Domains and Languages

Nikita Martynov, Mark Baushenko, Anastasia Kozlova, Katerina Kolomeytseva, Aleksandr Abramov, Alena Fenogenova

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments to appear in EACL 2024

CONVERSER: Few-Shot Conversational Dense Retrieval with Synthetic Data Generation

Chao-Wei Huang, Chen-Yu Hsu, Tsu-Yuan Hsu, Chen-An Li, Yun-Nung Chen

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments Accepted to SIGDIAL 2023

ExpCLIP: Bridging Text and Facial Expressions via Semantic Alignment

Yicheng Zhong, Huawei Wei, Peiji Yang, Zhisheng Wang

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.AI

Self-Supervised Masked Digital Elevation Models Encoding for Low-Resource Downstream Tasks

Priyam Mazumdar, Aiman Soliman, Volodymyr Kindratenko, Luigi Marini, Kenton McHenry

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.AI

Masked Momentum Contrastive Learning for Zero-shot Semantic Understanding

Jiantao Wu, Shentong Mo, Muhammad Awais, Sara Atito, Zhenhua Feng, Josef Kittler

专题命中 预训练与数据 ：pretraining(abstract)；prompting(abstract)；分类 cs.LG

DepreSym: A Depression Symptom Annotated Corpus and the Role of LLMs as Assessors of Psychological Markers

Anxo Pérez, Marcos Fernández-Pichel, Javier Parapar, David E. Losada

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

The Emergence of Essential Sparsity in Large Pre-trained Models: The Weights that Matter

Ajay Jaiswal, Shiwei Liu, Tianlong Chen, Zhangyang Wang

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.LG

Comments Added new results on LLMs and N:M Sparsity

SurgicalGPT: End-to-End Language-Vision GPT for Visual Question Answering in Surgery

Lalithkumar Seenivasan, Mobarakol Islam, Gokul Kannan, Hongliang Ren

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.AI

Comments The manuscript is accepted in MICCAI 2023. Code are available at: https://github.com/lalithjets/SurgicalGPT

MotionGPT: Human Motion as a Foreign Language

Biao Jiang, Xin Chen, Wen Liu, Jingyi Yu, Gang Yu, Tao Chen

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments Project Page: https://github.com/OpenMotionLab/MotionGPT

Is Prompt-Based Finetuning Always Better than Vanilla Finetuning? Insights from Cross-Lingual Language Understanding

Bolei Ma, Ercong Nie, Helmut Schmid, Hinrich Schütze

专题命中 预训练与数据 ：language model(abstract)；pretraining(abstract)；分类 cs.CL

Comments KONVENS 2023

CodeGen2: Lessons for Training LLMs on Programming and Natural Languages

Erik Nijkamp, Hiroaki Hayashi, Caiming Xiong, Silvio Savarese, Yingbo Zhou

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.LG

Cross-Lingual Retrieval Augmented Prompt for Low-Resource Languages

Ercong Nie, Sheng Liang, Helmut Schmid, Hinrich Schütze

专题命中 预训练与数据 ：language model(abstract)；pretraining(abstract)；分类 cs.CL

Comments Accepted to Findings of ACL 2023

ELQA: A Corpus of Metalinguistic Questions and Answers about English

Shabnam Behzad, Keisuke Sakaguchi, Nathan Schneider, Amir Zeldes

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments Accepted to ACL 2023

Product Information Extraction using ChatGPT

Alexander Brinkmann, Roee Shraga, Reng Chiz Der, Christian Bizer

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Neural Embeddings for Protein Graphs

Francesco Ceccarelli, Lorenzo Giusti, Sean B. Holden, Pietro Liò

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.LG

Comments 10 pages, 5 figures

Büyük dil modellerinin Türkçe verisetleri ile eğitilmesi ve ince ayarlanması

A. Taha Arslan

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments 7 pages

On the Difference of BERT-style and CLIP-style Text Encoders

Zhihong Chen, Guiming Hardy Chen, Shizhe Diao, Xiang Wan, Benyou Wang

专题命中 预训练与数据 ：language model(abstract)；pretraining(abstract)；分类 cs.CL

Comments Natural Language Processing. 10 pages, 1 figure. Findings of ACL-2023

An Approach to Solving the Abstraction and Reasoning Corpus (ARC) Challenge

Tan John Chong Min

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.AI

Comments 14 pages