语言大模型 / LLM - arXivDaily 专题

2405.20649 2024-06-03 cs.CL cs.LG 62%

Reward-based Input Construction for Cross-document Relation Extraction

Byeonghu Na, Suhyeon Jo, Yeongmin Kim, Il-Chul Moon

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

Comments Accepted at ACL 2024 main conference

2405.15318 2024-05-27 cs.CL cs.AI 62%

Are Long-LLMs A Necessity For Long-Context Tasks?

Hongjin Qian, Zheng Liu, Peitian Zhang, Kelong Mao, Yujia Zhou, Xu Chen, Zhicheng Dou

专题命中长上下文与记忆：LLM(abstract)；分类 cs.CL、cs.AI

Comments 18 pages

2405.06321 2024-05-16 cs.CL cond-mat.stat-mech cs.AI 62%

Correlation Dimension of Natural Language in a Statistical Manifold

Xin Du, Kumiko Tanaka-Ishii

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.AI

Comments Published at Physical Review Research

Journal ref Physical Review Research, 6(2), L022028 (2024)

2405.06709 2024-05-14 cs.CL cs.AI 62%

Evaluating the Efficacy of AI Techniques in Textual Anonymization: A Comparative Study

Dimitris Asimopoulos, Ilias Siniosoglou, Vasileios Argyriou, Sotirios K. Goudos, Konstantinos E. Psannis, Nikoleta Karditsioti, Theocharis Saoulidis, Panagiotis Sarigiannidis

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.AI

2404.12526 2024-04-22 cs.LG cs.CL cs.CV 62%

Adaptive Memory Replay for Continual Learning

James Seale Smith, Lazar Valkov, Shaunak Halbe, Vyshnavi Gutta, Rogerio Feris, Zsolt Kira, Leonid Karlinsky

专题命中长上下文与记忆：foundation model(abstract)；分类 cs.CL、cs.LG

Comments CVPR-W 2024 (Spotlight)

2403.15434 2024-03-26 cs.CL cs.AI 62%

ChatPattern: Layout Pattern Customization via Natural Language

Zixiao Wang, Yunheng Shen, Xufeng Yao, Wenqian Zhao, Yang Bai, Farzan Farnia, Bei Yu

专题命中长上下文与记忆：LLM(abstract)；分类 cs.CL、cs.AI

Comments Accepted by DAC24

2310.01777 2024-03-26 cs.CL cs.LG 62%

SEA: Sparse Linear Attention with Estimated Attention Mask

Heejun Lee, Jina Kim, Jeffrey Willette, Sung Ju Hwang

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

Comments 9 main pages

2402.17546 2024-02-28 cs.AI cs.CL 62%

COCOA: CBT-based Conversational Counseling Agent using Memory Specialized in Cognitive Distortions and Dynamic Prompt

Suyeon Lee, Jieun Kang, Harim Kim, Kyoung-Mee Chung, Dongha Lee, Jinyoung Yeo

专题命中长上下文与记忆：prompting(abstract)；分类 cs.CL、cs.AI

Comments 4 pages, 2 figures

2402.16482 2024-02-27 cs.AI cs.CE cs.CL 62%

On Languaging a Simulation Engine

Han Liu, Liantang Li

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.AI

2401.11626 2024-02-27 cs.LG cs.CL 62%

Freely Long-Thinking Transformer (FraiLT)

Akbay Tabak

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

2402.13208 2024-02-21 cs.CL cs.AI 62%

How do Hyenas deal with Human Speech? Speech Recognition and Translation with ConfHyena

Marco Gaido, Sara Papi, Matteo Negri, Luisa Bentivogli

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.AI

Comments Accepted at LREC-COLING 2024

2305.02437 2023-12-27 cs.CL cs.AI 62%

Lift Yourself Up: Retrieval-augmented Text Generation with Self Memory

Xin Cheng, Di Luo, Xiuying Chen, Lemao Liu, Dongyan Zhao, Rui Yan

专题命中长上下文与记忆：LLM(abstract)；分类 cs.CL、cs.AI

Comments Neurips 2023

2305.05091 2023-12-19 cs.CL cs.AI cs.HC 62%

Knowledge-enhanced Agents for Interactive Text Games

Prateek Chhikara, Jiarui Zhang, Filip Ilievski, Jonathan Francis, Kaixin Ma

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.AI

Comments Published at K-CAP '23

2306.09364 2023-12-12 cs.LG cs.AI 62%

TSMixer: Lightweight MLP-Mixer Model for Multivariate Time Series Forecasting

Vijay Ekambaram, Arindam Jati, Nam Nguyen, Phanwadee Sinthong, Jayant Kalagnanam

专题命中长上下文与记忆：foundation model(abstract)；分类 cs.AI、cs.LG

Comments Accepted in the Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD 23), Research Track. Delayed release in arXiv to comply with the conference policies on the double-blind review process. This paper has been submitted to the KDD peer-review process on Feb 02, 2023

2305.13877 2023-12-11 cs.CL cs.AI 62%

NarrativeXL: A Large-scale Dataset For Long-Term Memory Models

Arseny Moskvichev, Ky-Vinh Mai

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.AI

2311.18194 2023-12-01 cs.LG cs.CL 62%

Positional Information Matters for Invariant In-Context Learning: A Case Study of Simple Function Classes

Yongqiang Chen, Binghui Xie, Kaiwen Zhou, Bo Han, Yatao Bian, James Cheng

专题命中长上下文与记忆：LLM(abstract)；分类 cs.CL、cs.LG

Comments Ongoing work; preliminary version

2305.04859 2023-11-21 cs.CL cs.AI 62%

A Frustratingly Easy Improvement for Position Embeddings via Random Padding

Mingxu Tao, Yansong Feng, Dongyan Zhao

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.AI

2311.08123 2023-11-15 cs.LG cs.CL 62%

Memory-efficient Stochastic methods for Memory-based Transformers

Vishwajit Kumar Vishnu, C. Chandra Sekhar

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

2309.13543 2023-09-26 cs.CL cs.LG 62%

Substituting Data Annotation with Balanced Updates and Collective Loss in Multi-label Text Classification

Muberra Ozmen, Joseph Cotnareanu, Mark Coates

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

Comments Proc. Conf. Lifelong Learning Agents (CoLLAs), 2023

2309.08868 2023-09-19 cs.CL cs.AI 62%

MHLAT: Multi-hop Label-wise Attention Model for Automatic ICD Coding

Junwen Duan, Han Jiang, Ying Yu

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.AI

Comments 5 pages, 1 figure, accepted in ICASSP 2023

2304.11461 2023-04-25 cs.LG cs.CL cs.NE cs.SD eess.AS 62%

Recurrent Neural Networks and Long Short-Term Memory Networks: Tutorial and Survey

Benyamin Ghojogh, Ali Ghodsi

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

Comments To appear as a part of an upcoming textbook on deep learning

2302.00003 2023-02-02 cs.LG cs.CL 62%

The Power of External Memory in Increasing Predictive Model Capacity

Cenk Baykal, Dylan J Cutler, Nishanth Dikkala, Nikhil Ghosh, Rina Panigrahy, Xin Wang

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

Comments arXiv admin note: substantial text overlap with arXiv:2301.13310

2207.06881 2022-12-09 cs.CL cs.LG 62%

Recurrent Memory Transformer

Aydar Bulatov, Yuri Kuratov, Mikhail S. Burtsev

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

Comments 36th Conference on Neural Information Processing Systems (NeurIPS 2022)

2204.13074 2022-10-25 cs.CL cs.AI 62%

Towards Teachable Reasoning Systems: Using a Dynamic Memory of User Feedback for Continual System Improvement

Bhavana Dalvi Mishra, Oyvind Tafjord, Peter Clark

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.AI

Comments accepted at EMNLP 2022

2210.02928 2022-10-21 cs.CL cs.AI cs.CV 62%

MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and Text

Wenhu Chen, Hexiang Hu, Xi Chen, Pat Verga, William W. Cohen

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.AI

Comments Accepted to EMNLP 2022 main conference

2203.12644 2022-10-14 cs.CL cs.LG 62%

Linearizing Transformer with Key-Value Memory

Yizhe Zhang, Deng Cai

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

Comments EMNLP2022. The two authors contributed equally

2209.15189 2022-10-03 cs.CL cs.AI 62%

Learning by Distilling Context

Charlie Snell, Dan Klein, Ruiqi Zhong

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.AI

2209.06505 2022-09-16 cs.CL cs.LG 62%

BERT-based Ensemble Approaches for Hate Speech Detection

Khouloud Mnassri, Praboda Rajapaksha, Reza Farahbakhsh, Noel Crespi

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

2106.04560 2022-06-22 cs.CV cs.AI cs.LG 62%

Scaling Vision Transformers

Xiaohua Zhai, Alexander Kolesnikov, Neil Houlsby, Lucas Beyer

专题命中长上下文与记忆：language model(abstract)；分类 cs.AI、cs.LG

Comments Xiaohua, Alex, and Lucas contributed equally; CVPR 2022

2206.06520 2022-06-15 cs.AI cs.CL 62%

Memory-Based Model Editing at Scale

Eric Mitchell, Charles Lin, Antoine Bosselut, Christopher D. Manning, Chelsea Finn

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.AI

Comments ICML 2022. Project site at https://sites.google.com/view/serac-editing

1. 长上下文与记忆 4797 篇

Reward-based Input Construction for Cross-document Relation Extraction

Are Long-LLMs A Necessity For Long-Context Tasks?

Correlation Dimension of Natural Language in a Statistical Manifold

Evaluating the Efficacy of AI Techniques in Textual Anonymization: A Comparative Study

Adaptive Memory Replay for Continual Learning

ChatPattern: Layout Pattern Customization via Natural Language

SEA: Sparse Linear Attention with Estimated Attention Mask

COCOA: CBT-based Conversational Counseling Agent using Memory Specialized in Cognitive Distortions and Dynamic Prompt

On Languaging a Simulation Engine

Freely Long-Thinking Transformer (FraiLT)

How do Hyenas deal with Human Speech? Speech Recognition and Translation with ConfHyena

Lift Yourself Up: Retrieval-augmented Text Generation with Self Memory

Knowledge-enhanced Agents for Interactive Text Games

TSMixer: Lightweight MLP-Mixer Model for Multivariate Time Series Forecasting

NarrativeXL: A Large-scale Dataset For Long-Term Memory Models

Positional Information Matters for Invariant In-Context Learning: A Case Study of Simple Function Classes

A Frustratingly Easy Improvement for Position Embeddings via Random Padding

Memory-efficient Stochastic methods for Memory-based Transformers

Substituting Data Annotation with Balanced Updates and Collective Loss in Multi-label Text Classification

MHLAT: Multi-hop Label-wise Attention Model for Automatic ICD Coding

Recurrent Neural Networks and Long Short-Term Memory Networks: Tutorial and Survey

The Power of External Memory in Increasing Predictive Model Capacity

Recurrent Memory Transformer

Towards Teachable Reasoning Systems: Using a Dynamic Memory of User Feedback for Continual System Improvement

MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and Text

Linearizing Transformer with Key-Value Memory

Learning by Distilling Context

BERT-based Ensemble Approaches for Hate Speech Detection

Scaling Vision Transformers

Memory-Based Model Editing at Scale