Can Transformer Memory Be Corrupted? Investigating Cache-Side Vulnerabilities in Large Language Models
Transformer记忆能否被破坏?调查大型语言模型中的缓存侧漏洞
Elias Hossain, Swayamjit Saha, Somshubhra Roy, Ravi Prasad
机构
*
College of Engineering and Computer Science, University of Central Florida(中央佛罗里达大学工程与计算机科学学院)
;
Department of Computer Science and Engineering, Mississippi State University(密苏里州立大学计算机科学与工程系)
;
Department of Electrical and Computer Engineering, North Carolina State University(北卡罗来纳州立大学电子与计算机工程系)
专题命中
长上下文与记忆
:language model(title,abstract);large language model(title);LLM(abstract);分类 cs.AI
How Implicit Bias Accumulates and Propagates in LLM Long-term Memory
隐性偏见如何在LLM长期记忆中积累和传播
Yiming Ma, Lixu Wang, Lionel Z. Wang, Hongkun Yang, Haoming Sun, Xin Xu, Jiaqi Wu, Bin Chen, Wei Dong
机构
*
International Research Center for Artificial Intelligence, Harbin Institute of Technology (Shenzhen), Shenzhen, China
;
Chongqing Research Institute of Harbin Institute of Technology, Chongqing, China
;
College of Computing
;
Data Science, Nanyang Technological University, Singapore
;
Department of Management
;
Marketing, The Hong Kong Polytechnic University, Hong Kong
;
Haide College, Ocean University of China, Qingdao, China
;
School of Computer Science, The University of Sheffield, Sheffield, UK
;
Department of Automation, Tsinghua University, Beijing, China
专题命中
长上下文与记忆
:LLM(title);large language model(abstract);language model(abstract);prompting(abstract)
AI总结
本文研究了LLM长期记忆中隐性偏见的积累与传播,提出动态内存标记方法以缓解偏见问题。
CommentsUnder review, and the first two authors contribute equally
机构
*
Equal Contribution 12pt Senior Authorship 0.15in 1Alibaba Cloud Computing, Beijing, China 0.05in 2Zhongguancun Academy, Beijing, China 0.05in 3Zhongguancun Institute of Artificial Intelligence, Beijing, China 0.05in 4University of Science
;
Technology of China, Hefei, China 0.05in 5State Key Laboratory of Genome
;
Multi-omics Technologies, Shenzhen Branch, Guangdong Laboratory for Lingnan Modern Agriculture, Key Laboratory of Livestock
;
Poultry Multi-Omics of MARA, Agricultural Genomics Institute at Shenzhen, Chinese Academy of Agricultural Sciences, Shenzhen, China 0.05in 6Innovation Group of Pig Genome Design
;
Breeding, Research Centre for Animal Genome, Agricultural Genomics Institute at Shenzhen, Chinese Academy of Agricultural Sciences, Shenzhen, China 0.05in 7The Hong Kong University of Science
;
Technology (Guangzhou), Guangzhou, China 0.05in 8The Hong Kong University of Science
;
Technology , Hong Kong SAR, China 0.05in 9Mila - Qu\'ebec AI Institute, Montr\'eal, Canada 0.05in 10University of Montr\'eal, Montr\'eal, Canada 0.05in 11HEC Montr\'eal, Montr\'eal, Canada 0.05in 12CIFAR AI Chair, Canada 0.05in 13Carnegie Mellon University, Pittsburgh, USA 0.15in to
专题命中
长上下文与记忆
:foundation model(title,abstract);large language model(abstract);language model(abstract);分类 cs.CL
Enhancing few-shot time series forecasting with LLM-guided diffusion
通过LLM引导扩散增强少样本时间序列预测
Haonan Shi, Dehua Shuai, Liming Wang, Xiyang Liu, Long Tian
机构
*
School of Computer Science and Technology, Xidian University(西安电子科技大学计算机科学与技术学院)
;
Hangzhou Institute of Technology, Xidian University(西安电子科技大学杭州研究院)
专题命中
长上下文与记忆
:LLM(title);large language model(abstract);language model(abstract);分类 cs.AI、cs.LG
机构
*
UCAS-Terminus AI Lab, University of Chinese Academy of Sciences(中国科学院大学Terminus AI实验室,中国科学院大学)
;
Centre for Artificial Intelligence and Robotics, HKISI-CAS(人工智能与机器人中心,中国科学院香港研究院)
;
School of Computer Science and Engineering, Nanjing University of Science and Technology(南京理工大学计算机科学与工程学院)
专题命中
长上下文与记忆
:LLM(abstract);large language model(abstract);language model(abstract);分类 cs.LG
机构
*
Beijing Advanced Innovation Center for Future Blockchain and Privacy Computing, School of Artificial Intelligence, Beihang University(北京未来区块链与隐私计算创新中心,人工智能学院,北京航空航天大学)
;
National University of Singapore(新加坡国立大学)
;
Tsinghua University(清华大学)
;
BNRist, Tsinghua University(BNRist,清华大学)
专题命中
长上下文与记忆
:LLM(abstract);large language model(abstract);language model(abstract);分类 cs.CL
FreshMem: Brain-Inspired Frequency-Space Hybrid Memory for Streaming Video Understanding
FreshMem: 基于大脑的频率-空间混合内存用于流视频理解
Kangcong Li, Peng Ye, Lin Zhang, Chao Wang, Huafeng Qin, Tao Chen
机构
*
College of Future Information Technology, Fudan University, Shanghai, China(复旦大学未来信息科技学院)
;
Shanghai Innovation Institute, Shanghai, China(上海创新研究院)
;
Shanghai Artificial Intelligence Laboratory, Shanghai, China(上海人工智能实验室)
;
The Chinese University of Hong Kong, Hong Kong, China(香港中文大学)
专题命中
长上下文与记忆
:large language model(abstract);language model(abstract);分类 cs.AI
Softmax Linear Attention: Reclaiming Global Competition
Mingwei Xu, Xuan Lin, Xinnan Guo, Wanqing Xu, Wanyun Cui
机构
*
MoE Key Laboratory of Interdisciplinary Research of Computation and Economics(跨学科计算与经济研究莫艾实验室)
;
Shanghai University of Finance and Economics(上海财经大学)
机构
*
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
;
School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)