ERA: Entropy-Guided Visual Token Pruning with Rectified Attention for Efficient MLLMs
ERA:基于熵引导的视觉令牌剪枝与修正注意力机制的高效多模态大语言模型
Yuhao Wang, Mu Qiao, Haiwen Diao, Yunzhi Zhuge, Pingping Zhang, Xindong Zhang, Lei Zhang, Huchuan Lu
机构
*
School of Future Technology, Dalian University of Technology(大连理工大学未来技术学院)
;
S-Lab, Nanyang Technological University(南洋理工大学S-Lab)
;
OPPO Research Institute(OPPO研究院)
;
Department of Computing, The Hong Kong Polytechnic University(香港理工大学计算机系)
专题命中
效率与部署
:large language model(abstract);language model(abstract)
OmniSpace: Efficient Geometry Awareness for Autonomous Vehicles MLLMs
OmniSpace: 自动驾驶多模态大语言模型的高效几何感知
Hao Vo, Phu Loc Nguyen, Khoa Vo, Sieu Tran, Duc Minh Nguyen, Ngo Xuan Cuong, Nghi D. Q. Bui, Anh Nguyen, Duy Minh Ho Nguyen, Ngan Le
机构
*
University of Arkansas(阿肯色大学)
;
Google Research, Google(谷歌研究院)
;
University of Liverpool(利物浦大学)
;
Max Planck Research School for Intelligent Systems(马克斯·普朗克智能系统研究所)
专题命中
效率与部署
:large language model(abstract);language model(abstract)
MLLMs Get It Right, Then Get It Wrong: Tracing and Correcting Late-Layer Textual Bias
MLLMs 先正确后错误:追踪并纠正后层文本偏见
Xingming Li, Ao Cheng, Qiyao Sun, Xixiang He, Xuanyu Ji, Runke Huang, Qingyong Hu
机构
*
National University of Defense Technology(国防科技大学)
;
Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳))
;
Intelligent Game and Decision Lab(智能博弈与决策实验室)
专题命中
效率与部署
:large language model(abstract);language model(abstract)