Embodied and edge systems increasingly rely on vision-language models (VLMs) to support heterogeneous skills, yet deploying a separate task adapter for each skill while retaining a high-precision backbone creates substantial memory and management costs. We present UniCompress, a deployment-oriented framework that converts multi-task expertise into one compact, adapter-free model. Starting from a consolidated BF16 Qwen3-VL-4B teacher, UniCompress constructs an asymmetric INT2 student using GPTQ initialization and teacher-guided quantization recovery. The approach jointly quantizes and recovers the projection weights in the vision encoder and language backbone, enabling aggressive compression of the complete vision-language model while preserving its multi-task behavior. We evaluate UniCompress on four heterogeneous embodied tasks: posture recognition, household-safety understanding, multimodal dialogue routing, and mobile-GUI action prediction. UniCompress reduces the approximate weight storage from 8.9 GB in BF16 to 2.1 GB in INT2, corresponding to a reduction of approximately 76%. It improves the INT2 macro task score by 34.3 percentage points over GPTQ-INT2 while remaining within 0.9 points of the consolidated BF16 teacher. These results demonstrate the potential of teacher-guided joint vision-language INT2 recovery for deploying a single multi-skill VLM on resource-constrained embodied platforms.
A Lightweight LLM Framework for Disaster Humanitarian Information Classification
Department of Civil, Architectural & Environment Engineering, Sungkyunkwan University(苏州市立大学土木、建筑与环境工程系);School of Geography, University of Leeds(利兹大学地理学院)
Flexora: Flexible Low Rank Adaptation for Large Language Models
College of Computer Science and Software Engineering, Shenzhen University(深圳大学计算机科学与软件工程学院);Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ)(广东人工智能与数字经济实验室);Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));School of Information Technology, Carleton University(卡尔顿大学信息科技学院)
PFAdapter: Hierarchical LoRA Decomposition for Personalized Federated MLLMs
College of Future Information Technology, Fudan University(复旦大学未来信息技术学院);Division of Natural and Applied Sciences, Duke Kunshan University(昆山杜克大学自然科学与应用科学部);Department of Electrical and Computer Engineering, The University of British Columbia(英属哥伦比亚大学电气与计算机工程系);Ant Group(蚂蚁集团);College of Information Science and Electronic Engineering, Zhejiang University(浙江大学信息科学与电子工程学院);School of Data Science and Engineering, East China Normal University(华东师范大学数据科学与工程学院);College of Intelligent Robotics and Advanced Manufacturing, Fudan University & Fysics AI(复旦大学智能机器人与先进制造学院及复肆智能科技(上海)有限公司);Xiaomi EV, Xiaomi Campus(小米汽车、小米园区);Information and Communications Technology Cluster, Singapore Institute of Technology (SIT)(新加坡理工学院信息通信技术集群);College of Electronic and Information Engineering, Tongji University(同济大学电子与信息工程学院);School of Computer Science and Informatics, Cardiff University(卡迪夫大学计算机科学与信息学院)
Low-Rank Adaptation for Foundation Models: A Comprehensive Review
Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Yale University(耶鲁大学);Nanyang Technological University(南洋理工大学);Central University of Finance and Economics(中央财经大学);The Chinese University of Hong Kong(香港中文大学);Xi’an University of Electronic Science and Technology(西安电子科技大学);University of California, Davis(加州大学戴维斯分校);The University of Cambridge(剑桥大学);LOGS AI
MODF-SIR: A Multi-agent Omni-modal Distilled Framework for Social Intelligence Reasoning
School of Information Science and Engineering, Lanzhou University(兰州大学信息科学与工程学院);School of Medical Technology, Beijing Institute of Technology(北京理工大学医学技术学院);Cloud and AI BU, Huawei(华为云与AI业务部);School of Computing, National University of Singapore(新加坡国立大学计算机学院)
Preserving Privacy, Increasing Accessibility, and Reducing Cost: An On-Device Artificial Intelligence Model for Medical Transcription and Note Generation
School of Computer Science and Technology, Anhui University(计算机科学与技术学院,安徽大学);School of Electronic and Information Engineering, Anhui University(电子与信息工程学院,安徽大学)
Crab$^{+}$: A Scalable and Unified Audio-Visual Scene Understanding Model with Explicit Cooperation
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学耿丽人工智能学院);Institute of Artificial Intelligence of China Telecom (TeleAI)(中国电信人工智能研究院);AI Technology Center, Online Video Business Unit, Tencent PCG(腾讯PCG在线视频业务单元AI技术中心);Hefei University of Technology(合肥工业大学);The University of Hong Kong(香港大学)
Enhancing Adversarial Robustness of Vision-Language Models through Low-Rank Adaptation
Institute of Automation, CAS(中国科学院自动化研究所);School of Artificial Intelligence, UCAS(中国科学院大学人工智能学院);Institute of Data Science, National University of Singapore(新加坡国立大学数据科学研究所);Beijing University of Posts and Telecommunications(北京邮电大学);Beijing Academy of Artificial Intelligence(北京人工智能研究院)
A Federated Fine-Tuning Paradigm of Foundation Models in Heterogenous Wireless Networks
Wireless AI System Research Team, China Telecom Research Institute(中国电信研究院无线AI系统研究团队);The State Key Laboratory of Networking and Switching Technology Beijing University of Posts and Telecommunications(北京邮电大学网络与交换技术国家重点实验室);Singapore University of Technology and Design(新加坡科技设计大学)
V2X-QA: A Comprehensive Reasoning Dataset and Benchmark for Multimodal Large Language Models in Autonomous Driving Across Ego, Infrastructure, and Cooperative Views
Department of Civil and Environmental Engineering, University of Wisconsin–Madison(威斯康星大学麦迪逊分校土木与环境工程系);Department of Civil and Architectural Engineering and Construction Management, University of Wyoming(怀俄明大学土木与建筑工程及施工管理系);School of Transportation, Southeast University(东南大学交通学院)