多模态大模型

An Actionable Hierarchical Scene Representation Enhancing Autonomous Inspection Missions in Unknown Environments

Vignesh Kottayam Viswanathan, Mario Alberto Valdes Saucedo, Sumeet Gajanan Satpute, Christoforos Kanellakis, George Nikolakopoulos

机构 * Robotics and AI（机器人与人工智能） 纠错

专题命中 多模态训练与对齐 ：multi-modal(abstract)

Comments Accepted to IROS 2025

Zero-Shot Learning with Subsequence Reordering Pretraining for Compound-Protein Interaction

Hongzhi Zhang, Zhonglie Liu, Kun Meng, Jiameng Chen, Jia Wu, Bo Du, Di Lin, Yan Che, Wenbin Hu

机构 * School of Computer Science, Wuhan University（武汉大学计算机学院） ； Engineering Research Center for Big Data Application in Private Health Medicine of Fujian Universities, Putian University（福建省私人健康医学大数据应用工程研究中心，莆田大学） ； Macquarie University（麦考瑞大学） ； Wuhan University Shenzhen Research Institute（武汉大学深圳研究院） 纠错

专题命中 多模态训练与对齐 ：multimodal(abstract)

Meta Fusion: A Unified Framework For Multimodality Fusion with Mutual Learning

Ziyi Liang, Annie Qu, Babak Shahbaba

机构 * Department of Statistics, University of California, Irvine, CA, USA（统计学系，加州大学伊维奇分校） ； Department of Statistics and Applied Probability, University of California, Santa Barbara, CA, USA（统计学与应用概率系，加州大学圣巴巴拉分校） 纠错

专题命中 多模态训练与对齐 ：multimodal(abstract)

AF-RLIO: Adaptive Fusion of Radar-LiDAR-Inertial Information for Robust Odometry in Challenging Environments

Chenglong Qian, Yang Xu, Xiufang Shi, Jiming Chen, Liang Li

机构 * College of Information Engineering, Zhejiang University of Technology（浙江工业大学信息工程学院） ； College of Control Science and Engineering, Zhejiang University（浙江大学控制科学与工程学院） 纠错

专题命中 多模态训练与对齐 ：multimodal(abstract)

Latent Sensor Fusion: Multimedia Learning of Physiological Signals for Resource-Constrained Devices

Abdullah Ahmed, Jeremy Gummeson

机构 * University of Massachusetts Amherst（马萨诸塞大学阿默斯特分校） 纠错

专题命中 多模态训练与对齐 ：multimodal(abstract)

LightCurve MoE: A Dynamic Sparse Routing Mixture-of-Experts Architecture for Efficient Stellar Light Curve Classification

Cunshi Wang, Yu Bai, Xinrui Song, Jiacheng Xu, Henggeng Han, Yuyang Li, Xinjie Hu, Huiqin Yang, Jifeng Liu

专题命中 多模态训练与对齐 ：multi-modal(abstract)

Comments 40 pages, 23 figures

Gaussian Process-Based Active Exploration Strategies in Vision and Touch

Ho Jin Choi, Nadia Figueroa

机构 * Mechanical Engineering and Applied Mechanics（机械工程与应用力学） 纠错

专题命中 多模态训练与对齐 ：multi-modal(abstract)

Comments Master's Thesis, Mechanical Engineering and Applied Mechanics, University of Pennsylvania - April 2024 (https://events.seas.upenn.edu/event/meam-masters-thesis-defense-gaussian-process-based-active-exploration-strategies-in-vision-and-touch/) (https://blog.me.upenn.edu/ho-jin-choi-successfully-defends-masters-thesis/)

Feature Geometry for Stereo Sidescan and Forward-looking Sonar

Kalin Norman, Joshua G. Mangelson

机构 * Brigham Young University 纠错

专题命中 多模态训练与对齐 ：cross-modal(abstract)

Comments This is a submission to a workshop and was presented at the Workshop on Field Robotics, which was a part of ICRA 2025

From stellar light to astrophysical insight: automating variable star research with machine learning

Jeroen Audenaert

专题命中 多模态训练与对齐 ：multimodal(abstract)

Comments Author accepted version of Invited Review for 2024 Astronomy Prize Awardees Collection of Astrophysics and Space Science journal

A Survey of AI for Materials Science: Foundation Models, LLM Agents, Datasets, and Tools

Minh-Hao Van, Prateek Verma, Chen Zhao, Xintao Wu

机构 * Department of EECS University of Arkansas Fayetteville（电子工程与计算机科学系美国阿肯色大学弗莱维尔分校） ； Department of CS Baylor University Waco（计算机科学系贝勒大学沃斯堡） 纠错

专题命中 多模态训练与对齐 ：multimodal(abstract)

WebGuard++:Interpretable Malicious URL Detection via Bidirectional Fusion of HTML Subgraphs and Multi-Scale Convolutional BERT

Ye Tian, Zhang Yumin, Yifan Jia, Jianguo Sun, Yanbin Wang

机构 * Hangzhou Research Institute（杭州研究院） ； Xidian University（西安电子科技大学） ； Yantai Research Institute（烟台研究院） ； Harbin Engineering University（哈尔滨工程大学） 纠错

专题命中 多模态训练与对齐 ：cross-modal(abstract)

PG-LIO: Photometric-Geometric fusion for Robust LiDAR-Inertial Odometry

Nikhil Khedekar, Kostas Alexis

机构 * Autonomous Robots Lab, Norwegian University of Science and Technology (NTNU)（自主机器人实验室，挪威科学技术大学） 纠错

专题命中 多模态训练与对齐 ：multi-modal(abstract)

Comments 8 pages, 6 figures

Satellite Edge Artificial Intelligence with Large Models: Architectures and Technologies

Yuanming Shi, Jingyang Zhu, Chunxiao Jiang, Linling Kuang, Khaled B. Letaief

机构 * School of Information Science and Technology, ShanghaiTech University（信息科学与技术学院，上海科技大学） ； Beijing National Research Center for Information Science and Technology, Tsinghua University（信息科学与技术国家研究中心，清华大学） ； Department of Electronic and Computer Engineering, Hong Kong University of Science and Technology（电子与计算机工程系，香港理工大学） 纠错

专题命中 多模态训练与对齐 ：multimodal(abstract)

Comments 15 pages, 5 figures; submitted to SCIENCE CHINA Information Sciences for possible publication

Journal ref SCIENCE CHINA Information Sciences, Volume 68, Issue 7, 2025, Pages 170302-, ISSN 1674-733X

Differentiable neural network representation of multi-well, locally-convex potentials

Reese E. Jones, Adrian Buganza Tepole, Jan N. Fuhg

机构 * Sandia National Laboratories（桑地亚国家实验室） ； Columbia University（哥伦比亚大学） ； The University of Texas at Austin（德克萨斯大学奥斯汀分校） 纠错

专题命中 多模态训练与对齐 ：multimodal(abstract)

Comments 16 pages, 13 figures

EMUSE: Evolutionary Map of the Universe Search Engine

Nikhel Gupta, Zeeshan Hayder, Minh Huynh, Ray P. Norris, Lars Petersson, Andrew M. Hopkins, Simone Riggi, Bärbel S. Koribalski, Miroslav D. Filipović

专题命中 多模态训练与对齐 ：multimodal(abstract)

Comments 19 pages, 9 figures, accepted for publication in PASA

PDEfuncta: Spectrally-Aware Neural Representation for PDE Solution Modeling

Minju Jo, Woojin Cho, Uvini Balasuriya Mudiyanselage, Seungjun Lee, Noseong Park, Kookjin Lee

机构 * LG CNS ； TelePIX ； SCAI ； Arizona State University（亚利桑那州立大学） ； Brookhaven National Laboratory（布鲁克海文国家实验室） ； KAIST（韩国科学技术院） 纠错

专题命中 多模态训练与对齐 ：multi-modal(abstract)

Combining Log Data and Collaborative Dialogue Features to Predict Project Quality in Middle School AI Education

Conrad Borchers, Xiaoyi Tian, Kristy Elizabeth Boyer, Maya Israel

专题命中 多模态训练与对齐 ：multimodal(abstract)

Comments Research paper accepted to the 9th Educational Data Mining in Computer Science Education (CSEDM) Workshop

ReFineVLA: Reasoning-Aware Teacher-Guided Transfer Fine-Tuning

Tuan Van Vo, Tan Quang Nguyen, Khang Minh Nguyen, Duy Ho Minh Nguyen, Minh Nhat Vu

机构 * VinRobotics ； Max Planck Research School for Intelligent Systems (IMPRS-IS)（Max Planck Research School for Intelligent Systems） ； University of Texas at Arlington（德克萨斯大学阿灵顿分校） ； Automation & Control Institute, TU Wien（技术大学维也纳自动化与控制研究所） ； Austrian Institute of Technology (AIT)（奥地利技术研究所） 纠错

专题命中 多模态训练与对齐 ：multimodal(abstract)

Comments 10 pages

The Evolution of Alpha in Finance Harnessing Human Insight and LLM Agents

Mohammad Rubyet Islam

专题命中 多模态训练与对齐 ：multimodal(abstract)

Foundations of Unknown-aware Machine Learning

Xuefeng Du

专题命中 多模态训练与对齐 ：multimodal(abstract)

Comments PhD Dissertation

Advances in Protein Representation Learning: Methods, Applications, and Future Directions

Viet Thanh Duy Nguyen, Truong-Son Hy

机构 * The University of Alabama at Birmingham（阿拉巴马大学伯明翰分校） 纠错

专题命中 多模态训练与对齐 ：multimodal(abstract)

Neural Representational Consistency Emerges from Probabilistic Neural-Behavioral Representation Alignment

Yu Zhu, Chunfeng Song, Wanli Ouyang, Shan Yu, Tiejun Huang

专题命中 多模态训练与对齐 ：cross-modal(abstract)

Comments ICML2025

Edge Large AI Models: Collaborative Deployment and IoT Applications

Zixin Wang, Yuanming Shi, Khaled. B. Letaief

专题命中 多模态训练与对齐 ：multi-modal(abstract)

Towards Cross-Modality Modeling for Time Series Analytics: A Survey in the LLM Era

Chenxi Liu, Shaowen Zhou, Qianxiong Xu, Hao Miao, Cheng Long, Ziyue Li, Rui Zhao

机构 * S-Lab, Nanyang Technological University, Singapore（南洋理工大学S实验室） ； Aalborg University, Denmark（奥尔堡大学） ； University of Cologne, Germany（科隆大学） ； SenseTime Research, China（SenseTime研究院） 纠错

专题命中 多模态训练与对齐 ：multimodal(abstract)

Comments Accepted by IJCAI 2025 Survey Track

Deep Representation Learning for Electronic Design Automation

Pratik Shrestha, Saran Phatharodom, Alec Aversa, David Blankenship, Zhengfeng Wu, Ioannis Savidis

专题命中 多模态训练与对齐 ：multimodal(abstract)

FoAR: Force-Aware Reactive Policy for Contact-Rich Robotic Manipulation

Zihao He, Hongjie Fang, Jingjing Chen, Hao-Shu Fang, Cewu Lu

机构 * Shanghai Jiao Tong University（上海交通大学） 纠错

专题命中 多模态训练与对齐 ：multimodal(abstract)

Comments Accepted to Robotics and Automation Letters. 9 pages, 5 figures

Train Robots in a JIF: Joint Inverse and Forward Dynamics with Human and Robot Demonstrations

Gagan Khandate, Boxuan Wang, Sarah Park, Weizhe Ni, Joaquin Palacios, Kathyrn Lampo, Philippe Wu, Rosh Ho, Eric Chang, Matei Ciocarlie

机构 * Dept. of Computer Science（计算机科学系） ； Dept. of Mechanical Engineering（机械工程系） ； Columbia University（哥伦比亚大学） 纠错

专题命中 多模态训练与对齐 ：multi-modal(abstract)

Comments 9 pages, 8 figures, submission to RSS 2025

ECG Identity Authentication in Open-set with Multi-model Pretraining and Self-constraint Center & Irrelevant Sample Repulsion Learning

Mingyu Dong, Zhidong Zhao, Hao Wang, Yefei Zhang, Yanjun Deng

专题命中 多模态训练与对齐 ：multi-modal(abstract)

Comments 10 pages,

MorphoNavi: Aerial-Ground Robot Navigation with Object Oriented Mapping in Digital Twin

Sausar Karaf, Mikhail Martynov, Oleg Sautenkov, Zhanibek Darush, Dzmitry Tsetserukou

机构 * Intelligent Space Robotics Laboratory, CDE, Skoltech（智能空间机器人实验室，Skoltech） 纠错

专题命中 多模态训练与对齐 ：multimodal(abstract)

Representation Learning for Tabular Data: A Comprehensive Survey

Jun-Peng Jiang, Si-Yang Liu, Hao-Run Cai, Qile Zhou, Han-Jia Ye

机构 * School of Artificial Intelligence, Nanjing University（人工智能学院，南京大学） ； National Key Laboratory for Novel Software Technology, Nanjing University（新型软件技术国家实验室，南京大学） 纠错

专题命中 多模态训练与对齐 ：multimodal(abstract)