For autonomous agents to successfully operate in real world, the ability to anticipate future motions of surrounding entities in the scene can greatly enhance their safety levels since potentially dangerous situations could be avoided in advance. While impressive results have been shown on predicting each agent's behavior independently, we argue that it is not valid to consider road entities individually since transitions of vehicle states are highly coupled. Moreover, as the predicted horizon becomes longer, modeling prediction uncertainties and multi-modal distributions over future sequences will turn into a more challenging task. In this paper, we address this challenge by presenting a multi-modal probabilistic prediction approach. The proposed method is based on a generative model and is capable of jointly predicting sequential motions of each pair of interacting agents. Most importantly, our model is interpretable, which can explain the underneath logic as well as obtain more reliability to use in real applications. A complicate real-world roundabout scenario is utilized to implement and examine the proposed method.
RetainVis: Visual Analytics with Interpretable and Interactive Recurrent Neural Networks on Electronic Medical Records
IBM T.J. Watson Research Center(IBM托马斯·J·沃森研究中心);Korea University(高丽大学);Georgia Institute of Technology(佐治亚理工学院);Chung-Ang University(中央大学);Catholic University of Daegu(大邱天主教大学)
Unveiling Global Interactive Patterns across Graphs: Towards Interpretable Graph Neural Networks
School of Software Technology, Zhejiang University(浙江大学软件学院);Hangzhou High-Tech Zone (Binjiang) Institute of Blockchain and Data Security(杭州高新区(滨江)区块链与数据安全研究院);Big Graph Center, School of Computer and Computing Science, Hangzhou City University(杭州城市大学计算机与计算科学学院大图中心);College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院)
IDAT: A Multi-Modal Dataset and Toolkit for Building and Evaluating Interactive Task-Solving Agents
Massachusetts Institute of Technology(麻省理工学院);University of Waterloo(滑铁卢大学);Meta AI;AIRI(人工智能研究院);École Polytechnique de Montréal(蒙特利尔理工学院);Microsoft Research(微软研究院)
CALM: Interpretable Cross-Modal Alignment for Biomarker Discovery from Unpaired Data
Department of Electrical and Computer Engineering, Boston University(波士顿大学电气与计算机工程系);School of Data Science, University of Virginia(弗吉尼亚大学数据科学学院);Department of Psychology, University of Virginia(弗吉尼亚大学心理学系);Department of Neurology, University of Virginia(弗吉尼亚大学神经病学系);Departments of Computer Science and Biology, Johns Hopkins University(约翰霍普金斯大学计算机科学与生物学系)
Interpretable and Interactive Deep Multiple Instance Learning for Dental Caries Classification in Bitewing X-rays
Hasso Plattner Institute, University of Potsdam(波茨坦大学哈索·普拉特纳研究所);Charité - Universitätsmedizin Berlin(柏林夏里特医学院);Contraste Radiologia Odontológica(康特拉斯特牙科放射诊所);Hasso Plattner Institute for Digital Health at Mount Sinai, Icahn School of Medicine at Mount Sinai(西奈山伊坎医学院西奈山哈索·普拉特纳数字健康研究所)
Interpretable Parallel Recurrent Neural Networks with Convolutional Attentions for Multi-Modality Activity Modeling
School of Computer Science and Engineering, UNSW Sydney, Australia(澳大利亚新南威尔士大学计算机科学与工程学院);School of Information Technology, RMIT University, Australia(澳大利亚皇家墨尔本理工大学信息技术学院);School of Computer Science, Northwestern Polytechnical University, China(中国西北工业大学计算机学院);School of Software, Tsinghua University China(中国清华大学软件学院)
Interpretable 3D Multi-Modal Residual Convolutional Neural Network for Mild Traumatic Brain Injury Diagnosis
School of Electrical Engineering and Computer Science, University of Queensland(昆士兰大学电气工程与计算机科学学院);The Centre for Advanced Imaging, University of Queensland(昆士兰大学高级成像中心);Australian Institute for Bioengineering and Nanotechnology, University of Queensland(昆士兰大学生物工程与纳米技术研究所);ARC Training Centre for Innovation in Biomedical Imaging Technology(ARC生物医学成像技术创新培训中心)
MountainLion: A Multi-Modal LLM-Based Agent System for Interpretable and Adaptive Financial Trading
The University of Texas at Arlington(德克萨斯大学阿灵顿分校);Sichuan University(四川大学);Northwestern University(西北大学);Indiana University(印第安纳大学);Emory University(埃默里大学);Nankai University(南开大学);MountainLion Research(MountainLion研究机构);Xi’an University of Electronic Science and Technology(西安电子科技大学);Kyoto University(京都大学);University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校);Nanjing university(南京大学);Tsinghua University(清华大学);University of Toronto(多伦多大学)
Soybean Disease Detection via Interpretable Hybrid CNN-GNN: Integrating MobileNetV2 and GraphSAGE with Cross-Modal Attention
Biology Unit, Okinawa Institute of Science;Technology Graduate University, Okinawa 904-0412, Japan (e-mail: );Thomas Lord Department of Computer Science, Viterbi School of Engineering, University of Southern California, Los Angeles, CA 90007, USA (e-mail: );Department of Computer Science, American International University-Bangladesh, Dhaka 1229, Bangladesh (e-mail: , );Department of Robotics;Automation, Multimedia University, Melaka, Malaysia (e-mail: );Department of Computer Science \& Engineering, Techno International New Town, Kolkata 700156, India (e-mail: )
METER: Multi-modal Evidence-based Thinking and Explainable Reasoning -- Algorithm and Benchmark
Institute of Artificial Intelligence (TeleAI), China Telecom(电信人工智能研究院);Institute of Artificial Intelligence and Robotics(IAIR), Xi’an Jiaotong University(人工智能与机器人研究院);Advanced Technique of Artificial Intelligence(ATAI), Chongqing University of Technology(人工智能先进技术研究院)