Vision-based Discovery of Nonlinear Dynamics for 3D Moving Target
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);School of Engineering Science, University of Chinese Academy of Sciences(中国科学院大学工程科学学院)
Data-driven discovery of governing equations has kindled significant interests in many science and engineering areas. Existing studies primarily focus on uncovering equations that govern nonlinear dynamics based on direct measurement of the system states (e.g., trajectories). Limited efforts have been placed on distilling governing laws of dynamics directly from videos for moving targets in a 3D space. To this end, we propose a vision-based approach to automatically uncover governing equations of nonlinear dynamics for 3D moving targets via raw videos recorded by a set of cameras. The approach is composed of three key blocks: (1) a target tracking module that extracts plane pixel motions of the moving target in each video, (2) a Rodrigues' rotation formula-based coordinate transformation learning module that reconstructs the 3D coordinates with respect to a predefined reference point, and (3) a spline-enhanced library-based sparse regressor that uncovers the underlying governing law of dynamics. This framework is capable of effectively handling the challenges associated with measurement data, e.g., noise in the video, imprecise tracking of the target that causes data missing, etc. The efficacy of our method has been demonstrated through multiple sets of synthetic videos considering different nonlinear dynamics.
Enhancing Agentic Autonomous Scientific Discovery with Vision-Language Model Capabilities
Department of Physics, University of Cambridge, Cambridge, United Kingdom(剑桥大学物理系);Kavli Institute for Cosmology, University of Cambridge, Cambridge, United Kingdom(剑桥大学卡弗利天文研究所);Department of Physics and Astronomy, Haverford College, 370 Lancaster Avenue, Haverford, PA 19041, USA(哈弗福德学院物理与天文学系);Division of Physics, Mathematics and Astronomy, California Institute of Technology, Pasadena, CA 91125, USA(加州理工学院物理、数学与天文学系);Institute of Astronomy, University of Cambridge, Cambridge, United Kingdom(剑桥大学天文研究所)
Correctable Landmark Discovery via Large Models for Vision-Language Navigation
Shenzhen Campus of Sun Yat-sen University(中山大学深圳校区);PengCheng Laboratory(鹏城实验室);Dataa Robotics(达闼机器人公司);Shenzhen Institute of Advanced Technology(深圳先进技术研究院)
Diagnosing and Repairing Unsafe Channels in Vision-Language Models via Causal Discovery and Dual-Modal Safety Subspace Projection
Beijing University of Posts and Telecommunications(北京邮电大学);Huawei Technologies Ltd.(华为技术有限公司);Peking University(北京大学);Chongqing University of Posts and Telecommunications(重庆邮电大学)
VISLIX: An XAI Framework for Validating Vision Models with Slice Discovery and Analysis
Scientific Computing and Imaging Institute, University of Utah, USA(美国犹他大学科学计算与成像研究所);University of California, Davis, USA(美国加州大学戴维斯分校);Bosch Research North America and Bosch Center for Artificial Intelligence (BCAI), USA(美国博世北美研究部及博世人工智能中心);Robert Bosch GmbH, Germany(德国博世集团);Splunk Technology, USA(美国Splunk技术公司)
VLM4Bio: A Benchmark Dataset to Evaluate Pretrained Vision-Language Models for Trait Discovery from Biological Images
Virginia Tech(弗吉尼亚理工大学);UNC at Chapel Hill(北卡罗来纳大学教堂山分校);Tulane Univ.(杜兰大学);Ohio State Univ.(俄亥俄州立大学);Duke Univ.(杜克大学);Battelle(巴特尔研究所);Univ. of California, Irvine(加利福尼亚大学欧文分校);Oak Ridge Lab.(橡树岭实验室);Rensselaer Polytechnic Institute(伦斯勒理工学院)
The Right Spin: Learning Object Motion from Rotation-Compensated Flow Fields
TU Berlin(柏林工业大学);University of Massachusetts(马萨诸塞大学);Inria(法国国家信息与自动化研究所);École Normale Supérieure(巴黎高等师范学院);CNRS(法国国家科学研究中心);PSL Research University(巴黎文理研究大学);Univ. Grenoble Alpes(格勒诺布尔阿尔卑斯大学);Grenoble INP(格勒诺布尔理工学院)
ViVa-SAFELAND: a New Freeware for Safe Validation of Vision-based Navigation in Aerial Vehicles
Center for Research in Mathematics CIMAT(数学研究中心(CIMAT));Centro de Investigación y de Estudios Avanzados del IPN, CINVESTAV-IPN(墨西哥理工学院高级研究中心(CINVESTAV-IPN))
GraViT: Transfer Learning with Vision Transformers and MLP-Mixer for Strong Gravitational Lens Discovery
Facultad de Ingeniería, Universidad Autónoma de San Luis Potosí(圣路易斯波托西自治大学工程学院);Universidad Nacional Autónoma de México. Instituto de Astronomía(墨西哥国家自治大学天文研究所);Inter-University Centre for Astronomy and Astrophysics (IUCAA)(天文学与天体物理学跨大学研究中心);Kavli IPMU (WPI), UTIAS, The University of Tokyo(Kavli IPMU(WPI),东京大学UTIAS);Astronomy Research Group and Bosscha Observatory, FMIPA, Institut Teknologi Bandung(天文学研究组和博斯卡天文台,万隆理工学院);U-CoE AI-VLB, Institut Teknologi Bandung(人工智能与视觉学习卓越中心,万隆理工学院);University Center of Excellence for Space Science, Technology and Innovation, Institut Teknologi Bandung(空间科学、技术和创新卓越大学中心,万隆理工学院)
运动目标检测是视频自动分析的关键技术之一,在视频监控跟踪、视频压缩编码等领域有着广泛的应用前景。鲁棒主成分分析(Robust Principal Component Analysis,RPCA)是目前最流行的运动目标建模方法之一,其目标是将运动目标的时变(即,从视频中的静态背景中移动)前景对象,假设背景帧是低秩的,而前景是空间稀疏的。经典的RPCA使用l1范数对前景分量施加稀疏性,并通过2范数使建模误差最小化。我们表明,这样的假设可能是过于限制在实践中,这限制了经典的RPCA的有效性,特别是当处理视频与动态背景,相机抖动,隐藏的移动对象,在本文中,我们提出了一种新的RPCA为基础的模型,称为超RPCA,检测运动物体的飞行。与经典的RPCA不同,超RPCA联合应用最大相关熵准则(MCC)的建模误差,拉普拉斯尺度混合(LSM)模型的前景对象。大量的实验已经进行,结果表明,所提出的超RPCA具有竞争力的性能,前景检测的国家的最先进的算法在几个著名的基准数据集。
ViTNF: Leveraging Neural Fields to Boost Vision Transformers in Generalized Category Discovery
School of Mathematics and Information Science(数学与信息科学学院);Guangxi University(广西大学);Shanghai Institute of Applied Mathematics and Mechanics(应用数学与力学研究所);School of Mechanics and Engineering Science(力学与工程科学学院);Shanghai University(上海大学)
本文提出 ViTNF,用基于耦合静态神经场的分类器替换 ViT 的 MLP 头,并简化训练流程,在多个 GCD 基准上显著提升新类别和所有类别的准确率。