多模态大模型 - arXivDaily 专题

2410.22978 2024-10-31 stat.ML cs.LG 50%

Graph Integration for Diffusion-Based Manifold Alignment

Jake S. Rhodes, Adam G. Rustad

专题命中多模态训练与对齐：multimodal(abstract)

Comments 8 pages, 4 figures, Accepted at ICMLA 2024

2405.16148 2024-10-31 cs.LG 50%

Accelerating Transformers with Spectrum-Preserving Token Merging

Hoai-Chau Tran, Duy M. H. Nguyen, Duy M. Nguyen, Trung-Tin Nguyen, Ngan Le, Pengtao Xie, Daniel Sonntag, James Y. Zou, Binh T. Nguyen, Mathias Niepert

专题命中多模态训练与对齐：image-text(abstract)

Comments Accepted at NeurIPS 2024

2406.14685 2024-10-25 physics.ed-ph 50%

Evaluating vision-capable chatbots in interpreting kinematics graphs: a comparative study of free and subscription-based models

Giulia Polverini, Bor Gregorcic

专题命中多模态训练与对齐：multimodal(abstract)

2410.01858 2024-10-04 q-bio.CB cs.LG q-bio.GN 50%

Long-range gene expression prediction with token alignment of large language model

Edouardo Honig, Huixin Zhan, Ying Nian Wu, Zijun Frank Zhang

专题命中多模态训练与对齐：cross-modal(abstract)

Comments 14 pages, 10 figures

2406.10606 2024-09-25 eess.SP 50%

Semantic Communication for Edge Intelligence Enabled Autonomous Driving System

Yunqi Feng, Hesheng Shen, Zhendong Shan, Qianqian Yang, Xiufang Shi

专题命中多模态训练与对齐：multi-modal(abstract)

Comments This paper has been accepted by IEEE Network Magazine

2306.08553 2024-09-24 cs.LG cs.DS math.OC stat.ML 50%

Noise Stability Optimization for Finding Flat Minima: A Hessian-based Regularization Approach

Hongyang R. Zhang, Dongyue Li, Haotian Ju

专题命中多模态训练与对齐：multimodal(abstract)

Comments 39 pages

Journal ref Trans. Mach. Learn. Res. 2024

2409.12899 2024-09-20 cs.RO 50%

LI-GS: Gaussian Splatting with LiDAR Incorporated for Accurate Large-Scale Reconstruction

Changjian Jiang, Ruilan Gao, Kele Shao, Yue Wang, Rong Xiong, Yu Zhang

专题命中多模态训练与对齐：multimodal(abstract)

2404.03966 2024-09-18 physics.app-ph 50%

k-space Physics-informed Neural Network (k-PINN) for Compressed Spectral Mapping and Efficient Inversion of Vibrations in Thin Composite Laminates

Saeid Hedayatrasa, Olga Fink, Wim Van Paepegem, Mathias Kersemans

专题命中多模态训练与对齐：multimodal(abstract)

Comments Revised: References, Figures 3&4, Equation 19&31, and discussions

2409.09101 2024-09-17 astro-ph.IM astro-ph.CO 50%

Understanding posterior projection effects with normalizing flows

Marco Raveri, Cyrille Doux, Shivam Pandey

专题命中多模态训练与对齐：multi-modal(abstract)

Comments 10 pages, 6 figures Tutorial available at https://tensiometer.readthedocs.io/en/latest/example_posterior_profiles.html

2409.08033 2024-09-13 cs.RO 50%

A three-dimensional force estimation method for the cable-driven soft robot based on monocular images

Xiaohan Zhu, Ran Bu, Zhen Li, Fan Xu, Hesheng Wang

专题命中多模态训练与对齐：multimodal(abstract)

2311.06228 2024-08-21 cs.LG cond-mat.mtrl-sci 50%

Learning material synthesis-process-structure-property relationship by data fusion: Bayesian Coregionalization N-Dimensional Piecewise Function Learning

A. Gilad Kusne, Austin McDannald, Brian DeCost

专题命中多模态训练与对齐：multimodal(abstract)

2407.16657 2024-08-20 physics.optics eess.IV 50%

Fluorescence Diffraction Tomography using Explicit Neural Fields

Renzhi He, Yucheng Li, Junjie Chen, Yi Xue

专题命中多模态训练与对齐：multimodal(abstract)

2408.09015 2024-08-20 cs.LG 50%

AdaRank: Disagreement Based Module Rank Prediction for Low-rank Adaptation

Yihe Dong

专题命中多模态训练与对齐：multimodal(abstract)

2310.07820 2024-08-13 cs.LG 50%

Large Language Models Are Zero-Shot Time Series Forecasters

Nate Gruver, Marc Finzi, Shikai Qiu, Andrew Gordon Wilson

专题命中多模态训练与对齐：multimodal(abstract)

Comments NeurIPS 2023. Code available at: https://github.com/ngruver/llmtime

2402.02338 2024-08-07 cs.NI cs.LG 50%

NetLLM: Adapting Large Language Models for Networking

Duo Wu, Xianda Wang, Yaqi Qiao, Zhi Wang, Junchen Jiang, Shuguang Cui, Fangxin Wang

专题命中多模态训练与对齐：multimodal(abstract)

Comments This paper has been accepted by ACM SIGCOMM 2024. DOI: https://doi.org/10.1145/3651890.3672268

2407.20710 2024-07-31 cs.DC 50%

On-the-fly Communication-and-Computing to Enable Representation Learning for Distributed Point Clouds

Xu Chen, Hai Wu, Kaibin Huang

专题命中多模态训练与对齐：multi-modal(abstract)

Comments This is an ongoing work under revision

2407.20265 2024-07-31 cs.LG cs.CE 50%

COEFF-KANs: A Paradigm to Address the Electrolyte Field with KANs

Xinhe Li, Zhuoying Feng, Yezeng Chen, Weichen Dai, Zixu He, Yi Zhou, Shuhong Jiao

专题命中多模态训练与对齐：multimodal(abstract)

Comments 8 pages, 5 figures

2407.09509 2024-07-16 q-bio.NC cs.HC 50%

Brain Dialogue Interface (BDI): A User-Friendly fMRI Model for Interactive Brain Decoding

Heng Huang, Lin Zhao, Zihao Wu, Xiaowei Yu, Jing Zhang, Xintao Hu, Dajiang Zhu, Tianming Liu

专题命中多模态训练与对齐：multimodal(abstract)

2407.02074 2024-07-03 cs.SI 50%

CGAP: Urban Region Representation Learning with Coarsened Graph Attention Pooling

Zhuo Xu, Xiao Zhou

专题命中多模态训练与对齐：multi-modal(abstract)

2402.07249 2024-07-01 cs.LG cs.CE q-bio.BM 50%

Impact of Domain Knowledge and Multi-Modality on Intelligent Molecular Property Prediction: A Systematic Survey

Taojie Kuang, Pengfei Liu, Zhixiang Ren

专题命中多模态训练与对齐：multi-modal(abstract)

2406.17226 2024-06-26 math.OC 50%

Extended alternating structure-adapted proximal gradient algorithm for nonconvex nonsmooth problems

Ying Gao, Chunfeng Cui, Wenxing Zhang, Deren Han

专题命中多模态训练与对齐：multimodal(abstract)

2406.09841 2024-06-17 cs.LG q-bio.BM 50%

Learning Multi-view Molecular Representations with Structured and Unstructured Knowledge

Yizhen Luo, Kai Yang, Massimo Hong, Xing Yi Liu, Zikun Nie, Hao Zhou, Zaiqing Nie

专题命中多模态训练与对齐：multi-modal(abstract)

Comments 12 pages, 4 figures

2406.01245 2024-06-04 eess.IV 50%

Sparse Focus Network for Multi-Source Remote Sensing Data Classification

Xuepeng Jin, Junyan Lin, Feng Gao, Lin Qi, Yang Zhou

专题命中多模态训练与对齐：cross-modal(abstract)

Comments Accepted by IEEE IGARSS 2024

2312.03642 2024-05-29 cs.LG 50%

Transformer-Powered Surrogates Close the ICF Simulation-Experiment Gap with Extremely Limited Data

Matthew L. Olson, Shusen Liu, Jayaraman J. Thiagarajan, Bogdan Kustowski, Weng-Keen Wong, Rushil Anirudh

专题命中多模态训练与对齐：multi-modal(abstract)

Comments MLST

2405.14311 2024-05-24 cs.CR 50%

Deep Learning Fusion For Effective Malware Detection: Leveraging Visual Features

Jahez Abraham Johny, Vinod P., Asmitha K. A., G. Radhamani, Rafidha Rehiman K. A., Mauro Conti

专题命中多模态训练与对齐：multimodal(abstract)

2405.12931 2024-05-22 cs.HC 50%

Enabling Additive Manufacturing Part Inspection of Digital Twins via Collaborative Virtual Reality

Vuthea Chheang, Saurabh Narain, Garrett Hooten, Robert Cerda, Brian Au, Brian Weston, Brian Giera, Peer-Timo Bremer, Haichao Miao

专题命中多模态训练与对齐：multimodal(abstract)

Comments 10 Pages, 6 Figures

2401.14857 2024-05-20 cs.RO 50%

LIV-GaussMap: LiDAR-Inertial-Visual Fusion for Real-time 3D Radiance Field Map Rendering

Sheng Hong, Junjie He, Xinhu Zheng, Chunran Zheng, Shaojie Shen

专题命中多模态训练与对齐：multimodal(abstract)

2405.06784 2024-05-14 cs.LG 50%

Open Challenges and Opportunities in Federated Foundation Models Towards Biomedical Healthcare

Xingyu Li, Lu Peng, Yuping Wang, Weihua Zhang

专题命中多模态训练与对齐：multimodal(abstract)

Comments 42 pages

2405.04671 2024-05-09 cs.LG 50%

Interpretable Tensor Fusion

Saurabh Varshneya, Antoine Ledent, Philipp Liznerski, Andriy Balinskyy, Purvanshi Mehta, Waleed Mustafa, Marius Kloft

专题命中多模态训练与对齐：multimodal(abstract)

2404.14167 2024-05-07 cs.RO 50%

A multi-robot system for the detection of explosive devices

Ken Hasselmann, Mario Malizia, Rafael Caballero, Fabio Polisano, Shashank Govindaraj, Jakob Stigler, Oleksii Ilchenko, Milan Bajic, Geert De Cubber

专题命中多模态训练与对齐：multimodal(abstract)

Journal ref IEEE ICRA Workshop on Field Robotics 2024

1. 多模态训练与对齐 6942 篇

Graph Integration for Diffusion-Based Manifold Alignment

Accelerating Transformers with Spectrum-Preserving Token Merging

Evaluating vision-capable chatbots in interpreting kinematics graphs: a comparative study of free and subscription-based models

Long-range gene expression prediction with token alignment of large language model

Semantic Communication for Edge Intelligence Enabled Autonomous Driving System

Noise Stability Optimization for Finding Flat Minima: A Hessian-based Regularization Approach

LI-GS: Gaussian Splatting with LiDAR Incorporated for Accurate Large-Scale Reconstruction

k-space Physics-informed Neural Network (k-PINN) for Compressed Spectral Mapping and Efficient Inversion of Vibrations in Thin Composite Laminates

Understanding posterior projection effects with normalizing flows

A three-dimensional force estimation method for the cable-driven soft robot based on monocular images

Learning material synthesis-process-structure-property relationship by data fusion: Bayesian Coregionalization N-Dimensional Piecewise Function Learning

Fluorescence Diffraction Tomography using Explicit Neural Fields

AdaRank: Disagreement Based Module Rank Prediction for Low-rank Adaptation

Large Language Models Are Zero-Shot Time Series Forecasters

NetLLM: Adapting Large Language Models for Networking

On-the-fly Communication-and-Computing to Enable Representation Learning for Distributed Point Clouds

COEFF-KANs: A Paradigm to Address the Electrolyte Field with KANs

Brain Dialogue Interface (BDI): A User-Friendly fMRI Model for Interactive Brain Decoding

CGAP: Urban Region Representation Learning with Coarsened Graph Attention Pooling

Impact of Domain Knowledge and Multi-Modality on Intelligent Molecular Property Prediction: A Systematic Survey

Extended alternating structure-adapted proximal gradient algorithm for nonconvex nonsmooth problems

Learning Multi-view Molecular Representations with Structured and Unstructured Knowledge

Sparse Focus Network for Multi-Source Remote Sensing Data Classification

Transformer-Powered Surrogates Close the ICF Simulation-Experiment Gap with Extremely Limited Data

Deep Learning Fusion For Effective Malware Detection: Leveraging Visual Features

Enabling Additive Manufacturing Part Inspection of Digital Twins via Collaborative Virtual Reality

LIV-GaussMap: LiDAR-Inertial-Visual Fusion for Real-time 3D Radiance Field Map Rendering

Open Challenges and Opportunities in Federated Foundation Models Towards Biomedical Healthcare

Interpretable Tensor Fusion

A multi-robot system for the detection of explosive devices