多模态大模型 - arXivDaily 专题

2310.14226 2023-10-24 cs.CV 57%

Multi-stream Cell Segmentation with Low-level Cues for Multi-modality Images

Wei Lou, Xinyi Yu, Chenyu Liu, Xiang Wan, Guanbin Li, Siqi Liu, Haofeng Li

专题命中其他多模态：multi-modal(abstract)；分类 cs.CV

Comments The second place in NeurIPS 2022 cell segmentation challenge (https://neurips22-cellseg.grand-challenge.org/), released code: https://github.com/lhaof/CellSeg

2307.11099 2023-10-24 physics.geo-ph cs.AI cs.LG cs.NA math.NA physics.comp-ph 57%

Solving multiphysics-based inverse problems with learned surrogates and constraints

Ziyi Yin, Rafael Orozco, Mathias Louboutin, Felix J. Herrmann

专题命中其他多模态：multimodal(abstract)；分类 cs.AI

2306.15228 2023-10-23 cs.RO cs.AI 57%

IIFL: Implicit Interactive Fleet Learning from Heterogeneous Human Supervisors

Gaurav Datta, Ryan Hoque, Anrui Gu, Eugen Solowjow, Ken Goldberg

专题命中其他多模态：multimodal(abstract)；分类 cs.AI

Comments CoRL 2023

2306.17525 2023-10-20 cond-mat.mtrl-sci cond-mat.dis-nn cond-mat.mes-hall cond-mat.other cs.AI 57%

MeLM, a generative pretrained language modeling framework that solves forward and inverse mechanics problems

Markus J. Buehler

专题命中其他多模态：multi-modal(abstract)；分类 cs.AI

2310.08002 2023-10-13 eess.IV cs.CV 57%

MLP-AMDC: An MLP Architecture for Adaptive-Mask-based Dual-Camera snapshot hyperspectral imaging

Zeyu Cai, Can Zhang, Xunhao Chen, Shanghuan Liu, Chengqian Jin, Feipeng Da

专题命中其他多模态：multimodal(abstract)；分类 cs.CV

Comments arXiv admin note: substantial text overlap with arXiv:2308.01541

2304.01601 2023-10-13 eess.IV cs.CV 57%

Primitive Simultaneous Optimization of Similarity Metrics for Image Registration

Diana Waldmannstetter, Benedikt Wiestler, Julian Schwarting, Ivan Ezhov, Marie Metz, Spyridon Bakas, Bhakti Baheti, Satrajit Chakrabarty, Daniel Rueckert, Jan S. Kirschke, Rolf A. Heckemann, Marie Piraud, Bjoern H. Menze, Florian Kofler

专题命中其他多模态：multi-modal(abstract)；分类 cs.CV

2204.06272 2023-10-13 cs.CV 57%

3D-SPS: Single-Stage 3D Visual Grounding via Referred Point Progressive Selection

Junyu Luo, Jiahui Fu, Xianghao Kong, Chen Gao, Haibing Ren, Hao Shen, Huaxia Xia, Si Liu

专题命中其他多模态：cross-modal(abstract)；分类 cs.CV

Comments CVPR 2022, Oral

2310.07093 2023-10-12 cs.CL 57%

Argumentative Stance Prediction: An Exploratory Study on Multimodality and Few-Shot Learning

Arushi Sharma, Abhibha Gupta, Maneesh Bilalpur

专题命中其他多模态：multimodal(abstract)；分类 cs.CL

2307.02796 2023-10-12 cs.DB cs.CL cs.LG 57%

VerifAI: Verified Generative AI

Nan Tang, Chenyu Yang, Ju Fan, Lei Cao, Yuyu Luo, Alon Halevy

专题命中其他多模态：multi-modal(abstract)；分类 cs.CL

Comments 8 pages, 4 figures

2310.03715 2023-10-06 cs.AI cs.CY 57%

Artificial Intelligence Index Report 2023

Nestor Maslej, Loredana Fattorini, Erik Brynjolfsson, John Etchemendy, Katrina Ligett, Terah Lyons, James Manyika, Helen Ngo, Juan Carlos Niebles, Vanessa Parli, Yoav Shoham, Russell Wald, Jack Clark, Raymond Perrault

专题命中其他多模态：multimodal(abstract)；分类 cs.AI

2310.02918 2023-10-05 eess.SY cs.AI cs.SY 57%

Learning-Aided Warmstart of Model Predictive Control in Uncertain Fast-Changing Traffic

Mohamed-Khalil Bouzidi, Yue Yao, Daniel Goehring, Joerg Reichardt

专题命中其他多模态：multimodal(abstract)；分类 cs.AI

2310.02528 2023-10-05 cs.CV 57%

On the Cognition of Visual Question Answering Models and Human Intelligence: A Comparative Study

Liben Chen, Long Chen, Tian Ellison-Chen, Zhuoyuan Xu

专题命中其他多模态：cross-modal(abstract)；分类 cs.CV

Comments 16 pages, 11 figures

2302.01416 2023-10-04 cs.LG cs.AI 57%

Neural Insights for Digital Marketing Content Design

Fanjie Kong, Yuan Li, Houssam Nassif, Tanner Fiez, Ricardo Henao, Shreya Chakrabarti

专题命中其他多模态：multimodal(abstract)；分类 cs.AI

Journal ref International Conference on Knowledge Discovery and Data Mining (KDD'23), Long Beach, CA, pp. 4320-4332, 2023

2303.08692 2023-09-28 cs.CV 57%

SpiderMesh: Spatial-aware Demand-guided Recursive Meshing for RGB-T Semantic Segmentation

Siqi Fan, Zhe Wang, Yan Wang, Jingjing Liu

专题命中其他多模态：multimodal(abstract)；分类 cs.CV

2303.11568 2023-09-26 cs.AI cs.CY 57%

Large AI Models in Health Informatics: Applications, Challenges, and the Future

Jianing Qiu, Lin Li, Jiankai Sun, Jiachuan Peng, Peilun Shi, Ruiyang Zhang, Yinzhao Dong, Kyle Lam, Frank P. -W. Lo, Bo Xiao, Wu Yuan, Ningli Wang, Dong Xu, Benny Lo

专题命中其他多模态：multi-modal(abstract)；分类 cs.AI

Comments This article has been accepted for publication in IEEE Journal of Biomedical and Health Informatics

Journal ref JBHI, 2023

2303.05193 2023-09-26 cs.RO cs.AI cs.LG 57%

GOATS: Goal Sampling Adaptation for Scooping with Curriculum Reinforcement Learning

Yaru Niu, Shiyu Jin, Zeqing Zhang, Jiacheng Zhu, Ding Zhao, Liangjun Zhang

专题命中其他多模态：multi-modal(abstract)；分类 cs.AI

2202.04680 2023-09-19 cs.CV math.FA 57%

Lifting-based variational multiclass segmentation algorithm: design, convergence analysis, and implementation with applications in medical imaging

Nadja Gruber, Johannes Schwab, Sebastien Court, Elke Gizewski, Markus Haltmeier

专题命中其他多模态：multimodal(abstract)；分类 cs.CV

2309.03726 2023-09-08 cs.CV 57%

Interpretable Visual Question Answering via Reasoning Supervision

Maria Parelli, Dimitrios Mallis, Markos Diomataris, Vassilis Pitsikalis

专题命中其他多模态：multimodal(abstract)；分类 cs.CV

2309.02965 2023-09-07 cs.CV 57%

Dynamic Hyperbolic Attention Network for Fine Hand-object Reconstruction

Zhiying Leng, Shun-Cheng Wu, Mahdi Saleh, Antonio Montanaro, Hao Yu, Yin Wang, Nassir Navab, Xiaohui Liang, Federico Tombari

专题命中其他多模态：multi-modal(abstract)；分类 cs.CV

Comments Accpeted by ICCV 2023

2212.11613 2023-09-06 cs.CV 57%

DDColor: Towards Photo-Realistic Image Colorization via Dual Decoders

Xiaoyang Kang, Tao Yang, Wenqi Ouyang, Peiran Ren, Lingzhi Li, Xuansong Xie

专题命中其他多模态：multi-modal(abstract)；分类 cs.CV

Comments ICCV 2023; Code: https://github.com/piddnad/DDColor

2308.14619 2023-08-30 cs.CV 57%

Compositional Semantic Mix for Domain Adaptation in Point Cloud Segmentation

Cristiano Saltori, Fabio Galasso, Giuseppe Fiameni, Nicu Sebe, Fabio Poiesi, Elisa Ricci

专题命中其他多模态：multi-modal(abstract)；分类 cs.CV

Comments TPAMI. arXiv admin note: text overlap with arXiv:2207.09778

2308.14066 2023-08-30 eess.IV cs.CV 57%

Bi-Modality Medical Image Synthesis Using Semi-Supervised Sequential Generative Adversarial Networks

Xin Yang, Yi Lin, Zhiwei Wang, Xin Li, Kwang-Ting Cheng

专题命中其他多模态：multimodal(abstract)；分类 cs.CV

2307.08238 2023-08-21 cs.CV 57%

Unified Open-Vocabulary Dense Visual Prediction

Hengcan Shi, Munawar Hayat, Jianfei Cai

专题命中其他多模态：multi-modal(abstract)；分类 cs.CV

2308.08764 2023-08-21 cs.CV cs.MA 57%

XVTP3D: Cross-view Trajectory Prediction Using Shared 3D Queries for Autonomous Driving

Zijian Song, Huikun Bi, Ruisi Zhang, Tianlu Mao, Zhaoqi Wang

专题命中其他多模态：multimodal(abstract)；分类 cs.CV

Comments 11 pages, 6 figures, accepted by IJCAI 23

2308.07777 2023-08-16 cs.CL 57%

Enhancing Visually-Rich Document Understanding via Layout Structure Modeling

Qiwei Li, Zuchao Li, Xiantao Cai, Bo Du, Hai Zhao

专题命中其他多模态：multi-modal(abstract)；分类 cs.CL

2308.01731 2023-08-04 cs.LG cs.CV 57%

Quantification of Predictive Uncertainty via Inference-Time Sampling

Katarína Tóthová, Ľubor Ladický, Daniel Thul, Marc Pollefeys, Ender Konukoglu

专题命中其他多模态：multi-modal(abstract)；分类 cs.CV

Journal ref Lecture Notes in Computer Science, vol 13563. Springer, Cham, 2022

2308.01541 2023-08-04 eess.IV cs.CV 57%

DMDC: Dynamic-mask-based dual camera design for snapshot Hyperspectral Imaging

Zeyu Cai, Chengqian Jin, Feipeng Da

专题命中其他多模态：multimodal(abstract)；分类 cs.CV

Comments 11 pages, 7 figures

2308.01271 2023-08-03 cs.LG cs.AI 57%

A Probabilistic Approach to Self-Supervised Learning using Cyclical Stochastic Gradient MCMC

Masoumeh Javanbakhat, Christoph Lippert

专题命中其他多模态：multimodal(abstract)；分类 cs.AI

2108.11674 2023-07-31 cs.AI cs.LG q-bio.MN 57%

Graph-guided random forest for gene set selection

Bastian Pfeifer, Hubert Baniecki, Anna Saranti, Przemyslaw Biecek, Andreas Holzinger

专题命中其他多模态：multi-modal(abstract)；分类 cs.AI

Journal ref Sci Rep 12, 16857 (2022)

2111.09739 2023-07-27 cs.AI cs.RO 57%

Learning Ultrasound Scanning Skills from Human Demonstrations

Xutian Deng, Ziwei Lei, Yi Wang, Miao Li

专题命中其他多模态：multi-modal(abstract)；分类 cs.AI

1. 其他多模态 4892 篇

Multi-stream Cell Segmentation with Low-level Cues for Multi-modality Images

Solving multiphysics-based inverse problems with learned surrogates and constraints

IIFL: Implicit Interactive Fleet Learning from Heterogeneous Human Supervisors

MeLM, a generative pretrained language modeling framework that solves forward and inverse mechanics problems

MLP-AMDC: An MLP Architecture for Adaptive-Mask-based Dual-Camera snapshot hyperspectral imaging

Primitive Simultaneous Optimization of Similarity Metrics for Image Registration

3D-SPS: Single-Stage 3D Visual Grounding via Referred Point Progressive Selection

Argumentative Stance Prediction: An Exploratory Study on Multimodality and Few-Shot Learning

VerifAI: Verified Generative AI

Artificial Intelligence Index Report 2023

Learning-Aided Warmstart of Model Predictive Control in Uncertain Fast-Changing Traffic

On the Cognition of Visual Question Answering Models and Human Intelligence: A Comparative Study

Neural Insights for Digital Marketing Content Design

SpiderMesh: Spatial-aware Demand-guided Recursive Meshing for RGB-T Semantic Segmentation

Large AI Models in Health Informatics: Applications, Challenges, and the Future

GOATS: Goal Sampling Adaptation for Scooping with Curriculum Reinforcement Learning

Lifting-based variational multiclass segmentation algorithm: design, convergence analysis, and implementation with applications in medical imaging

Interpretable Visual Question Answering via Reasoning Supervision

Dynamic Hyperbolic Attention Network for Fine Hand-object Reconstruction

DDColor: Towards Photo-Realistic Image Colorization via Dual Decoders

Compositional Semantic Mix for Domain Adaptation in Point Cloud Segmentation

Bi-Modality Medical Image Synthesis Using Semi-Supervised Sequential Generative Adversarial Networks

Unified Open-Vocabulary Dense Visual Prediction

XVTP3D: Cross-view Trajectory Prediction Using Shared 3D Queries for Autonomous Driving

Enhancing Visually-Rich Document Understanding via Layout Structure Modeling

Quantification of Predictive Uncertainty via Inference-Time Sampling

DMDC: Dynamic-mask-based dual camera design for snapshot Hyperspectral Imaging

A Probabilistic Approach to Self-Supervised Learning using Cyclical Stochastic Gradient MCMC

Graph-guided random forest for gene set selection

Learning Ultrasound Scanning Skills from Human Demonstrations