大模型推理能力 - arXivDaily 专题

2406.15704 2024-06-25 cs.CV 50%

video-SALMONN: Speech-Enhanced Audio-Visual Large Language Models

Guangzhi Sun, Wenyi Yu, Changli Tang, Xianzhao Chen, Tian Tan, Wei Li, Lu Lu, Zejun Ma, Yuxuan Wang, Chao Zhang

专题命中推理评测：reasoning(abstract)

Comments Accepted at ICML 2024. arXiv admin note: substantial text overlap with arXiv:2310.05863

2406.10789 2024-06-18 cs.CV 50%

Learning Traffic Crashes as Language: Datasets, Benchmarks, and What-if Causal Analyses

Zhiwen Fan, Pu Wang, Yang Zhao, Yibo Zhao, Boris Ivanovic, Zhangyang Wang, Marco Pavone, Hao Frank Yang

专题命中推理评测：reasoning(abstract)

2406.09383 2024-06-14 cs.CV 50%

Multiagent Multitraversal Multimodal Self-Driving: Open MARS Dataset

Yiming Li, Zhiheng Li, Nuo Chen, Moonjun Gong, Zonglin Lyu, Zehong Wang, Peili Jiang, Chen Feng

专题命中推理评测：planning(abstract)

Comments Accepted by CVPR 2024

2406.09029 2024-06-14 cs.CY 50%

Fair by design: A sociotechnical approach to justifying the fairness of AI-enabled systems across the lifecycle

Marten H. L. Kaas, Christopher Burr, Zoe Porter, Berk Ozturk, Philippa Ryan, Michael Katell, Nuala Polo, Kalle Westerling, Ibrahim Habli

专题命中推理评测：reasoning(abstract)

Comments 18 pages, 2 figures

2305.01928 2024-06-12 cs.CV 50%

Visual Transformation Telling

Wanqing Cui, Xin Hong, Yanyan Lan, Liang Pang, Jiafeng Guo, Xueqi Cheng

专题命中推理评测：reasoning(abstract)

2403.19369 2024-06-10 cs.RO 50%

RAIL: Robot Affordance Imagination with Large Language Models

Ceng Zhang, Xin Meng, Dongchen Qi, Gregory S. Chirikjian

专题命中推理评测：reasoning(abstract)

2405.20340 2024-05-31 cs.CV 50%

MotionLLM: Understanding Human Behaviors from Human Motions and Videos

Ling-Hao Chen, Shunlin Lu, Ailing Zeng, Hao Zhang, Benyou Wang, Ruimao Zhang, Lei Zhang

专题命中推理评测：reasoning(abstract)

Comments MotionLLM version 1.0, project page see https://lhchen.top/MotionLLM

2405.19773 2024-05-31 cs.CV 50%

VQA Training Sets are Self-play Environments for Generating Few-shot Pools

Tautvydas Misiunas, Hassan Mansoor, Jasper Uijlings, Oriana Riva, Victor Carbune

专题命中推理评测：reasoning(abstract)

2405.03076 2024-05-07 cs.MA 50%

Traffic Performance GPT (TP-GPT): Real-Time Data Informed Intelligent ChatBot for Transportation Surveillance and Management

Bingzhang Wang, Zhiyu Cai, Muhammad Monjurul Karim, Chenxi Liu, Yinhai Wang

专题命中推理评测：chain-of-thought(abstract)

Comments 8 pages, 5 figures, submitted to 27th IEEE International Conference on Intelligent Transportation Systems (IEEE ITSC 2024)

2404.13236 2024-05-06 cs.DC cs.ET 50%

LLMChain: Blockchain-based Reputation System for Sharing and Evaluating Large Language Models

Mouhamed Amine Bouchiha, Quentin Telnoff, Souhail Bakkali, Ronan Champagnat, Mourad Rabah, Mickaël Coustaty, Yacine Ghamri-Doudane

专题命中推理评测：reasoning(abstract)

Comments Paper accepted at IEEE 48th Annual Computers, Software, and Applications Conference (COMPSAC) IEEE, Osaka, Japan (2024)

2404.16754 2024-04-26 cs.CV 50%

RadGenome-Chest CT: A Grounded Vision-Language Dataset for Chest CT Analysis

Xiaoman Zhang, Chaoyi Wu, Ziheng Zhao, Jiayu Lei, Ya Zhang, Yanfeng Wang, Weidi Xie

专题命中推理评测：reasoning(abstract)

2401.06209 2024-04-26 cs.CV 50%

Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMs

Shengbang Tong, Zhuang Liu, Yuexiang Zhai, Yi Ma, Yann LeCun, Saining Xie

专题命中推理评测：reasoning(abstract)

Comments Project page: https://tsb0601.github.io/mmvp_blog/

2404.14678 2024-04-24 cs.CV 50%

3DBench: A Scalable 3D Benchmark and Instruction-Tuning Dataset

Junjie Zhang, Tianci Hu, Xiaoshui Huang, Yongshun Gong, Dan Zeng

专题命中推理评测：planning(abstract)

2401.09630 2024-04-23 eess.IV cs.CV 50%

CT Liver Segmentation via PVT-based Encoding and Refined Decoding

Debesh Jha, Nikhil Kumar Tomar, Koushik Biswas, Gorkem Durak, Alpay Medetalibeyoglu, Matthew Antalek, Yury Velichko, Daniela Ladner, Amir Borhani, Ulas Bagci

专题命中推理评测：planning(abstract)

2404.12576 2024-04-22 cs.SE 50%

Requirements Satisfiability with In-Context Learning

Sarah Santos, Travis Breaux, Thomas Norton, Sara Haghighi, Sepideh Ghanavati

专题命中推理评测：chain-of-thought(abstract)

Journal ref IEEE International Requirements Engineering Conference, 2024

2402.01246 2024-04-15 cs.RO cs.SY eess.SY 50%

LimSim++: A Closed-Loop Platform for Deploying Multimodal LLMs in Autonomous Driving

Daocheng Fu, Wenjie Lei, Licheng Wen, Pinlong Cai, Song Mao, Min Dou, Botian Shi, Yu Qiao

专题命中推理评测：reasoning(abstract)

Comments Accepted by 35th IEEE Intelligent Vehicles Symposium (IV 2024)

2404.04654 2024-04-09 cs.CV cs.IR 50%

Music Recommendation Based on Facial Emotion Recognition

Rajesh B, Keerthana V, Narayana Darapaneni, Anwesh Reddy P

专题命中推理评测：reasoning(abstract)

2307.09915 2024-04-08 cs.CV cs.MM 50%

Embedded Heterogeneous Attention Transformer for Cross-lingual Image Captioning

Zijie Song, Zhenzhen Hu, Yuanen Zhou, Ye Zhao, Richang Hong, Meng Wang

专题命中推理评测：reasoning(abstract)

2304.12306 2024-04-02 eess.IV cs.CV 50%

Segment Anything in Medical Images

Jun Ma, Yuting He, Feifei Li, Lin Han, Chenyu You, Bo Wang

专题命中推理评测：planning(abstract)

Journal ref Nature Communications 15, 654 (2024)

2403.17830 2024-03-27 cs.CV 50%

Assessment of Multimodal Large Language Models in Alignment with Human Values

Zhelun Shi, Zhipin Wang, Hongxing Fan, Zaibin Zhang, Lijun Li, Yongting Zhang, Zhenfei Yin, Lu Sheng, Yu Qiao, Jing Shao

专题命中推理评测：reasoning(abstract)

Comments arXiv admin note: text overlap with arXiv:2311.02692

2403.15684 2024-03-26 cs.CV 50%

The Limits of Perception: Analyzing Inconsistencies in Saliency Maps in XAI

Anna Stubbin, Thompson Chyrikov, Jim Zhao, Christina Chajo

专题命中推理评测：reasoning(abstract)

Comments 7 pages, 1 figure, 2 tables

2403.13365 2024-03-21 cs.RO cs.CV 50%

ManiPose: A Comprehensive Benchmark for Pose-aware Object Manipulation in Robotics

Qiaojun Yu, Ce Hao, Junbo Wang, Wenhai Liu, Liu Liu, Yao Mu, Yang You, Hengxu Yan, Cewu Lu

专题命中推理评测：planning(abstract)

Comments 8 pages, 7 figures, submitted to 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2024)

2403.12895 2024-03-20 cs.CV 50%

mPLUG-DocOwl 1.5: Unified Structure Learning for OCR-free Document Understanding

Anwen Hu, Haiyang Xu, Jiabo Ye, Ming Yan, Liang Zhang, Bo Zhang, Chen Li, Ji Zhang, Qin Jin, Fei Huang, Jingren Zhou

专题命中推理评测：reasoning(abstract)

Comments 21 pages, 15 figures

2401.16205 2024-03-20 cs.RO 50%

CognitiveOS: Large Multimodal Model based System to Endow Any Type of Robot with Generative AI

Artem Lykov, Mikhail Konenkov, Koffivi Fidèle Gbagbe, Mikhail Litvinov, Denis Davletshin, Aleksey Fedoseev, Miguel Altamirano Cabrera, Robinroy Peter, Dzmitry Tsetserukou

专题命中推理评测：reasoning(abstract)

Comments The paper is submitted to the IEEE conference

2403.10287 2024-03-18 cs.CV 50%

Few-Shot Image Classification and Segmentation as Visual Question Answering Using Vision-Language Models

Tian Meng, Yang Tao, Ruilin Lyu, Wuliang Yin

专题命中推理评测：chain-of-thought(abstract)

2403.07301 2024-03-13 cs.CV 50%

Let Storytelling Tell Vivid Stories: An Expressive and Fluent Multimodal Storyteller

Chuanqi Zang, Jiji Tang, Rongsheng Zhang, Zeng Zhao, Tangjie Lv, Mingtao Pei, Wei Liang

专题命中推理评测：reasoning(abstract)

2403.07198 2024-03-13 cs.CV 50%

Action Reimagined: Text-to-Pose Video Editing for Dynamic Human Actions

Lan Wang, Vishnu Boddeti, Sernam Lim

专题命中推理评测：reasoning(abstract)

2403.05280 2024-03-11 cs.CV 50%

ContrastDiagnosis: Enhancing Interpretability in Lung Nodule Diagnosis Using Contrastive Learning

Chenglong Wang, Yinqiao Yi, Yida Wang, Chengxiu Zhang, Yun Liu, Kensaku Mori, Mei Yuan, Guang Yang

专题命中推理评测：reasoning(abstract)

2401.16822 2024-03-11 cs.CV 50%

EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domain

Wei Zhang, Miaoxin Cai, Tong Zhang, Yin Zhuang, Xuerui Mao

专题命中推理评测：reasoning(abstract)

2312.05476 2024-03-05 cs.CV 50%

Exploring the Naturalness of AI-Generated Images

Zijian Chen, Wei Sun, Haoning Wu, Zicheng Zhang, Jun Jia, Zhongpeng Ji, Fengyu Sun, Shangling Jui, Xiongkuo Min, Guangtao Zhai, Wenjun Zhang

专题命中推理评测：reasoning(abstract)

Comments 33 pages

1. 推理评测 10577 篇

video-SALMONN: Speech-Enhanced Audio-Visual Large Language Models

Learning Traffic Crashes as Language: Datasets, Benchmarks, and What-if Causal Analyses

Multiagent Multitraversal Multimodal Self-Driving: Open MARS Dataset

Fair by design: A sociotechnical approach to justifying the fairness of AI-enabled systems across the lifecycle

Visual Transformation Telling

RAIL: Robot Affordance Imagination with Large Language Models

MotionLLM: Understanding Human Behaviors from Human Motions and Videos

VQA Training Sets are Self-play Environments for Generating Few-shot Pools

Traffic Performance GPT (TP-GPT): Real-Time Data Informed Intelligent ChatBot for Transportation Surveillance and Management

LLMChain: Blockchain-based Reputation System for Sharing and Evaluating Large Language Models

RadGenome-Chest CT: A Grounded Vision-Language Dataset for Chest CT Analysis

Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMs

3DBench: A Scalable 3D Benchmark and Instruction-Tuning Dataset

CT Liver Segmentation via PVT-based Encoding and Refined Decoding

Requirements Satisfiability with In-Context Learning

LimSim++: A Closed-Loop Platform for Deploying Multimodal LLMs in Autonomous Driving

Music Recommendation Based on Facial Emotion Recognition

Embedded Heterogeneous Attention Transformer for Cross-lingual Image Captioning

Segment Anything in Medical Images

Assessment of Multimodal Large Language Models in Alignment with Human Values

The Limits of Perception: Analyzing Inconsistencies in Saliency Maps in XAI

ManiPose: A Comprehensive Benchmark for Pose-aware Object Manipulation in Robotics

mPLUG-DocOwl 1.5: Unified Structure Learning for OCR-free Document Understanding

CognitiveOS: Large Multimodal Model based System to Endow Any Type of Robot with Generative AI

Few-Shot Image Classification and Segmentation as Visual Question Answering Using Vision-Language Models

Let Storytelling Tell Vivid Stories: An Expressive and Fluent Multimodal Storyteller

Action Reimagined: Text-to-Pose Video Editing for Dynamic Human Actions

ContrastDiagnosis: Enhancing Interpretability in Lung Nodule Diagnosis Using Contrastive Learning

EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domain

Exploring the Naturalness of AI-Generated Images