大模型推理能力

RAGLAB: A Modular and Research-Oriented Unified Framework for Retrieval-Augmented Generation

Xuanwang Zhang, Yunze Song, Yidong Wang, Shuyun Tang, Xinfeng Li, Zhengran Zeng, Zhen Wu, Wei Ye, Wenyuan Xu, Yue Zhang, Xinyu Dai, Shikun Zhang, Qingsong Wen

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments 6 pages, 3 figures

Blocks as Probes: Dissecting Categorization Ability of Large Multimodal Models

Bin Fu, Qiyang Wan, Jialin Li, Ruiping Wang, Xilin Chen

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI

Comments 39 pages, 28 figures, 4 tables. Accepted at The 35th British Machine Vision Conference (BMVC 2024). Project page at https://fubin29.github.io/Blocks-as-Probes/

Using LLMs for Explaining Sets of Counterfactual Examples to Final Users

Arturo Fredes, Jordi Vitria

专题命中 推理评测 ：reasoning(abstract)；分类 cs.LG

Comments Presented as a poster in the 2nd Workshop on Causal Inference and Machine Learning in Practice at KDD 2024

Text2SQL is Not Enough: Unifying AI and Databases with TAG

Asim Biswal, Liana Patel, Siddarth Jha, Amog Kamsetty, Shu Liu, Joseph E. Gonzalez, Carlos Guestrin, Matei Zaharia

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI

A Comprehensive Evaluation of GPT-4V on Knowledge-Intensive Visual Question Answering

Yunxin Li, Longyue Wang, Baotian Hu, Xinyu Chen, Wanqi Zhong, Chenyang Lyu, Wei Wang, Min Zhang

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments 20 pages, 15 pages; technical paper

A Modular Approach for Multimodal Summarization of TV Shows

Louis Mahon, Mirella Lapata

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

MMBench: Is Your Multi-modal Model an All-around Player?

Yuan Liu, Haodong Duan, Yuanhan Zhang, Bo Li, Songyang Zhang, Wangbo Zhao, Yike Yuan, Jiaqi Wang, Conghui He, Ziwei Liu, Kai Chen, Dahua Lin

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments Accepted in ECCV2024 as Oral Presentation

SEMDR: A Semantic-Aware Dual Encoder Model for Legal Judgment Prediction with Legal Clue Tracing

Pengjie Liu, Wang Zhang, Yulong Ding, Xuefeng Zhang, Shuang-Hua Yang

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Adaptable Logical Control for Large Language Models

Honghua Zhang, Po-Nien Kung, Masahiro Yoshida, Guy Van den Broeck, Nanyun Peng

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

TR2MTL: LLM based framework for Metric Temporal Logic Formalization of Traffic Rules

Kumar Manas, Stefan Zwicklbauer, Adrian Paschke

专题命中 推理评测 ：chain-of-thought(abstract)；分类 cs.LG

Comments Accepted for publication in Proceedings of the IEEE Intelligent Vehicles Symposium (IV), Jeju Island - Korea, 2-5 June 2024

MUSE: Multi-Knowledge Passing on the Edges, Boosting Knowledge Graph Completion

Pengjie Liu

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

User-in-the-loop Evaluation of Multimodal LLMs for Activity Assistance

Mrinal Verghese, Brian Chen, Hamid Eghbalzadeh, Tushar Nagarajan, Ruta Desai

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI

Comments 9 pages, 4 figures

TinyLVLM-eHub: Towards Comprehensive and Efficient Evaluation for Large Vision-Language Models

Wenqi Shao, Meng Lei, Yutao Hu, Peng Gao, Kaipeng Zhang, Fanqing Meng, Peng Xu, Siyuan Huang, Hongsheng Li, Yu Qiao, Ping Luo

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI

Comments accepted to IEEE Transactions on Big Data. Project Page: http://lvlm-ehub.opengvlab.com/

Get Confused Cautiously: Textual Sequence Memorization Erasure with Selective Entropy Maximization

Zhaohan Zhang, Ziquan Liu, Ioannis Patras

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments 15 pages, 7 figures

PAGED: A Benchmark for Procedural Graphs Extraction from Documents

Weihong Du, Wenrui Liao, Hongru Liang, Wenqiang Lei

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments Accepted to The 62nd Annual Meeting of the Association for Computational Linguistics (ACL 2024)

1.5-Pints Technical Report: Pretraining in Days, Not Months -- Your Language Model Thrives on Quality Data

Calvin Tan, Jerome Wang

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments Technical Report for 1.5-Pints

Making Long-Context Language Models Better Multi-Hop Reasoners

Yanyang Li, Shuo Liang, Michael R. Lyu, Liwei Wang

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments ACL 2024 Main Conference Camera Ready; Dataset, model, and code are available at https://github.com/LaVi-Lab/LongContextReasoner

MMRA: A Benchmark for Evaluating Multi-Granularity and Multi-Image Relational Association Capabilities in Large Visual Language Models

Siwei Wu, Kang Zhu, Yu Bai, Yiming Liang, Yizhi Li, Haoning Wu, J. H. Liu, Ruibo Liu, Xingwei Qu, Xuxin Cheng, Ge Zhang, Wenhao Huang, Chenghua Lin

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments VLMs, Multi-Image Association

ARIES: A Corpus of Scientific Paper Edits Made in Response to Peer Reviews

Mike D'Arcy, Alexis Ross, Erin Bransom, Bailey Kuehl, Jonathan Bragg, Tom Hope, Doug Downey

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments ACL 2024, 10 pages, 2 figures

Is Large Language Model Good at Database Knob Tuning? A Comprehensive Experimental Evaluation

Yiyan Li, Haoyang Li, Zhao Pu, Jing Zhang, Xinyi Zhang, Tao Ji, Luming Sun, Cuiping Li, Hong Chen

专题命中 推理评测 ：chain-of-thought(abstract)；分类 cs.AI

PyBench: Evaluating LLM Agent on various real-world coding tasks

Yaolun Zhang, Yinxu Pan, Yudong Wang, Jie Cai

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI

Comments 16 pages

Can LLMs "Reason" in Music? An Evaluation of LLMs' Capability of Music Understanding and Generation

Ziya Zhou, Yuhang Wu, Zhiyue Wu, Xinyue Zhang, Ruibin Yuan, Yinghao Ma, Lu Wang, Emmanouil Benetos, Wei Xue, Yike Guo

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments Accepted by ISMIR2024

V-RECS, a Low-Cost LLM4VIS Recommender with Explanations, Captioning and Suggestions

Luca Podo, Marco Angelini, Paola Velardi

专题命中 推理评测 ：CoT(abstract)；分类 cs.AI

Benchmarks as Microscopes: A Call for Model Metrology

Michael Saxon, Ari Holtzman, Peter West, William Yang Wang, Naomi Saphra

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments Conference paper at COLM 2024

Harnessing LLMs for Automated Video Content Analysis: An Exploratory Workflow of Short Videos on Depression

Jiaying Lizzy Liu, Yunlong Wang, Yao Lyu, Yiheng Su, Shuo Niu, Xuhai Orson Xu, Yan Zhang

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI

Comments 7 pages, 2 figures, accepted by CSCW 24

ArabicMMLU: Assessing Massive Multitask Language Understanding in Arabic

Fajri Koto, Haonan Li, Sara Shatnawi, Jad Doughman, Abdelrahman Boda Sadallah, Aisha Alraeesi, Khalid Almubarak, Zaid Alyafeai, Neha Sengupta, Shady Shehata, Nizar Habash, Preslav Nakov, Timothy Baldwin

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments Findings of ACL 2024

Orca: Ocean Significant Wave Height Estimation with Spatio-temporally Aware Large Language Models

Zhe Li, Ronghui Xu, Jilin Hu, Zhong Peng, Xi Lu, Chenjuan Guo, Bin Yang

专题命中 推理评测 ：reasoning(abstract)；分类 cs.LG

Evaluating LLMs at Detecting Errors in LLM Responses

Ryo Kamoi, Sarkar Snigdha Sarathi Das, Renze Lou, Jihyun Janice Ahn, Yilun Zhao, Xiaoxin Lu, Nan Zhang, Yusen Zhang, Ranran Haoran Zhang, Sujeeth Reddy Vummanthala, Salika Dave, Shaobo Qin, Arman Cohan, Wenpeng Yin, Rui Zhang

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments COLM 2024, 46 pages, Benchmark and code: https://github.com/psunlpgroup/ReaLMistake

Human-Interpretable Adversarial Prompt Attack on Large Language Models with Situational Context

Nilanjana Das, Edward Raff, Manas Gaur

专题命中 推理评测 ：chain-of-thought(abstract)；分类 cs.CL

Grounding Language Models for Visual Entity Recognition

Zilin Xiao, Ming Gong, Paola Cascante-Bonilla, Xingyao Zhang, Jie Wu, Vicente Ordonez

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments ECCV 2024