大模型推理能力

Advancing GenAI Assisted Programming--A Comparative Study on Prompt Efficiency and Code Quality Between GPT-4 and GLM-4

Angus Yang, Zehan Li, Jie Li

专题命中 推理评测 ：CoT(abstract)；分类 cs.AI

Comments 18 pages, 4 figures, 3 tables

Evaluation of ChatGPT's Smart Contract Auditing Capabilities Based on Chain of Thought

Yuying Du, Xueyan Tang

专题命中 推理评测 ：CoT(abstract)；分类 cs.AI

Comments 21 pages, 10 figures

Modularized Networks for Few-shot Hateful Meme Detection

Rui Cao, Roy Ka-Wei Lee, Jing Jiang

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments camera-ready for WWW, 2024, Web4Good

Accountable Textual-Visual Chat Learns to Reject Human Instructions in Image Re-creation

Zhiwei Zhang, Yuliang Liu

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI

Comments TMLR, Survey Certification

RoleEval: A Bilingual Role Evaluation Benchmark for Large Language Models

Tianhao Shen, Sun Li, Quan Tu, Deyi Xiong

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments Our dataset is available at https://github.com/Magnetic2014/RoleEval

TransLLaMa: LLM-based Simultaneous Translation System

Roman Koshkin, Katsuhito Sudoh, Satoshi Nakamura

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Promises and pitfalls of artificial intelligence for legal applications

Sayash Kapoor, Peter Henderson, Arvind Narayanan

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI

LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understanding

Yanzhe Zhang, Ruiyi Zhang, Jiuxiang Gu, Yufan Zhou, Nedim Lipka, Diyi Yang, Tong Sun

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments Preprint

Equipping Language Models with Tool Use Capability for Tabular Data Analysis in Finance

Adrian Theuma, Ehsan Shareghi

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments Accepted to EACL2024; code, model and dataset are available at https://raven-lm.github.io

E-EVAL: A Comprehensive Chinese K-12 Education Evaluation Benchmark for Large Language Models

Jinchang Hou, Chang Ao, Haihong Wu, Xiangtao Kong, Zhigang Zheng, Daijia Tang, Chengming Li, Xiping Hu, Ruifeng Xu, Shiwen Ni, Min Yang

专题命中 推理评测 ：CoT(abstract)；分类 cs.CL

Green Runner: A tool for efficient deep learning component selection

Jai Kannan

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI

ConvoSense: Overcoming Monotonous Commonsense Inferences for Conversational AI

Sarah E. Finch, Jinho D. Choi

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments accepted to TACL 2024; final author's version of paper; pre-MIT Press publication version

MultiHop-RAG: Benchmarking Retrieval-Augmented Generation for Multi-Hop Queries

Yixuan Tang, Yi Yang

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments Link: https://github.com/yixuantt/MultiHop-RAG/

Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Data

Xuhai Xu, Bingsheng Yao, Yuanzhe Dong, Saadia Gabriel, Hong Yu, James Hendler, Marzyeh Ghassemi, Anind K. Dey, Dakuo Wang

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments Published at Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT) 2024

ChatGPT Evaluation on Sentence Level Relations: A Focus on Temporal, Causal, and Discourse Relations

Chunkit Chan, Jiayang Cheng, Weiqi Wang, Yuxin Jiang, Tianqing Fang, Xin Liu, Yangqiu Song

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments Accepted to Findings of EACL2024 "Exploring the Potential of ChatGPT on Sentence Level Relations: A Focus on Temporal, Causal, and Discourse Relations"

Symbrain: A large-scale dataset of MRI images for neonatal brain symmetry analysis

Arnaud Gucciardi, Safouane El Ghazouali, Francesca Venturini, Vida Groznik, Umberto Michelucci

专题命中 推理评测 ：planning(abstract)；分类 cs.AI

Comments 7 pages, 2 figures, Dataset Paper, Medical AI

The Radiation Oncology NLP Database

Zhengliang Liu, Jason Holmes, Wenxiong Liao, Chenbin Liu, Lian Zhang, Hongying Feng, Peilong Wang, Muhammad Ali Elahi, Hongmin Cai, Lichao Sun, Quanzheng Li, Xiang Li, Tianming Liu, Jiajian Shen, Wei Liu

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments 10 pages, 7 figures, 6 tables

SAGE: Smart home Agent with Grounded Execution

Dmitriy Rivkin, Francois Hogan, Amal Feriani, Abhisek Konar, Adam Sigal, Steve Liu, Greg Dudek

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI

Enabling Collaborative Clinical Diagnosis of Infectious Keratitis by Integrating Expert Knowledge and Interpretable Data-driven Intelligence

Zhengqing Fang, Shuowen Zhou, Zhouhang Yuan, Yuxuan Si, Mengze Li, Jinxu Li, Yesheng Xu, Wenjia Xie, Kun Kuang, Yingming Li, Fei Wu, Yu-Feng Yao

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI

Comments 33 pages

Paralinguistics-Enhanced Large Language Modeling of Spoken Dialogue

Guan-Ting Lin, Prashanth Gurunath Shivakumar, Ankur Gandhe, Chao-Han Huck Yang, Yile Gu, Shalini Ghosh, Andreas Stolcke, Hung-yi Lee, Ivan Bulyko

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments Accepted by ICASSP 2024. Camera-ready version

A Novel Multi-Stage Prompting Approach for Language Agnostic MCQ Generation using GPT

Subhankar Maity, Aniket Deroy, Sudeshna Sarkar

专题命中 推理评测 ：chain-of-thought(abstract)；分类 cs.CL

Comments Accepted at ECIR 2024(short paper)

PUB: A Pragmatics Understanding Benchmark for Assessing LLMs' Pragmatics Capabilities

Settaluri Lakshmi Sravanthi, Meet Doshi, Tankala Pavan Kalyan, Rudra Murthy, Pushpak Bhattacharyya, Raj Dabre

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Knowledge-aware Graph Transformer for Pedestrian Trajectory Prediction

Yu Liu, Yuexin Zhang, Kunming Li, Yongliang Qiao, Stewart Worrall, You-Fu Li, He Kong

专题命中 推理评测 ：planning(abstract)；分类 cs.LG

Comments This paper was accepted to and presented at the 26th IEEE International Conference on Intelligent Transportation Systems (ITSC), September 2023

Empirical Study of Large Language Models as Automated Essay Scoring Tools in English Composition__Taking TOEFL Independent Writing Task for Example

Wei Xia, Shaoguang Mao, Chanjing Zheng

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

RJUA-QA: A Comprehensive QA Dataset for Urology

Shiwei Lyu, Chenfei Chi, Hongbo Cai, Lei Shi, Xiaoyan Yang, Lei Liu, Xiang Chen, Deng Zhao, Zhiqiang Zhang, Xianguo Lyu, Ming Zhang, Fangzhou Li, Xiaowei Ma, Yue Shen, Jinjie Gu, Wei Xue, Yiran Huang

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments An initial version

Location Aware Modular Biencoder for Tourism Question Answering

Haonan Li, Martin Tomko, Timothy Baldwin

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments Accepted at AACL 2023

VideoChat: Chat-Centric Video Understanding

KunChang Li, Yinan He, Yi Wang, Yizhuo Li, Wenhai Wang, Ping Luo, Yali Wang, Limin Wang, Yu Qiao

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments Technical report

FusionMind -- Improving question and answering with external context fusion

Shreyas Verma, Manoj Parmar, Palash Choudhary, Sanchita Porwal

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments 5 pages, 4 figures, 4 tables

Symbol tuning improves in-context learning in language models

Jerry Wei, Le Hou, Andrew Lampinen, Xiangning Chen, Da Huang, Yi Tay, Xinyun Chen, Yifeng Lu, Denny Zhou, Tengyu Ma, Quoc V. Le

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments EMNLP 2023

SecQA: A Concise Question-Answering Dataset for Evaluating Large Language Models in Computer Security

Zefang Liu

专题命中 推理评测 ：planning(abstract)；分类 cs.CL