大模型推理能力

Exploring Group and Symmetry Principles in Large Language Models

Shima Imani, Hamid Palangi

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Interpreting and Improving Large Language Models in Arithmetic Calculation

Wei Zhang, Chaoqun Wan, Yonggang Zhang, Yiu-ming Cheung, Xinmei Tian, Xu Shen, Jieping Ye

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments Accepted by ICML 2024 (oral)

An Incomplete Loop: Instruction Inference, Instruction Following, and In-context Learning in Language Models

Emmy Liu, Graham Neubig, Jacob Andreas

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments COLM 2024

Tuning Language Models by Proxy

Alisa Liu, Xiaochuang Han, Yizhong Wang, Yulia Tsvetkov, Yejin Choi, Noah A. Smith

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments COLM 2024 camera-ready, code available at https://github.com/alisawuffles/proxy-tuning

Extend Model Merging from Fine-Tuned to Pre-Trained Large Language Models via Weight Disentanglement

Le Yu, Bowen Yu, Haiyang Yu, Fei Huang, Yongbin Li

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments 17 pages

SeaLLMs 3: Open Foundation and Chat Multilingual Large Language Models for Southeast Asian Languages

Wenxuan Zhang, Hou Pong Chan, Yiran Zhao, Mahani Aljunied, Jianyu Wang, Chaoqun Liu, Yue Deng, Zhiqiang Hu, Weiwen Xu, Yew Ken Chia, Xin Li, Lidong Bing

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Towards Effective and Efficient Continual Pre-training of Large Language Models

Jie Chen, Zhipeng Chen, Jiapeng Wang, Kun Zhou, Yutao Zhu, Jinhao Jiang, Yingqian Min, Wayne Xin Zhao, Zhicheng Dou, Jiaxin Mao, Yankai Lin, Ruihua Song, Jun Xu, Xu Chen, Rui Yan, Zhewei Wei, Di Hu, Wenbing Huang, Ji-Rong Wen

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments 16 pages, 10 figures, 16 tables

Towards Guaranteed Safe AI: A Framework for Ensuring Robust and Reliable AI Systems

David "davidad" Dalrymple, Joar Skalse, Yoshua Bengio, Stuart Russell, Max Tegmark, Sanjit Seshia, Steve Omohundro, Christian Szegedy, Ben Goldhaber, Nora Ammann, Alessandro Abate, Joe Halpern, Clark Barrett, Ding Zhao, Tan Zhi-Xuan, Jeannette Wing, Joshua Tenenbaum

专题命中 数学推理 ：verifier(abstract)；分类 cs.AI

Smart Vision-Language Reasoners

Denisa Roberts, Lucas Roberts

专题命中 数学推理 ：reasoning(abstract)；分类 cs.AI

Comments Accepted in ICML 2024 MATH AI Workshop

LLMs-as-Instructors: Learning from Errors Toward Automating Model Improvement

Jiahao Ying, Mingbao Lin, Yixin Cao, Wei Tang, Bo Wang, Qianru Sun, Xuanjing Huang, Shuicheng Yan

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Multimodal Explainable Artificial Intelligence: A Comprehensive Review of Methodological Advances and Future Research Directions

Nikolaos Rodis, Christos Sardianos, Panagiotis Radoglou-Grammatikis, Panagiotis Sarigiannidis, Iraklis Varlamis, Georgios Th. Papadopoulos

专题命中 数学推理 ：reasoning(abstract)；分类 cs.AI

Comments 49 pages, 11 figures

Applying RLAIF for Code Generation with API-usage in Lightweight LLMs

Sujan Dutta, Sayantan Mahinder, Raviteja Anantha, Bortik Bandyopadhyay

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Can LLMs Reason in the Wild with Programs?

Yuan Yang, Siheng Xiong, Ali Payani, Ehsan Shareghi, Faramarz Fekri

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

An LLM Compiler for Parallel Function Calling

Sehoon Kim, Suhong Moon, Ryan Tabrizi, Nicholas Lee, Michael W. Mahoney, Kurt Keutzer, Amir Gholami

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments ICML 2024

Exploring Mathematical Extrapolation of Large Language Models with Synthetic Data

Haolong Li, Yu Ma, Yinqi Zhang, Chen Ye, Jie Chen

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments Accept by Findings of ACL 2024

SIBO: A Simple Booster for Parameter-Efficient Fine-Tuning

Zhihao Wen, Jie Zhang, Yuan Fang

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments Accepted by ACL 2024, 17 pages

LLaMA Pro: Progressive LLaMA with Block Expansion

Chengyue Wu, Yukang Gan, Yixiao Ge, Zeyu Lu, Jiahao Wang, Ye Feng, Ying Shan, Ping Luo

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments Accepted by ACL 2024, Main Conference

Efficient Model-agnostic Alignment via Bayesian Persuasion

Fengshuo Bai, Mingzhi Wang, Zhaowei Zhang, Boyuan Chen, Yinda Xu, Ying Wen, Yaodong Yang

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Self-Guiding Exploration for Combinatorial Problems

Zangir Iklassov, Yali Du, Farkhad Akimov, Martin Takac

专题命中 数学推理 ：reasoning(abstract)；分类 cs.AI

Comments 22 pages

DOP: Diagnostic-Oriented Prompting for Large Language Models in Mathematical Correction

Hao Chen, Biaojie Zeng, Xin Lin, Liang He, Aimin Zhou

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Exploring Internal Numeracy in Language Models: A Case Study on ALBERT

Ulme Wennberg, Gustav Eje Henter

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments 4 pages + references, 4 figures. Accepted for publication at the MathNLP Workshop at LREC-COLING 2024

MARIO Eval: Evaluate Your Math LLM with your Math LLM--A mathematical dataset evaluation toolkit

Boning Zhang, Chengxi Li, Kai Fan

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Learning From Failure: Integrating Negative Examples when Fine-tuning Large Language Models as Agents

Renxi Wang, Haonan Li, Xudong Han, Yixuan Zhang, Timothy Baldwin

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments Agent, LLM, Large Language Model

Bridging the Gap between Different Vocabularies for LLM Ensemble

Yangyifan Xu, Jinliang Lu, Jiajun Zhang

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments Accepted to the main conference of NAACL 2024

Stable Code Technical Report

Nikhil Pinnaparaju, Reshinth Adithyan, Duy Phung, Jonathan Tow, James Baicoianu, Ashish Datta, Maksym Zhuravinskyi, Dakota Mahan, Marco Bellagente, Carlos Riquelme, Nathan Cooper

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Teaching Language Models to Self-Improve through Interactive Demonstrations

Xiao Yu, Baolin Peng, Michel Galley, Jianfeng Gao, Zhou Yu

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments NAACL 2024 main

RankPrompt: Step-by-Step Comparisons Make Language Models Better Reasoners

Chi Hu, Yuan Ge, Xiangnan Ma, Hang Cao, Qiang Li, Yonghua Yang, Tong Xiao, Jingbo Zhu

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments LREC-Coling 2024 Long Paper

Machine learning and information theory concepts towards an AI Mathematician

Yoshua Bengio, Nikolay Malkin

专题命中 数学推理 ：reasoning(abstract)；分类 cs.AI

Comments To appear in the Bulletin of the AMS, 2024

SAIE Framework: Support Alone Isn't Enough -- Advancing LLM Training with Adversarial Remarks

Mengsay Loem, Masahiro Kaneko, Naoaki Okazaki

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Can LLMs Compute with Reasons?

Harshit Sandilya, Peehu Raj, Jainit Sushil Bafna, Srija Mukhopadhyay, Shivansh Sharma, Ellwil Sharma, Arastu Sharma, Neeta Trivedi, Manish Shrivastava, Rajesh Kumar

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments 8 pages