大模型推理能力

Tool-Augmented Reward Modeling

Lei Li, Yekun Chai, Shuohuan Wang, Yu Sun, Hao Tian, Ningyu Zhang, Hua Wu

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments ICLR 2024 Spotlight

Understanding the Effect of Noise in LLM Training Data with Algorithmic Chains of Thought

Alex Havrilla, Maia Iyer

专题命中 数学推理 ：CoT(abstract)；分类 cs.LG

Improving Semantic Control in Discrete Latent Spaces with Transformer Quantized Variational Autoencoders

Yingji Zhang, Danilo S. Carvalho, Marco Valentino, Ian Pratt-Hartmann, Andre Freitas

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

TroVE: Inducing Verifiable and Efficient Toolboxes for Solving Programmatic Tasks

Zhiruo Wang, Daniel Fried, Graham Neubig

专题命中 数学推理 ：reasoning(abstract)；分类 cs.AI

Separate the Wheat from the Chaff: Model Deficiency Unlearning via Parameter-Efficient Module Operation

Xinshuo Hu, Dongfang Li, Baotian Hu, Zihao Zheng, Zhenyu Liu, Min Zhang

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments AAAI 2024; The first two authors contributed equally to this paper

Is Bigger and Deeper Always Better? Probing LLaMA Across Scales and Layers

Nuo Chen, Ning Wu, Shining Liang, Ming Gong, Linjun Shou, Dongmei Zhang, Jia Li

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments 15 pages

Token-Scaled Logit Distillation for Ternary Weight Generative Language Models

Minsoo Kim, Sihwa Lee, Janghwan Lee, Sukjin Hong, Du-Seong Chang, Wonyong Sung, Jungwook Choi

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments NeurIPS 2023 Camera Ready

The ART of LLM Refinement: Ask, Refine, and Trust

Kumar Shridhar, Koustuv Sinha, Andrew Cohen, Tianlu Wang, Ping Yu, Ram Pasunuru, Mrinmaya Sachan, Jason Weston, Asli Celikyilmaz

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Code Soliloquies for Accurate Calculations in Large Language Models

Shashank Sonkar, MyCo Le, Xinghe Chen, Naiming Liu, Debshila Basu Mallick, Richard G. Baraniuk

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Three Questions Concerning the Use of Large Language Models to Facilitate Mathematics Learning

An-Zi Yen, Wei-Ling Hsu

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments Accepted by EMNLP 2023 Findings

Improving Large Language Model Fine-tuning for Solving Math Problems

Yixin Liu, Avi Singh, C. Daniel Freeman, John D. Co-Reyes, Peter J. Liu

专题命中 数学推理 ：verifier(abstract)；分类 cs.CL

Empirical Study of Zero-Shot NER with ChatGPT

Tingyu Xie, Qi Li, Jian Zhang, Yan Zhang, Zuozhu Liu, Hongwei Wang

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments Accepted to EMNLP 2023 (Main Conference)

LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models

Zhiqiang Hu, Lei Wang, Yihuai Lan, Wanyu Xu, Ee-Peng Lim, Lidong Bing, Xing Xu, Soujanya Poria, Roy Ka-Wei Lee

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments EMNLP 2023. The code of our framework can be found at AGI-Edgerunners/LLM-Adapters" target="_blank" rel="noopener">https://github.com/AGI-Edgerunners/LLM-Adapters. We will keep all of the code open-source and continue to update the framework with new adapters, LLMs, and tasks

Qwen Technical Report

Jinze Bai, Shuai Bai, Yunfei Chu, Zeyu Cui, Kai Dang, Xiaodong Deng, Yang Fan, Wenbin Ge, Yu Han, Fei Huang, Binyuan Hui, Luo Ji, Mei Li, Junyang Lin, Runji Lin, Dayiheng Liu, Gao Liu, Chengqiang Lu, Keming Lu, Jianxin Ma, Rui Men, Xingzhang Ren, Xuancheng Ren, Chuanqi Tan, Sinan Tan, Jianhong Tu, Peng Wang, Shijie Wang, Wei Wang, Shengguang Wu, Benfeng Xu, Jin Xu, An Yang, Hao Yang, Jian Yang, Shusheng Yang, Yang Yao, Bowen Yu, Hongyi Yuan, Zheng Yuan, Jianwei Zhang, Xingxuan Zhang, Yichang Zhang, Zhenru Zhang, Chang Zhou, Jingren Zhou, Xiaohuan Zhou, Tianhang Zhu

专题命中 数学推理 ：planning(abstract)；分类 cs.CL

Comments 59 pages, 5 figures

On the meaning of uncertainty for ethical AI: philosophy and practice

Cassandra Bird, Daniel Williamson, Sabina Leonelli

专题命中 数学推理 ：reasoning(abstract)；分类 cs.AI

Comments 26 pages, 2 figures

Bayesian artificial brain with ChatGPT

Renato A. Krohling

专题命中 数学推理 ：reasoning(abstract)；分类 cs.AI

Teaching Arithmetic to Small Transformers

Nayoung Lee, Kartik Sreenivasan, Jason D. Lee, Kangwook Lee, Dimitris Papailiopoulos

专题命中 数学推理 ：chain-of-thought(abstract)；分类 cs.LG

Blank Collapse: Compressing CTC emission for the faster decoding

Minkyu Jung, Ohhyeok Kwon, Seunghyun Seo, Soonshin Seo

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments Accepted in Interspeech 2023

Evaluating Transformer Language Models on Arithmetic Operations Using Number Decomposition

Matteo Muffo, Aldo Cocco, Enrico Bertino

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments 7 pages, 1 figure, published at LREC 2022

Journal ref Proceedings of the 13th Conference on Language Resources and Evaluation (LREC 2022), pages 291-297

Tree-Based Representation and Generation of Natural and Mathematical Language

Alexander Scarlatos, Andrew Lan

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Techniques to Improve Neural Math Word Problem Solvers

Youyuan Zhang

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Computable Artificial General Intelligence

Michael Timothy Bennett

专题命中 数学推理 ：reasoning(abstract)；分类 cs.AI

Comments Experiment code available on TechRxiv: https://www.techrxiv.org/articles/preprint/Computable_Artificial_General_Intelligence/19740190

Galactica: A Large Language Model for Science

Ross Taylor, Marcin Kardas, Guillem Cucurull, Thomas Scialom, Anthony Hartshorn, Elvis Saravia, Andrew Poulton, Viktor Kerkez, Robert Stojnic

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Generating Sequences by Learning to Self-Correct

Sean Welleck, Ximing Lu, Peter West, Faeze Brahman, Tianxiao Shen, Daniel Khashabi, Yejin Choi

专题命中 数学推理 ：self-correction(abstract)；分类 cs.CL

Limitations of Language Models in Arithmetic and Symbolic Induction

Jing Qian, Hong Wang, Zekun Li, Shiyang Li, Xifeng Yan

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

MMTM: Multi-Tasking Multi-Decoder Transformer for Math Word Problems

Keyur Faldu, Amit Sheth, Prashant Kikani, Darshan Patel

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments 10 pages, 3 figures, 3 tables

MWP-BERT: Numeracy-Augmented Pre-training for Math Word Problem Solving

Zhenwen Liang, Jipeng Zhang, Lei Wang, Wei Qin, Yunshi Lan, Jie Shao, Xiangliang Zhang

专题命中 数学推理 ：reasoning(abstract)；分类 cs.AI

Comments Accepted by the Findings of NAACL 2022

Information Field Theory and Artificial Intelligence

Torsten Enßlin

专题命中 数学推理 ：reasoning(abstract)；分类 cs.LG

Comments 12 pages, three figures, invited talk at MaxEnt2020/2021, reviewed and published by Entropy

Journal ref Torsten A. Enßlin, Entropy 2022, 24, 374

Some Pragmatic Prevention's Guidelines regarding SARS-CoV-2 and COVID-19 in Latin-America inspired by mixed Machine Learning Techniques and Artificial Mathematical Intelligence. Case Study: Colombia

Danny A. J. Gomez-Ramirez, Yoe A. Herrera-Jaramillo, Johana C. Ortega-Giraldo, Alex M. Ardila-Garcia

专题命中 数学推理 ：planning(abstract)；分类 cs.AI

Realising Active Inference in Variational Message Passing: the Outcome-blind Certainty Seeker

Théophile Champion, Marek Grześ, Howard Bowman

专题命中 数学推理 ：planning(abstract)；分类 cs.LG

Comments 60 pages, 19 figures, final version accepted for publication in Neural Computation