大模型推理能力

Kwai-STaR: Transform LLMs into State-Transition Reasoners

Xingyu Lu, Yuhang Hu, Changyi Liu, Tianke Zhang, Zhenyu Yang, Zhixiang Ding, Shengsheng Qian, Meng Du, Ruiwen Kang, Kaiyu Tang, Fan Yang, Tingting Gao, Di Zhang, Hai-Tao Zheng, Bin Wen

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL、cs.AI

Comments 6 pages, 2 figures

SBI-RAG: Enhancing Math Word Problem Solving for Students through Schema-Based Instruction and Retrieval-Augmented Generation

Prakhar Dixit, Tim Oates

专题命中 数学推理 ：reasoning(abstract)；分类 cs.AI、cs.LG

Comments Accepted to the 4th MATH-AI Workshop at NeurIPS'24

Give me a hint: Can LLMs take a hint to solve math problems?

Vansh Agrawal, Pratham Singla, Amitoj Singh Miglani, Shivank Garg, Ayush Mangal

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL、cs.AI

Noise Contrastive Alignment of Language Models with Explicit Rewards

Huayu Chen, Guande He, Lifan Yuan, Ganqu Cui, Hang Su, Jun Zhu

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL、cs.LG

Comments NeurIPS 2024

Assessing the Creativity of LLMs in Proposing Novel Solutions to Mathematical Problems

Junyi Ye, Jingyi Gu, Xinyun Zhao, Wenpeng Yin, Guiling Wang

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL、cs.AI

Keep Guessing? When Considering Inference Scaling, Mind the Baselines

Gal Yona, Or Honovich, Omer Levy, Roee Aharoni

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL、cs.AI

When Not to Answer: Evaluating Prompts on GPT Models for Effective Abstention in Unanswerable Math Word Problems

Asir Saadat, Tasmia Binte Sogir, Md Taukir Azam Chowdhury, Syem Aziz

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL、cs.LG

Comments 11 pages, 7 figures, 2 tables

How to Leverage Demonstration Data in Alignment for Large Language Model? A Self-Imitation Learning Perspective

Teng Xiao, Mingxiao Li, Yige Yuan, Huaisheng Zhu, Chao Cui, Vasant G Honavar

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL、cs.LG

Comments EMNLP 2024 Main

How Does Quantization Affect Multilingual LLMs?

Kelly Marchisio, Saurabh Dash, Hongyu Chen, Dennis Aumiller, Ahmet Üstün, Sara Hooker, Sebastian Ruder

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL、cs.LG

Comments Findings of EMNLP 2024 Camera-Ready

PositionID: LLMs can Control Lengths, Copy and Paste with Explicit Positional Awareness

Zekun Wang, Feiyu Duan, Yibo Zhang, Wangchunshu Zhou, Ke Xu, Wenhao Huang, Jie Fu

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL、cs.AI

Comments 39 pages. CP-Bench and LenCtrl-Bench are available in https://huggingface.co/datasets/ZenMoore/CP-Bench and https://huggingface.co/datasets/ZenMoore/LenCtrl-Bench

Efficient Prompting for LLM-based Generative Internet of Things

Bin Xiao, Burak Kantarci, Jiawen Kang, Dusit Niyato, Mohsen Guizani

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL、cs.AI

Comments 14 pages, 11 figures. IEEE Internet of Things Journal, 2024

AlignedCoT: Prompting Large Language Models via Native-Speaking Demonstrations

Zhicheng Yang, Yinya Huang, Jing Xiong, Liang Feng, Xiaodan Liang, Yiwei Wang, Jing Tang

专题命中 数学推理 ：reasoning(abstract)；分类 cs.AI、cs.LG

Comments Findings of EMNLP 2024

Losing Visual Needles in Image Haystacks: Vision Language Models are Easily Distracted in Short and Long Contexts

Aditya Sharma, Michael Saxon, William Yang Wang

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL、cs.AI

Comments Findings of EMNLP 2024

PTD-SQL: Partitioning and Targeted Drilling with LLMs in Text-to-SQL

Ruilin Luo, Liyuan Wang, Binghuai Lin, Zicheng Lin, Yujiu Yang

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL、cs.AI

Comments EMNLP 2024 Main Conference. Revised by ARR April and ARR June. 32 pages, 7 figures and 30 tables

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Marah Abdin, Jyoti Aneja, Hany Awadalla, Ahmed Awadallah, Ammar Ahmad Awan, Nguyen Bach, Amit Bahree, Arash Bakhtiari, Jianmin Bao, Harkirat Behl, Alon Benhaim, Misha Bilenko, Johan Bjorck, Sébastien Bubeck, Martin Cai, Qin Cai, Vishrav Chaudhary, Dong Chen, Dongdong Chen, Weizhu Chen, Yen-Chun Chen, Yi-Ling Chen, Hao Cheng, Parul Chopra, Xiyang Dai, Matthew Dixon, Ronen Eldan, Victor Fragoso, Jianfeng Gao, Mei Gao, Min Gao, Amit Garg, Allie Del Giorno, Abhishek Goswami, Suriya Gunasekar, Emman Haider, Junheng Hao, Russell J. Hewett, Wenxiang Hu, Jamie Huynh, Dan Iter, Sam Ade Jacobs, Mojan Javaheripi, Xin Jin, Nikos Karampatziakis, Piero Kauffmann, Mahoud Khademi, Dongwoo Kim, Young Jin Kim, Lev Kurilenko, James R. Lee, Yin Tat Lee, Yuanzhi Li, Yunsheng Li, Chen Liang, Lars Liden, Xihui Lin, Zeqi Lin, Ce Liu, Liyuan Liu, Mengchen Liu, Weishung Liu, Xiaodong Liu, Chong Luo, Piyush Madan, Ali Mahmoudzadeh, David Majercak, Matt Mazzola, Caio César Teodoro Mendes, Arindam Mitra, Hardik Modi, Anh Nguyen, Brandon Norick, Barun Patra, Daniel Perez-Becker, Thomas Portet, Reid Pryzant, Heyang Qin, Marko Radmilac, Liliang Ren, Gustavo de Rosa, Corby Rosset, Sambudha Roy, Olatunji Ruwase, Olli Saarikivi, Amin Saied, Adil Salim, Michael Santacroce, Shital Shah, Ning Shang, Hiteshi Sharma, Yelong Shen, Swadheen Shukla, Xia Song, Masahiro Tanaka, Andrea Tupini, Praneetha Vaddamanu, Chunyu Wang, Guanhua Wang, Lijuan Wang, Shuohang Wang, Xin Wang, Yu Wang, Rachel Ward, Wen Wen, Philipp Witte, Haiping Wu, Xiaoxia Wu, Michael Wyatt, Bin Xiao, Can Xu, Jiahang Xu, Weijian Xu, Jilong Xue, Sonali Yadav, Fan Yang, Jianwei Yang, Yifan Yang, Ziyi Yang, Donghan Yu, Lu Yuan, Chenruidong Zhang, Cyril Zhang, Jianwen Zhang, Li Lyna Zhang, Yi Zhang, Yue Zhang, Yunan Zhang, Xiren Zhou

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL、cs.AI

Comments 24 pages

A Perspective on Large Language Models, Intelligent Machines, and Knowledge Acquisition

Vladimir Cherkassky, Eng Hock Lee

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL、cs.AI

The Qiyas Benchmark: Measuring ChatGPT Mathematical and Language Understanding in Arabic

Shahad Al-Khalifa, Hend Al-Khalifa

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL、cs.AI

MathOdyssey: Benchmarking Mathematical Problem-Solving Skills in Large Language Models Using Odyssey Math Data

Meng Fang, Xiangpeng Wan, Fei Lu, Fei Xing, Kai Zou

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL、cs.AI

Pre-Calc: Learning to Use the Calculator Improves Numeracy in Language Models

Vishruth Veerendranath, Vishwa Shah, Kshitish Ghate

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL、cs.AI

Comments AI4Math workshop, ICML 2024

Case-Based or Rule-Based: How Do Transformers Do the Math?

Yi Hu, Xiaojuan Tang, Haotong Yang, Muhan Zhang

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL、cs.AI

Transformer Normalisation Layers and the Independence of Semantic Subspaces

Stephen Menary, Samuel Kaski, Andre Freitas

专题命中 数学推理 ：reasoning(abstract)；分类 cs.AI、cs.LG

Lottery Ticket Adaptation: Mitigating Destructive Interference in LLMs

Ashwinee Panda, Berivan Isik, Xiangyu Qi, Sanmi Koyejo, Tsachy Weissman, Prateek Mittal

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL、cs.AI

Prompt Optimization via Adversarial In-Context Learning

Xuan Long Do, Yiran Zhao, Hannah Brown, Yuxi Xie, James Xu Zhao, Nancy F. Chen, Kenji Kawaguchi, Michael Shieh, Junxian He

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL、cs.LG

Comments ACL 2024

DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligence

DeepSeek-AI, Qihao Zhu, Daya Guo, Zhihong Shao, Dejian Yang, Peiyi Wang, Runxin Xu, Y. Wu, Yukun Li, Huazuo Gao, Shirong Ma, Wangding Zeng, Xiao Bi, Zihui Gu, Hanwei Xu, Damai Dai, Kai Dong, Liyue Zhang, Yishi Piao, Zhibin Gou, Zhenda Xie, Zhewen Hao, Bingxuan Wang, Junxiao Song, Deli Chen, Xin Xie, Kang Guan, Yuxiang You, Aixin Liu, Qiushi Du, Wenjun Gao, Xuan Lu, Qinyu Chen, Yaohui Wang, Chengqi Deng, Jiashi Li, Chenggang Zhao, Chong Ruan, Fuli Luo, Wenfeng Liang

专题命中 数学推理 ：reasoning(abstract)；分类 cs.AI、cs.LG

Pride and Prejudice: LLM Amplifies Self-Bias in Self-Refinement

Wenda Xu, Guanglei Zhu, Xuandong Zhao, Liangming Pan, Lei Li, William Yang Wang

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL、cs.AI

Knowledge Distillation of LLM for Automatic Scoring of Science Education Assessments

Ehsan Latif, Luyang Fang, Ping Ma, Xiaoming Zhai

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL、cs.AI

Comments Accepted to AIED2024

Pre-trained Large Language Models Use Fourier Features to Compute Addition

Tianyi Zhou, Deqing Fu, Vatsal Sharan, Robin Jia

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL、cs.LG

MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning

Ting Jiang, Shaohan Huang, Shengyue Luo, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang, Deqing Wang, Fuzhen Zhuang

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL、cs.LG

Comments Work in Progress

Cross-Language Assessment of Mathematical Capability of ChatGPT

Gargi Sathe, Aneesh Shamraj, Aditya Surve, Nahush Patil, Kumkum Saxena

专题命中 数学推理 ：chain-of-thought(abstract)；分类 cs.CL、cs.LG

Enabling High-Sparsity Foundational Llama Models with Efficient Pretraining and Deployment

Abhinav Agarwalla, Abhay Gupta, Alexandre Marques, Shubhra Pandit, Michael Goin, Eldar Kurtic, Kevin Leong, Tuan Nguyen, Mahmoud Salem, Dan Alistarh, Sean Lie, Mark Kurtz

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL、cs.AI