The rapid development of large language models (LLMs) has spurred extensive research into their domain-specific capabilities, particularly mathematical reasoning. However, most open-source LLMs focus solely on mathematical reasoning, neglecting the integration with visual injection, despite the fact that many mathematical tasks rely on visual inputs such as geometric diagrams, charts, and function plots. To fill this gap, we introduce \textbf{MultiMath-7B}, a multimodal large language model that bridges the gap between math and vision. \textbf{MultiMath-7B} is trained through a four-stage process, focusing on vision-language alignment, visual and math instruction-tuning, and process-supervised reinforcement learning. We also construct a novel, diverse and comprehensive multimodal mathematical dataset, \textbf{MultiMath-300K}, which spans K-12 levels with image captions and step-wise solutions. MultiMath-7B achieves state-of-the-art (SOTA) performance among open-source models on existing multimodal mathematical benchmarks and also excels on text-only mathematical benchmarks. Our model and dataset are available at {\textcolor{blue}{\url{https://github.com/pengshuai-rin/MultiMath}}}.
VCSearch: Bridging the Gap Between Well-Defined and Ill-Defined Problems in Mathematical Reasoning
National Key Laboratory for Novel Software Technology, Nanjing University（南京大学新型软件技术国家重点实验室）；School of Artificial Intelligence, Nanjing University（南京大学人工智能学院）；School of Intelligence Science and Technology, Nanjing University（南京大学智能科学与技术学院）
Iterative Preference Learning from Human Feedback: Bridging Theory and Practice for RLHF under KL-Constraint
University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）；Salesforce AI Research（Salesforce AI研究院）；The Hong Kong University of Science and Technology（香港科技大学）
Learn Globally, Speak Locally: Bridging the Gaps in Multilingual Reasoning
Massachusetts Institute of Technology（麻省理工学院）；Havard Univeristy（哈佛大学）；LG CNS；Université de Montréal（蒙特利尔大学）；Mila（米拉研究所）；Google（谷歌）；Stanford University（斯坦福大学）
NORCE Norwegian Research Centre（挪威研究中心）；Department of Mathematics, Hong Kong Baptist University（香港浸会大学数学系）；School of Data Science and Department of Operations and Risk Management, Lingnan University（岭南大学数据科学学院与运营及风险管理系）
Raman Lab, Malaviya National Institute of Technology（拉曼实验室，马拉维亚国家理工学院）；Inferigence Quotient Private Limited（Inferigence Quotient私人有限公司）；Language Technologies Research Center, KCIS, IIIT Hyderabad（海德拉巴国际信息技术学院KCIS语言技术研究中心）；Suresh Gyan Vihar University（苏雷什·格扬·维哈尔大学）
