Large language models (LLMs) increasingly rely on external knowledge to improve factuality, yet many knowledge sources on the Web, such as scholarly indexes and product catalogs, are organized as heterogeneous graphs. Reasoning over such graph-structured knowledge poses two key challenges: (1) navigating structured, schema-defined relations requires precise function calls beyond similarity-based retrieval, and (2) answering complex questions often demands multi-hop evidence aggregation through iterative information seeking. We study how LLMs can learn these interaction capabilities and transfer them to unseen domains. We propose GraphDancer, a reinforcement learning (RL) framework that teaches LLMs to navigate graphs by interleaving reasoning and function execution. To improve RL for moderate-sized LLMs, we introduce a graph-aware curriculum that schedules training by the structural difficulty of questions using an easy-to-hard biased sampler. We evaluate GraphDancer on the multi-domain GRBench benchmark, training only on Academic and Biomedical graphs. Testing covers held-out questions from these domains as well as unseen E-commerce, Literature, and Legal graphs. With either Qwen2.5-3B-Instruct or Qwen3-14B as the backbone, GraphDancer outperforms graph-agent baselines using the same backbone across all evaluation domains. These results indicate that the learned graph exploration and reasoning capabilities transfer across domains. On average across unseen domains, GraphDancer with a 14B backbone also outperforms baselines powered by the closed-source models GPT-4.1-mini and GPT-5-nano. Trajectory analyses further show that GraphDancer retrieves answer-bearing evidence more often and achieves higher accuracy when such evidence is found, while substantially reducing invalid-protocol outcomes.
Train Long, Think Short: Curriculum Learning for Efficient Reasoning
King Abdullah University of Science and Technology (KAUST), Saudi Arabia(卡布尔大学科学与技术大学);Massachusetts Institute of Technology (MIT), Cambridge, MA, USA(麻省理工学院);Princeton University, Princeton, NJ, USA(普林斯顿大学)
Training Large Language Models for Reasoning through Reverse Curriculum Reinforcement Learning
School of Computer Science, Fudan University(复旦大学计算机科学学院);ByteDance Research(字节跳动研究部);Institute of Modern Languages and Linguistics, Fudan University(复旦大学现代语言与语言学研究所)
TACLer: Tailored Curriculum Reinforcement Learning for Efficient Reasoning
Department of XXX, University of YYY, Location, Country(XXX系,YYY大学,地点,国家);School of ZZZ, Institute of WWW, Location, Country(ZZZ学院,WWW研究所,地点,国家);Center for Language and Cognition (CLCG), University of Groningen, The Netherlands(语言与认知中心(CLCG),格罗宁根大学,荷兰)
Infi-MMR: Curriculum-based Unlocking Multimodal Reasoning via Phased Reinforcement Learning in Multimodal Small Language Models
The Hong Kong Polytechnic University(香港理工大学);Zhejiang University(浙江大学);University of Electronic Science and Technology of China(电子科技大学);Reallm Labs(Reallm 实验室);Amazon(亚马逊);The Hong Kong University of Science and Technology(香港理工大学)
RuCL: Stratified Rubric-Based Curriculum Learning for Multimodal Large Language Model Reasoning
Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);University of Chinese Academy of Sciences(中国科学院大学);Alibaba Group(阿里巴巴集团);School of Biomedical Engineering, UNSW Sydney(新南威尔士大学生物医学工程学院)
Transferability for General Reasoning: An Automated Curriculum for Multi-Domain RLVR
Jinesis Lab, University of Toronto & Vector Institute(Jinesis实验室,多伦多大学与向量研究所);Carnegie Mellon University(卡内基梅隆大学);Princeton University(普林斯顿大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);ELLIS Institute Tübingen(ELLIS研究所图宾根);Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所);EuroSafeAI
Tailored Teaching with Balanced Difficulty: Elevating Reasoning in Multimodal Chain-of-Thought via Prompt Curriculum
Nanjing University of Aeronautics and Astronautics(南京航空航天大学);Hunan Vanguard Group Corporation Co., Ltd.(湖南 Vanguard集团有限公司);Huaneng Information Technology Co., Ltd.(华能信息技术有限公司);Tsinghua University(清华大学);Zhejiang University(浙江大学);PowerChina Huadong Engineering Co., Ltd.(中国电建华东工程有限公司)
Seoul National University(首尔国立大学);Automation and Systems Research Institute(自动化与系统研究所);Artificial Intelligence Institute of Seoul National University(首尔国立大学人工智能研究所)
Actor-Curator: Co-adaptive Curriculum Learning via Policy-Improvement Bandits for RL Post-Training
University of Illinois Chicago(伊利诺伊大学香槟分校);Caltech(加州理工学院);RPI(罗切斯特理工学院);MBZUAI(澳门大学人工智能研究院);University of Chicago(芝加哥大学);NEC Laboratories America(NEC美国实验室)