Northeastern University(东北大学);Washington University in St. Louis(圣路易斯华盛顿大学);Nanjing University of Aeronautics and Astronautics(南京航空航天大学);Tsinghua University(清华大学);Security Capability Center(360安全能力中心);Tencent(腾讯);Beijing University of Posts and Telecommunications(北京邮电大学)
Effectively eliciting the capabilities of large language models (LLMs) at inference time remains an important challenge. Existing studies address this challenge through context engineering, which shapes user queries, or fixed steering, which directly intervenes in model computation. However, predefined contexts and fixed intervention strategies may not adequately accommodate the diverse knowledge and reasoning requirements of individual queries. This raises a natural question: Can internal steering in LLMs be made query-adaptive? In this work, we investigate whether query-induced internal activations can guide adaptive steering in LLMs. Our pilot studies reveal subject- and layer-dependent neuron activation patterns and show that amplifying subject-relevant neurons can improve model performance. Based on these findings, we propose Q-NeuS, a query-adaptive neuron steering framework that dynamically determines which neurons to modulate and by how much for each input. Specifically, Q-NeuS constructs a compact subject-guided candidate neuron space and employs a lightweight Query-Adaptive Gate to generate neuron-wise modulation coefficients. To learn effective intervention strategies, we introduce Neu-GRPO, which adapts group-relative optimization to train the Query-Adaptive Gate using the relative performance of multiple neuron intervention configurations. The base LLM remains frozen throughout training and inference, and no task or subject labels are required at inference time. Extensive experiments across multiple LLMs and benchmarks demonstrate that Q-NeuS consistently improves model performance and exhibits broad applicability across model scales and strong cross-benchmark transferability.
Are Emotion and Rhetoric Neurons in LLM? Neuron Recognition and Adaptive Masking for Emotion-Rhetoric Prediction Steering
Key Laboratory of Aerospace Information Security and Trusted Computing, Ministry of Education, School of Cyber Science and Engineering, Wuhan University(航空信息安全与可信计算 key laboratory,教育部,武汉大学计算机科学与工程学院)
Style-Specific Neurons for Steering LLMs in Text Style Transfer
School of Computation, Information and Technology, Technical University of Munich(慕尼黑工业大学计算、信息与技术学院);Munich Center for Machine Learning(慕尼黑机器学习中心);Center for Information and Language Processing, LMU Munich(慕尼黑大学信息与语言处理中心)
Can Dialects Be Steered Like Languages? Sparse Neurons and Distributed Directions in Arabic LLMs
Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);Qatar Computing Research Institute, Hamad Bin Khalifa University(哈马德·本·哈利法大学卡塔尔计算研究所);Tohoku University(东北大学);RIKEN(理化学研究所)
ACE: Attribution-Controlled Knowledge Editing for Multi-hop Factual Recall
HKUST(GZ) Deep Interdisciplinary Intelligence Lab(香港科技大学(广州)深 interdisciplinary 智能实验室);BUAA(北京航空航天大学);HKUST(GZ) Institute of Deep Perception Technology, JITRI Deep Interdisciplinary Intelligence Lab(香港科技大学(广州)深度感知技术研究所,JITRI 深 interdisciplinary 智能实验室)
DPN-LE: Dual Personality Neuron Localization and Editing for Large Language Models
Southeast University(东南大学);Shanghai Jiao Tong University(上海交通大学);East China Normal University(华东师范大学);Zhongguancun Academy(中关村学院);Zhejiang University of Technology(浙江工业大学);Kuaishou Technology(快手科技);Northeastern University(东北大学);Tsinghua University(清华大学);Nanjing University of Aeronautics and Astronautics(南京航空航天大学)
A Systematic Analysis of the Impact of Persona Steering on LLM Capabilities
School of Computer Science and Engineering, Northeastern University, Shenyang 110819, China(东北大学计算机科学与工程学院,沈阳 110819,中国);School of Computing and Information Systems, Singapore Management University, Singapore 178902, Singapore(新加坡管理大学计算机与信息系统学院,新加坡 178902,新加坡);School of Computer and Communication Engineering, Northeastern University, Qinhuangdao 066004, China(东北大学计算机与通信工程学院,秦皇岛 066004,中国)
Knowledge Localization: Mission Not Accomplished? Enter Query Localization!
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
Controllable Value Alignment in Large Language Models through Neuron-Level Editing
National University of Singapore(新加坡国立大学);Hefei University of Technology(合肥工业大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);ST Engineering Ltd.(ST工程有限公司)