Activation steering has emerged as a promising alternative for controlling language-model behavior at inference time by modifying intermediate representations while keeping model parameters frozen. However, large-scale evaluations such as AxBench show that existing steering methods are often outperformed by simple in-context prompting and generalize poorly to unseen concepts. We hypothesize that these limitations arise from unvalidated simplifying assumptions shared across prior methods, which typically restrict steering interventions to fixed, single-step, position-invariant transforms. We propose FLAS (Flow-based Activation Steering), which learns a general, concept-conditioned velocity field $v_t(h,t,c)$ that transports unsteered activations to steered ones without relying on these assumptions. On AxBench, FLAS is the first learned method to consistently outperform prompting, reaching held-out harmonic means of $1.015$ on Gemma-2-2B-IT and $1.113$ on Gemma-2-9B-IT without per-concept tuning. Analysis of the learned flow shows curved, multi-step, token-varying trajectories, which suggests that previous hypotheses on activation space geometry might be incomplete.
Where Steering Signals Come From: Activation Source Selection in Activation Steering
Peking University(北京大学);Tsinghua University(清华大学);Beijing Academy of Artificial Intelligence(北京智源人工智能研究院);Tsinghua Shenzhen International Graduate School(清华大学深圳国际研究生院);YiXin-AILab(易信人工智能实验室)
Fine-Grained Activation Steering: Steering Less, Achieving More
School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore(电子与电气工程学院,南洋理工大学,新加坡);Home Team Science and Technology Agency (HTX), Singapore(家庭团队科技局(HTX),新加坡)
Interpretable Steering of Large Language Models with Feature Guided Activation Additions
Raffles Science Institute(莱佛士科学学院);Raffles Institution(莱佛士书院);Nous Research(努斯研究机构);Centre for Frontier AI Research (CFAR)(前沿人工智能研究中心);Agency for Science Technology and Research (A*STAR)(新加坡科技研究局)
Reflection Steering: Disentangling Reflection from Reasoning in Activation Space for Token-Efficient Inference
School of Computing and Data Science, The University of Hong Kong(香港大学计算与数据科学学院);Department of Computing, The Hong Kong Polytechnic University(香港理工大学计算学院);School of Data Science, Lingnan University(岭南大学数据科学学院);Centre for Learning, Teaching and Technology, The Education University of Hong Kong(香港教育大学学习、教学与技术中心)
Language Model Activations Inhabit Privileged Error-Correcting Basins
Goodfire;University of Southern California(南加州大学);Massachusetts Institute of Technology(麻省理工学院);Northeastern University(东北大学);Stanford University(斯坦福大学);Harvard University(哈佛大学)
LF-Steering: Latent Feature Activation Steering for Enhancing Semantic Consistency in Large Language Models
College of Intelligence and Computing, Tianjin University(天津大学智能与计算学部);IT Innovation and Research Center, Huawei Technologies(华为技术有限公司 IT 创新研究中心);Informatics, University of Edinburgh(爱丁堡大学信息学院)
From Weights to Activations: Is Steering the Next Frontier of Adaptation?
Saarland University(萨尔兰大学);German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心);Centre for European Research in Trusted AI (CERTAIN)(可信AI欧洲研究中心);Munich Center for Machine Learning(慕尼黑机器学习中心);Fraunhofer Heinrich Hertz Institute(弗劳恩霍夫海因里希·赫兹研究所);Technological University Dublin(都柏林技术大学);Technische Universität Berlin(柏林技术大学);Berlin Institute for the Foundations of Learning and Data (BIFOLD)(柏林学习与数据基础研究所)
Enhancing Cross-task Transfer of Large Language Models via Activation Steering
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学耿丽人工智能学院);Department of Computer Science, National University of Singapore(新加坡国立大学计算机科学系);Ant Group(蚂蚁集团)