arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2510.26243cs.LGcs.AI
收藏

Angular Steering:通过激活空间中的旋转进行行为控制

Angular Steering: Behavior Control via Rotation in Activation Space

Torilab;Department of Mathematics National University of Singapore(数学系,新加坡国立大学)

Hieu M. Vu, Tan M. Nguyen

摘要:

控制大语言模型中的特定行为,同时保留其一般功能是安全可靠的人工智能部署的核心挑战。目前的转向方法,如矢量加法和定向消融,被约束在由激活和特征方向定义的二维子空间内,使它们对所选参数敏感,并由于激活空间中的非预期相互作用而可能影响不相关的特征。我们介绍了角度转向,一种新颖而灵活的行为调制方法,通过在一个固定的二维子空间内旋转激活操作。通过将转向表述为朝向或远离目标行为方向的几何旋转,角度转向提供了对拒绝和顺从等行为的连续、细粒度控制。我们演示了这种方法使用拒绝转向情感转向作为用例。此外,我们提出了自适应角度转向,这是一种选择性变体,仅旋转与目标特征对齐的激活,进一步增强了稳定性和一致性。角度转向在统一的几何旋转框架下推广了现有的加法和正交化技术,简化了参数选择,并在更广泛的调整范围内保持模型稳定性。跨多个模型系列和大小的实验表明,Angular Steering实现了鲁棒的行为控制,同时保持了一般的语言建模性能,与以前的方法相比,强调了其灵活性,通用性和鲁棒性。代码和工件可在https://github.com/lone17/angular-steering/上获得。

英文摘要:

Controlling specific behaviors in large language models while preserving their general capabilities is a central challenge for safe and reliable artificial intelligence deployment. Current steering methods, such as vector addition and directional ablation, are constrained within a two-dimensional subspace defined by the activation and feature direction, making them sensitive to chosen parameters and potentially affecting unrelated features due to unintended interactions in activation space. We introduce Angular Steering, a novel and flexible method for behavior modulation that operates by rotating activations within a fixed two-dimensional subspace. By formulating steering as a geometric rotation toward or away from a target behavior direction, Angular Steering provides continuous, fine-grained control over behaviors such as refusal and compliance. We demonstrate this method using refusal steering emotion steering as use cases. Additionally, we propose Adaptive Angular Steering, a selective variant that rotates only activations aligned with the target feature, further enhancing stability and coherence. Angular Steering generalizes existing addition and orthogonalization techniques under a unified geometric rotation framework, simplifying parameter selection and maintaining model stability across a broader range of adjustments. Experiments across multiple model families and sizes show that Angular Steering achieves robust behavioral control while maintaining general language modeling performance, underscoring its flexibility, generalization, and robustness compared to prior approaches. Code and artifacts are available at https://github.com/lone17/angular-steering/.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑