arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~

OphBiWSSD:利用双向权重共享状态空间对偶性扩展眼科手术中的时间动作定位

OphBiWSSD: Scaling Temporal Action Localization in Ophthalmic Surgeries with Bidirectional Weight-tied State Space Duality

Yang Liu, Qionghong Ma, Joongwon Chae, Lihui Luo, Yibing Shen, Yulin Zhuo, Yingting Zhu, Jiashu Chang, Xiaoyun Zhong, Dongmei Yu, Peter E. Lobie, Peiwu Qin, Chengming Yang

arXiv 2609.12409首次发表:更新:

发表机构

Tsinghua Shenzhen International Graduate School(清华大学深圳国际研究生院)

机构由 AI 辅助整理,请以论文原文为准。

AI 中文总结

针对眼科手术时间动作定位中长程依赖建模的计算瓶颈,提出基于双向状态空间对偶性与权重共享扫描的OphBiWSSD框架,以线性复杂度实现高精度定位,在OphNet上超越基线6.8%和6.66%。

AI 中文摘要

眼科手术中的高频手术操作需要高保真度的时间建模,然而,对于基于注意力的架构而言,刻画长程手术流程依赖关系在计算上仍然难以承受。现有模型通常需要进行激进的时间下采样,这损害了对细粒度动作边界和器械-组织交互的检测。为解决这些可扩展性限制,我们提出了OphBiWSSD,一个利用双向状态空间对偶性重新构建手术时间动作定位的框架。通过采用结合前后手术上下文的权重共享选择性扫描机制,我们的方法以线性复杂度实现了非因果时间线索的全局综合。这种精简架构非常适合捕捉眼科工作流程中存在的双向依赖关系,有效弥合了局部边界精度与长程手术流程上下文之间的差距,而无需承担传统Transformer的二次方内存开销。在OphNet基准上的大量实验表明,OphBiWSSD达到了最先进的时间定位性能,在阶段和操作上的平均精度分别为44.42%和43.08%,分别超过基线6.80%和6.66%。实证验证表明,我们的方法确保了精确的时间定位,并为在临床环境中部署手术智能系统提供了一条计算上可行的途径。代码可在该https URL公开获取。

英文摘要

High-frequency surgical maneuvers in ophthalmology necessitate high-fidelity temporal modeling, yet characterizing long-range procedural dependencies remains computationally prohibitive for attention-based architectures. Existing models often require aggressive temporal downsampling, which compromises the detection of fine-grained action boundaries and instrument-tissue interactions. To address these scalability constraints, we present OphBiWSSD, a framework that reformulates surgical temporal action localization leveraging Bidirectional State Space Duality. By employing a weight-tied selective scan mechanism that incorporates both preceding and succeeding surgical contexts, our approach facilitates the global synthesis of non-causal temporal cues with linear complexity. This streamlined architecture is well-suited to capture the bidirectional dependencies present in ophthalmic workflows, effectively bridging the gap between local boundary precision and long-range procedural context without incurring the quadratic memory overhead of traditional Transformers. Extensive experiments on the OphNet benchmark demonstrate that OphBiWSSD achieves state-of-the-art temporal localization performance, with mean Average Precisions of 44.42% on phases and 43.08% on operations, surpassing the baselines by 6.80% and 6.66%, respectively. Empirical validation indicates that our approach ensures precise temporal localization and offers a computationally viable pathway for deploying surgical intelligence systems in clinical environments. The code is publicly available at https://github.com/yo3nglau/OphBiWSSD.

CommentsSubmitted to IEEE Transactions on Image Processing. Under review

论文原文

arXiv 摘要页 · PDF 原文 · HTML 原文

↑