Purpose: Curating large-scale datasets of operating room (OR) workflow, encompassing rare, safety-critical, or atypical events, remains operationally and ethically challenging. This data bottleneck complicates the development of ambient intelligence for detecting, understanding, and mitigating rare or safety-critical events in the OR.
Methods: This work presents an OR video diffusion framework that enables controlled synthesis of rare and safety-critical events. The framework integrates a geometric abstraction module, a conditioning module, and a fine-tuned diffusion model to first transform OR scenes into abstract geometric representations, then condition the synthesis process, and finally generate realistic OR event videos. Using this framework, we also curate a synthetic dataset to train and validate AI models for detecting near-misses of sterile-field violations.
Results: In synthesizing routine OR events, our method outperforms off-the-shelf video diffusion baselines, achieving lower FVD/LPIPS and higher SSIM/PSNR in both in- and out-of-domain datasets. Through qualitative results, we illustrate its ability for controlled video synthesis of counterfactual events. An AI model trained and validated on the generated synthetic data achieved a RECALL of 70.13% in detecting near safety-critical events. Finally, we conduct an ablation study to quantify performance gains from key design choices.
Conclusion: Our solution enables controlled synthesis of routine and rare OR events from abstract geometric representations. Beyond demonstrating its capability to generate rare and safety-critical scenarios, we show its potential to support the development of ambient intelligence models.
SALIENT: Frequency-Aware Paired Diffusion for Controllable Long-Tail CT Detection
Trauma Radiology AI Laboratory (TRAIL)(创伤放射AI实验室);Department of Radiology and Nuclear Medicine(放射科与核医学科);University of Maryland School of Medicine(马里兰大学医学院)
H-LDM: Hierarchical Latent Diffusion Models for Controllable and Interpretable PCG Synthesis from Clinical Metadata
School of Cyber Engineering Xidian University Xi'an, China(电子科技大学信息工程学院西安中国);School of Telecommunications Engineering Xidian University Xi'an, China(电子科技大学电信工程学院西安中国)
LD-Scene: LLM-Guided Diffusion for Controllable Generation of Adversarial Safety-Critical Driving Scenarios
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));School of Computer Science and Engineering, Sun Yat-sen University(中山大学计算机科学与工程学院)
Gumbel-Softmax Flow Matching with Straight-Through Guidance for Controllable Biological Sequence Generation
Duke University(杜克大学);University of Pennsylvania(宾夕法尼亚大学);Duke-NUS Medical School(杜克-新加坡国立大学医学院);Mila, Quebec AI Institute(米拉魁北克人工智能研究所);Université de Montréal(蒙特利尔大学)
CoCo: Code as CoT for Text-to-Image Preview and Rare Concept Generation
South China University of Technology(南方科技大学);StepFun;Institute of Automation Chinese Academy of Sciences(中国科学院自动化研究所);Nanyang Technological University(南洋理工大学);The Chinese University of Hong Kong(香港中文大学)
One-shot synthesis of rare gastrointestinal lesions improves diagnostic accuracy and clinical training
Zhejiang University(浙江大学);Shanghai Institute for Advanced Study of Zhejiang University(浙江大学上海研究院);Digital Medical Research Center, School of Basic Medical Sciences, Fudan University(复旦大学基础医学部数字医学研究中心);Shanghai Collaborative Innovation Center of Endoscopy(上海内镜协同创新中心);Alliance Manchester Business School, The University of Manchester(曼彻斯特大学曼彻斯特商学院);Data Science Institute, Imperial College London(伦敦帝国理工学院数据科学学院)
VitaminP: cross-modal learning enables whole-cell segmentation from routine histology
Department of Translational Molecular Pathology, Division of Pathology and Laboratory Medicine, The University of Texas MD Anderson Cancer Center(转化分子病理学部门,病理与实验室医学分会,德克萨斯大学MD安德森癌症中心);Institute for Data Science in Oncology, The University of Texas MD Anderson Cancer Center(肿瘤数据科学研究所,德克萨斯大学MD安德森癌症中心);The University of Texas MD Anderson Cancer Center(德克萨斯大学MD安德森癌症中心)
RealisDance-DiT: Simple yet Strong Baseline towards Controllable Character Animation in the Wild
DAMO Academy, Alibaba Group(达摩院,阿里巴巴集团);Zhejiang University(浙江大学);Hupan Lab(虎斑实验室);Southern University of Science and Technology(南方科技大学);Shenzhen University(深圳大学)
Controllable Diffusion-Based Lesion Inpainting for Scalable Histopathology Data Augmentation
Department of Diagnostic Radiology, Li Ka Shing Faculty of Medicine, The University of Hong Kong(香港大学李嘉诚医学院诊断放射学系);Department of Pathology, Li Ka Shing Faculty of Medicine, The University of Hong Kong(香港大学李嘉诚医学院病理学系);Department of Anatomical and Cellular Pathology, Prince of Wales Hospital, The Chinese University of Hong Kong(香港中文大学威尔斯亲王医院解剖及细胞病理学系);Department of Infectious Diseases and Public Health, Jockey Club College of Veterinary Medicine and Life Sciences, City University of Hong Kong(香港城市大学赛马会动物医学及生命科学院传染病及公共卫生学系);CityU Veterinary Diagnostic Laboratory Co., Ltd., City University of Hong Kong(香港城市大学城市大学兽医诊断实验室有限公司)