Capturing images is a key part of automation for high-level tasks such as scene text recognition. Low-light conditions pose a challenge for high-level perception stacks, which are often optimized on well-lit, artifact-free images. Reconstruction methods for low-light images can produce well-lit counterparts, but typically at the cost of high-frequency details critical for downstream tasks. We propose Diffusion in the Dark (DiD), a diffusion model for low-light image reconstruction for text recognition. DiD provides qualitatively competitive reconstructions with that of state-of-the-art (SOTA), while preserving high-frequency details even in extremely noisy, dark conditions. We demonstrate that DiD, without any task-specific optimization, can outperform SOTA low-light methods in low-light text recognition on real images, bolstering the potential of diffusion models to solve ill-posed inverse problems.
DiffuLT: How to Make Diffusion Model Useful for Long-tail Recognition
State Key Laboratory for Novel Software Technology, Nanjing University(南京大学现代软件技术国家重点实验室);School of Artificial Intelligence, Nanjing University(南京大学人工智能学院)
GenRec: Unifying Video Generation and Recognition with Diffusion Models
Fudan University(复旦大学);University of Maryland(马里兰大学);Shanghai Key Lab of Intell. Info. Processing(上海智能信息处理重点实验室);Shanghai Collaborative Innovation Center of Intelligent Visual Computing(上海智能视觉计算协同创新中心)
本文提出首个基于 Stable Video Diffusion 的统一框架 GenRec,通过随机帧条件化过程联合优化视频生成与识别,在多个数据集上取得优异性能,并在输入信息有限时表现出色。
LLDif: Diffusion Models for Low-light Emotion Recognition
College of Engineering and Computer Science, Australian National University(澳大利亚国立大学工程与计算机科学学院);School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳)计算机科学与技术学院)
CPKD: Clinical Prior Knowledge-Constrained Diffusion Models for Surgical Phase Recognition in Endoscopic Submucosal Dissection
School of Biomedical Engineering(生物医学工程学院);Division of Gastroenterology and Hepatology, Shanghai Institute of Digestive Disease, NHC Key Laboratory of Digestive Diseases, Renji Hospital(消化内科与肝病科、上海消化疾病研究所、国家消化疾病临床医学研究中心、仁济医院);College of Media Engineering(媒体工程学院);Aier Institute of Digital Ophthalmology and Visual Science(数字眼科与视觉科学研究院)
Knowledge-Aligned Counterfactual-Enhancement Diffusion Perception for Unsupervised Cross-Domain Visual Emotion Recognition
The Laboratory of Intelligent Collaborative Computing of UESTC(UESTC智能协同计算实验室);Ubiquitous Intelligence and Trusted Services Key Laboratory of Sichuan Province(四川省 ubiquitous intelligence and trusted services 重点实验室);Faculty of Information Technology, Monash University(墨尔本大学信息技术学院)
Modular Diffusion Models for Structured Visual Recognition
Department of Computer Science, University of British Columbia(不列颠哥伦比亚大学计算机科学系);Vector Institute for AI(向量人工智能研究所);CompVis, Ludwig Maximilian University of Munich(慕尼黑路德维希·马克西米利安大学计算机视觉实验室);Munich Center for Machine Learning(慕尼黑机器学习中心);CIFAR AI Chair(CIFAR人工智能教席)
WordStylist: Styled Verbatim Handwritten Text Generation with Latent Diffusion Models
Luleå University of Technology(吕勒奥理工大学);National Technical University of Athens(雅典国立技术大学);Friedrich-Alexander-Universität(弗里德里希-亚历山大大学);University of West Attica(西阿提卡大学);University of Ioannina(约阿尼纳大学)
Generative Diffusion Priors for 3D Mapping of the Dark Universe
Department of Computing and Mathematical Sciences, California Institute of Technology(加州理工学院计算与数学科学系);Jet Propulsion Laboratory, California Institute of Technology(加州理工学院喷气推进实验室);Department of Physics, Duke University(杜克大学物理系);Cahill Center for Astronomy and Astrophysics, California Institute of Technology(加州理工学院卡希尔天文与天体物理中心)