We introduce a new generator architecture, aimed at fast and efficient high-resolution image-to-image translation. We design the generator to be an extremely lightweight function of the full-resolution image. In fact, we use pixel-wise networks; that is, each pixel is processed independently of others, through a composition of simple affine transformations and nonlinearities. We take three important steps to equip such a seemingly simple function with adequate expressivity. First, the parameters of the pixel-wise networks are spatially varying so they can represent a broader function class than simple 1x1 convolutions. Second, these parameters are predicted by a fast convolutional network that processes an aggressively low-resolution representation of the input; Third, we augment the input image with a sinusoidal encoding of spatial coordinates, which provides an effective inductive bias for generating realistic novel high-frequency image content. As a result, our model is up to 18x faster than state-of-the-art baselines. We achieve this speedup while generating comparable visual quality across different image resolutions and translation domains.
Discrete Diffusion Bridges for Spatiotemporally Aligned Image Translation and Generation
Shenyang Institute of Automation, Chinese Academy of Sciences(中国科学院沈阳自动化研究所);University of Chinese Academy of Sciences(中国科学院大学);The University of Hong Kong(香港大学);School of Computing and Data Science, The University of Hong Kong(香港大学计算与数据科学学院)
Adaptive Domain Shift in Diffusion Models for Cross-Modality Image Translation
Laplace Lab at University of Tennessee(田纳西大学Laplace实验室);University of California Riverside(加州大学河滨分校);University of Tennessee at Chattanooga(田纳西大学查塔努加分校)
Plasticine: A Traceable Diffusion Model for Medical Image Translation
Department of Computer Science, University of Birmingham(计算机科学系,伯明翰大学);Institute for Infocomm Research, A*STAR(信息与通信研究所,A*STAR);Imperial College London(伦敦帝国学院);Department of Eye and Vision Science, University of Liverpool(眼科与视觉科学系,利物浦大学);Institute of High Performance Computing, A*STAR(高性能计算研究所,A*STAR);Department of Computer Science, and the Division of Informatics, Imaging and Data Sciences, School of Health Sciences, The University of Manchester(计算机科学系,信息、成像与数据科学分会,健康科学学院,曼彻斯特大学);Southern University of Science and Technology(南方科技大学);University of Birmingham(伯明翰大学);University of Manchester(曼彻斯特大学)
Style Intervention: How to Achieve Spatial Disentanglement with Style-based Generators?
Center for Research on Intelligent Perception and Computing, CASIA(中国科学院自动化研究所智能感知与计算研究中心);National Laboratory of Pattern Recognition, CASIA(中国科学院自动化研究所模式识别国家重点实验室);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
Frequency Routing and Identity Conditioning for Thermal-to-Visible Face Translation
Monash University, Monash Suzhou Research Institute(莫纳什大学、莫纳什大学苏州研究院);Southeast University, School of Computer Science and Engineering(东南大学计算机科学与工程学院);Monash University, Faculty of Information Technology(莫纳什大学信息技术学院)
Spatially Covariant Image Registration with Text Prompts
College of Electrical and Information Engineering, Hunan University(湖南大学电气与信息工程学院);Cornell University(康奈尔大学);University of Pennsylvania(宾夕法尼亚大学);New York University(纽约大学);Shanghai Jiao Tong University(上海交通大学)
Inter-vendor harmonization of Computed Tomography (CT) reconstruction kernels using unpaired image translation
Vanderbilt University(范德堡大学);Vanderbilt University Medical Center(范德堡大学医学中心);Amsterdam University Medical Center(阿姆斯特丹大学医学中心);University of Amsterdam(阿姆斯特丹大学)
Region of Interest focused MRI to Synthetic CT Translation using Regression and Classification Multi-task Network
GE Healthcare(通用电气医疗集团);Umeå University(于默奥大学);Erasmus MC Cancer Institute(伊拉斯谟医学中心癌症研究所);Newcastle University(纽卡斯尔大学);Newcastle upon Tyne Hospitals NHS Foundation Trust(泰恩河畔纽卡斯尔NHS基金会信托);Technical University of Munich(慕尼黑工业大学);Sree Chitra Tirunal Institute of Medical Sciences and Technology(斯里奇特拉蒂鲁纳尔医学科学与技术研究所);University of Zurich(苏黎世大学)
ContourDiff: Unpaired Medical Image Translation with Structural Consistency
Department of Electrical and Computer Engineering, Duke University(杜克大学电气与计算机工程系);Department of Biostatistics & Bioinformatics, Duke University(杜克大学生物统计学与生物信息学系);Department of Radiology, Duke University(杜克大学放射学系);Department of Computer Science, Duke University(杜克大学计算机科学系)