We introduce a novel cross-reference image quality assessment method that effectively fills the gap in the image assessment landscape, complementing the array of established evaluation schemes -- ranging from full-reference metrics like SSIM, no-reference metrics such as NIQE, to general-reference metrics including FID, and Multi-modal-reference metrics, e.g., CLIPScore. Utilising a neural network with the cross-attention mechanism and a unique data collection pipeline from NVS optimisation, our method enables accurate image quality assessment without requiring ground truth references. By comparing a query image against multiple views of the same scene, our method addresses the limitations of existing metrics in novel view synthesis (NVS) and similar tasks where direct reference images are unavailable. Experimental results show that our method is closely correlated to the full-reference metric SSIM, while not requiring ground truth references.
Tool-IQA: Augmenting Image Quality Assessment with Simple Tools
National University of Singapore（新加坡国立大学）；OPPO Research Institute（OPPO研究院）；Nanyang Technical University（南洋理工大学）；Duke University（杜克大学）；City University of Hong Kong（香港城市大学）；The Hong Kong Polytechnic University（香港理工大学）
Hierarchical Scoring with 3D Gaussian Splatting for Instance Image-Goal Navigation
NYUAD Center for Artificial Intelligence and Robotics (CAIR)（纽约大学阿布扎比分校人工智能与机器人中心）；New York University Abu Dhabi（纽约大学阿布扎比分校）；New York University（纽约大学）；Embodied AI and Robotics (AIR) Lab（具身人工智能与机器人实验室）；School of Software, Tsinghua University（清华大学软件学院）
Mohamed bin Zayed University of Artificial Intelligence（穆罕默德·本·扎耶德人工智能大学）
To assess fetal health during pregnancy, doctors use the gestational age (GA) calculation based on the Crown Rump Length (CRL) measurement in order to check for fetal size and growth trajectory. However, GA estimation based on CRL, requires proper positioning of calipers on the fetal crown and rump view, which is not always an easy plane to find, especially for an inexperienced sonographer. Finding a slightly oblique view from the true CRL view could lead to a different CRL value and therefore incorrect estimation of GA. This study presents an AI-based method for a quality assessment of the CR…
PAII Inc.（PAII 公司）；Chang Gung Memorial Hospital, Linkou Medical Center（长庚纪念医院林口医学中心）；Institute of Molecular and Genomic Medicine, National Health Research Institutes（国家卫生研究院分子与基因组医学研究所）；Ping An Insurance Group（平安保险集团）
Background & Aims: Hepatic steatosis is a major cause of chronic liver disease. 2D ultrasound is the most widely used non-invasive tool for screening and monitoring, but associated diagnoses are highly subjective. We developed a scalable deep learning (DL) algorithm for quantitative scoring of liver steatosis from 2D ultrasound images. Approach & Results: Using retrospectively collected multi-view ultrasound data from 3,310 patients, 19,513 studies, and 228,075 images, we trained a DL algorithm to diagnose steatosis stages (healthy, mild, moderate, or severe) from ultrasound diagnoses. Perform…
Efficient Cross-Country Data Acquisition Strategy for ADAS via Street-View Imagery
CARIAD SE；Karlsruhe Institute of Technology（卡尔斯鲁厄理工学院）；Esslingen University of Applied Sciences（埃森哲应用科学大学）；FZI Research Center for Information Technology（弗劳恩霍夫信息技术研究中心）
Breast cancer is the most common cancer among women worldwide. The human epidermal growth factor receptor 2 (HER2) with immunohistochemical (IHC) is widely used for pathological evaluation to provide the appropriate therapy for patients with breast cancer. However, the deficiency of pathologists and subjective and susceptible to inter-observer variation of visual diagnosis are the main challenges. Recently, with the rapid development of artificial intelligence (AI) in disease diagnosis, several automated HER2 scoring methods using traditional computer vision or machine learning methods indicat…
University of Illinois at Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）
Behavioral scoring of research data is crucial for extracting domain-specific metrics but is bottlenecked on the ability to analyze enormous volumes of information using human labor. Deep learning is widely viewed as a key advancement to relieve this bottleneck. We identify one such domain, where deep learning can be leveraged to alleviate the process of manual scoring. Novelty preference paradigms have been widely used to study recognition memory in pigs, but analysis of these videos requires human intervention. We introduce a subset of such videos in the form of the 'Pig Novelty Preference B…
University of Biskra（比斯克拉大学）；Univ. Polytechnique Hauts-de-France（上法兰西理工大学）；University of Oulu（奥卢大学）
Automatic kinship verification from facial images is an emerging research topic in machine learning community. In this paper, we proposed an effective facial features extraction model based on multi-view deep features. Thus, we used four pre-trained deep learning models using eight features layers (FC6 and FC7 layers of each VGG-F, VGG-M, VGG-S and VGG-Face models) to train the proposed Multilinear Side-Information based Discriminant Analysis integrating Within Class Covariance Normalization (MSIDA+WCCN) method. Furthermore, we show that how can metric learning methods based on WCCN method int…
We present 3DiM, a diffusion model for 3D novel view synthesis, which is able to translate a single input view into consistent and sharp completions across many views. The core component of 3DiM is a pose-conditional image-to-image diffusion model, which takes a source view and its pose as inputs, and generates a novel view for a target pose as output. 3DiM can generate multiple views that are 3D consistent using a novel technique called stochastic conditioning. The output views are generated autoregressively, and during the generation of each novel view, one selects a random conditioning view…
Automated HER2 Scoring in Breast Cancer Images Using Deep Learning and Pyramid Sampling
University of California, Los Angeles（加州大学洛杉矶分校）；California NanoSystems Institute（加州纳米系统研究所）；University of California at Davis（加州大学戴维斯分校）；Bnai-Zion Medical Center（贝内锡安医疗中心）；Hadassah Hebrew University Medical Center（哈达萨希伯来大学医疗中心）；David Geffen School of Medicine, University of California, Los Angeles（加州大学洛杉矶分校大卫·格芬医学院）
SplatPose: Geometry-Aware 6-DoF Pose Estimation from Single RGB Image via 3D Gaussian Splatting
Harbin Institute of Technology（哈尔滨工业大学）；Zhengzhou Research Institute, Harbin Institute of Technology（哈尔滨工业大学郑州研究院）；School of Information Science and Technology, Harbin Institute of Technology (Shen Zhen)（哈尔滨工业大学（深圳）信息科学与技术学院）；Jianghuai Advance Technology Center（江淮先进技术中心）
