Classifier-guided diffusion models have emerged as a powerful approach for conditional image generation, but they suffer from overconfident predictions during early denoising steps, causing the guidance gradient to vanish. This paper introduces two complementary contributions to address this issue. First, we propose a differentiable calibration objective based on the Smooth Expected Calibration Error (Smooth ECE), which improves classifier calibration with minimal fine-tuning and yields measurable improvements in Frechet Inception Distance (FID). Second, we develop enhanced sampling guidance methods that operate on off-the-shelf classifiers without requiring retraining. These include tilted sampling with batch-level reweighting, adaptive entropy-regularized sampling to preserve diversity, and a novel f-divergence-based sampling strategy that strengthens class-consistent guidance while maintaining mode coverage. Experiments on ImageNet 128x128 demonstrate that our divergence-regularized guidance achieves an FID of 2.13 using a ResNet-101 classifier, improving upon existing classifier-guided diffusion methods while requiring no diffusion model retraining. The results show that principled calibration and divergence-aware sampling provide practical and effective improvements for classifier-guided diffusion.
Guidance Matters: Rethinking the Evaluation Pitfall for Text-to-Image Generation
The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州));Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳));Cogniser Information Technology(Cogniser信息科技)
Camera calibration plays a critical role in various computer vision tasks such as autonomous driving or augmented reality. Widely used camera calibration tools utilize plane pattern based methodology, such as using a chessboard or AprilTag board, user's calibration expertise level significantly affects calibration accuracy and consistency when without clear instruction. Furthermore, calibration is a recurring task that has to be performed each time the camera is changed or moved. It's also a great burden to calibrate huge amounts of cameras such as Driver Monitoring System (DMS) cameras in a p…
Chalmers University of Technology and University of Gothenburg, Dept. Computer Science and Engineering(查尔姆斯理工大学和哥德堡大学,计算机科学与工程系);Massachusetts Institute of Technology, Research Laboratory of Electronics(麻省理工学院,电子研究实验室);Technical University of Munich(慕尼黑技术大学);Helmholtz AI, Munich(海德堡人工智能研究所,慕尼黑);Max Planck Institute for Intelligent Systems, Tübingen(马克斯·普朗克智能系统研究所,图宾根)
ETH Zurich(苏黎世联邦理工学院);INRIA Grenoble – Rhône-Alpes(法国国立信息学与自动化研究院格勒诺布尔-罗讷-阿尔卑斯分院)
It is well known that the accuracy of a calibration depends strongly on the choice of camera poses from which images of a calibration object are acquired. We present a system -- Calibration Wizard -- that interactively guides a user towards taking optimal calibration images. For each new image to be taken, the system computes, from all previously acquired images, the pose that leads to the globally maximum reduction of expected uncertainty on intrinsic parameters and then guides the user towards that pose. We also show how to incorporate uncertainty in corner point position in a novel principl…
Regularization by denoising (RED) is a broadly applicable framework for solving inverse problems by using priors specified as denoisers. While RED has been shown to provide state-of-the-art performance in a number of applications, existing RED algorithms require exact knowledge of the measurement operator characterizing the imaging system, limiting their applicability in problems where the measurement operator has parametric uncertainties. We propose a new method, called Calibrated RED (Cal-RED), that enables joint calibration of the measurement operator along with reconstruction of the unknow…
Deep neural networks have been shown to be highly miscalibrated. often they tend to be overconfident in their predictions. It poses a significant challenge for safety-critical systems to utilise deep neural networks (DNNs), reliably. Many recently proposed approaches to mitigate this have demonstrated substantial progress in improving DNN calibration. However, they hardly touch upon refinement, which historically has been an essential aspect of calibration. Refinement indicates separability of a network's correct and incorrect predictions. This paper presents a theoretically and empirically su…
Optimal Pose Guidance for Stereo Calibration in 3D Deformation Measurement
College of Aerospace Science and Engineering(航空航天科学与工程学院);National University of Defense Technology(国防科技大学);Hunan Provincial Key Laboratory of Image Measurement and Vision Navigation(湖南省图像测量与视觉导航重点实验室);Hypersonic Technology Laboratory(高超声速技术实验室);Hunan Key Laboratory of Intelligent Planning and Simulation for Aerospace Missions(湖南省航空航天任务智能规划与模拟重点实验室)
Representation Calibration and Uncertainty Guidance for Class-Incremental Learning based on Vision Language Model
Guangdong Province Key Laboratory of Machine Intelligence and Advanced Computing, Ministry of Education(广东省机器智能与先进计算重点实验室);Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州));Peng Cheng Laboratory(鹏城实验室);Key Laboratory of Machine Intelligence and Advanced Computing, Ministry of Education(广东省机器智能与先进计算重点实验室)
Nanjing University of Aeronautics and Astronautics(南京航空航天大学);Nanjing University of Science and Technology(南京理工大学);University of Leicester(莱斯特大学)
Object detection is one of the most fundamental yet challenging research topics in the domain of computer vision. Recently, the study on this topic in aerial images has made tremendous progress. However, complex background and worse imaging quality are obvious problems in aerial object detection. Most state-of-the-art approaches tend to develop elaborate attention mechanisms for the space-time feature calibrations with arduous computational complexity, while surprisingly ignoring the importance of feature calibrations in channel-wise. In this work, we propose a simple yet effective Calibrated-…
School of Mathematics and Statistics, Changsha University of Science and Technology(数学与统计学学院,长沙理工大学);School of Biomedical Engineering, Shanghai Jiao Tong University(生物医学工程学院,上海交通大学);Shanghai Chest Hospital, Shanghai Jiao Tong University School of Medicine(上海胸科医院,上海交通大学医学院)
DOMINO++: Domain-aware Loss Regularization for Deep Learning Generalizability
University of Florida (UF)(佛罗里达大学);Torch Technologies, LLC(Torch科技有限责任公司);McKnight Brain Institute(麦克奈特脑研究所);College of Public Health and Health Professions(公共卫生与健康职业学院);College of Medicine(医学院);United States Air Force Research Laboratory(美国空军研究实验室);Herbert Wertheim College of Engineering(赫伯特·韦特海姆工程学院);Department of Biomedical Engineering(生物医学工程系);Department of Clinical and Health Psychology(临床与健康心理学系);Department of Neuroscience(神经科学系);Department of Electrical and Computer Engineering(电气与计算机工程系);Department of Computer Information and Science and Engineering(计算机信息与工程系)
Physical Adversarial Camouflage through Gradient Calibration and Regularization
School of Cyber Science and Technology, Sun Yat-sen University Shenzhen Campus(中山大学计算机科学与技术学院深圳校区);Peng Cheng Laboratory(鹏城实验室);Nanyang Technological University(南洋理工大学);National Key Laboratory of Science and Technology on Information System Security(信息系统安全国家重点实验室)
Faculty of Mathematics and Informatics, Babeș-Bolyai University of Cluj-Napoca(巴比什-波雅依大学数学与信息学院);Robert Bosch SRL(罗伯特·博世有限责任公司)
Most distortion correction methods focus on simple forms of distortion, such as radial or linear distortions. These works undistort images either based on measurements in the presence of a calibration grid, or use multiple views to find point correspondences and predict distortion parameters. When possible distortions are more complex, e.g. in the case of a camera being placed behind a refractive surface such as glass, the standard method is to use a calibration grid. Considering a high variety of distortions, it is nonviable to conduct these measurements. In this work, we present a single vie…