Data augmentation is crucial in training deep models, preventing them from overfitting to limited data. Recent advances in generative AI, e.g., diffusion models, have enabled more sophisticated augmentation techniques that produce data resembling natural images. We introduce GeNIe a novel augmentation method which leverages a latent diffusion model conditioned on a text prompt to combine two contrasting data points (an image from the source category and a text prompt from the target category) to generate challenging augmentations. To achieve this, we adjust the noise level (equivalently, number of diffusion iterations) to ensure the generated image retains low-level and background features from the source image while representing the target category, resulting in a hard negative sample for the source category. We further automate and enhance GeNIe by adaptively adjusting the noise level selection on a per image basis (coined as GeNIe-Ada), leading to further performance improvements. Our extensive experiments, in both few-shot and long-tail distribution settings, demonstrate the effectiveness of our novel augmentation method and its superior performance over the prior art. Our code is available at: https://github.com/UCDvision/GeNIe
Physics-inspired Generative AI models via real hardware-based noisy quantum diffusion
Department of Physics and Astronomy(物理与天文学系);University of Florence(佛罗伦萨大学);LENS - European Laboratory for Non-Linear Spectroscopy(欧洲非线性光谱实验室);Department of Engineering(工程系);University Pompeu Fabra(庞培法布拉大学)
Image Synthesis Using Spintronic Deep Convolutional Generative Adversarial Network
Department of Electrical Engineering, IIT Bombay(印度比哈尔理工学院电气工程系);Department of Electrical Engineering, IIT Ropar(印度罗帕尔理工学院电气工程系);School of Computing and Electrical Engineering (SCEE), IIT Mandi(印度曼迪理工学院计算与电气工程学院)
Hard to See, Hard to Label: Generative and Symbolic Acquisition for Subtle Visual Phenomena
University of South Carolina(南卡罗来纳大学);AI Research Lab, HPE Labs, Hewlett Packard Enterprise(HPE实验室人工智能研究部);Indian AI Research Organization(印度人工智能研究组织);General Atomics(通用原子公司)