图像生成

Keep the General, Inject the Specific: Structured Dialogue Fine-Tuning for Knowledge Injection without Catastrophic Forgetting

Yijie Hong, Xiaofei Yin, Xinzhong Wang, Yi Tu, Ya Guo, Sufeng Duan, Weiqiang Wang, Lingyong Fang, Depeng Wang, Huijia Zhu

机构 * Shanghai Jiao Tong University（上海交通大学） ； Ant Security Lab, Ant Group（蚂蚁集团安全实验室） 纠错

专题命中 文生图 ：text-to-image(abstract)；diffusion(abstract)

Comments 13 pages, 3 figures

KAHANI: Culturally-Nuanced Visual Storytelling Tool for Non-Western Cultures

Hamna, Deepthi Sudharsan, Agrima Seth, Ritvik Budhiraja, Deepika Khullar, Vyshak Jain, Kalika Bali, Aditya Vashistha, Sameer Segal

专题命中 文生图 ：text-to-image(abstract)；diffusion(abstract)

Comments Under review

Artworks Reimagined: Exploring Human-AI Co-Creation through Body Prompting

Jonas Oppenlaender, Hannah Johnston, Johanna Silvennoinen, Helena Barranha

专题命中 文生图 ：image generation(abstract)；text-to-image(abstract)

Comments 29 pages, 5 figures, 2 tables

When the LM misunderstood the human chuckled: Analyzing garden path effects in humans and language models

Samuel Joseph Amouyal, Aya Meltzer-Asscher, Jonathan Berant

专题命中 文生图 ：image generation(abstract)；text-to-image(abstract)

SEAL: Entangled White-box Watermarks on Low-Rank Adaptation

Giyeong Oh, Saejin Kim, Woohyun Cho, Sangkyu Lee, Jiwan Chung, Dokyung Song, Youngjae Yu

专题命中 文生图 ：text-to-image(abstract)；image synthesis(abstract)

Comments Author name corrected

Consistent estimation of generative model representations in the data kernel perspective space

Aranyak Acharyya, Michael W. Trosset, Carey E. Priebe, Hayden S. Helm

专题命中 文生图 ：text-to-image(abstract)；diffusion(abstract)

FLIRT: Feedback Loop In-context Red Teaming

Ninareh Mehrabi, Palash Goyal, Christophe Dupuy, Qian Hu, Shalini Ghosh, Richard Zemel, Kai-Wei Chang, Aram Galstyan, Rahul Gupta

专题命中 文生图 ：text-to-image(abstract)；diffusion(abstract)

Comments EMNLP 2024

Learning on LoRAs: GL-Equivariant Processing of Low-Rank Weight Spaces for Large Finetuned Models

Theo Putterman, Derek Lim, Yoav Gelberg, Stefanie Jegelka, Haggai Maron

专题命中 文生图 ：text-to-image(abstract)；diffusion(abstract)

Comments 24 pages

GaNDLF-Synth: A Framework to Democratize Generative AI for (Bio)Medical Imaging

Sarthak Pati, Szymon Mazurek, Spyridon Bakas

专题命中 文生图 ：diffusion(abstract)；image synthesis(abstract)

CAD-Prompted Generative Models: A Pathway to Feasible and Novel Engineering Designs

Leah Chong, Jude Rayan, Steven Dow, Ioanna Lykourentzou, Faez Ahmed

专题命中 文生图 ：text-to-image(abstract)；diffusion(abstract)

Comments 11 pages, 3 figures, 4 tables

Can Generative AI Replace Immunofluorescent Staining Processes? A Comparison Study of Synthetically Generated CellPainting Images from Brightfield

Xiaodan Xing, Siofra Murdoch, Chunling Tang, Giorgos Papanastasiou, Jan Cross-Zamirski, Yunzhe Guo, Xianglu Xiao, Carola-Bibiane Schönlieb, Yinhai Wang, Guang Yang

专题命中 文生图 ：diffusion(abstract)；image synthesis(abstract)

Non-convergence of Adam and other adaptive stochastic gradient descent optimization methods for non-vanishing learning rates

Steffen Dereich, Robin Graeber, Arnulf Jentzen

专题命中 文生图 ：text-to-image(abstract)；diffusion(abstract)

Comments 54 pages

StoryDiffusion: How to Support UX Storyboarding With Generative-AI

Zhaohui Liang, Xiaoyu Zhang, Kevin Ma, Zhao Liu, Xipei Ren, Kosa Goucher-Lambert, Can Liu

专题命中 文生图 ：image generation(abstract)；text-to-image(abstract)

Prompting AI Art: An Investigation into the Creative Skill of Prompt Engineering

Jonas Oppenlaender, Rhema Linder, Johanna Silvennoinen

专题命中 文生图 ：image generation(abstract)；text-to-image(abstract)

Comments 42 pages, 8 figures

At the edge of a generative cultural precipice

Diego Porres, Alex Gomez-Villa

专题命中 文生图 ：text-to-image(abstract)；diffusion(abstract)

Comments Accepted at the CVPR Fourth Workshop on Ethical Considerations in Creative applications of Computer Vision

Equivalence: An analysis of artists' roles with Image Generative AI from Conceptual Art perspective through an interactive installation design practice

Yixuan Li, Dan C. Baciu, Marcos Novak, George Legrady

专题命中 文生图 ：text-to-image(abstract)；diffusion(abstract)

Can AI Outperform Human Experts in Creating Social Media Creatives?

Eunkyung Park, Raymond K. Wong, Junbum Kwon

专题命中 文生图 ：text-to-image(abstract)；diffusion(abstract)

Comments 17 pages, 5 figures

Disentanglement in a GAN for Unconditional Speech Synthesis

Matthew Baas, Herman Kamper

专题命中 文生图 ：diffusion(abstract)；image synthesis(abstract)

Comments 12 pages, 5 tables, 4 figures. Accepted to IEEE TASLP. arXiv admin note: substantial text overlap with arXiv:2210.05271

Learning the Visualness of Text Using Large Vision-Language Models

Gaurav Verma, Ryan A. Rossi, Christopher Tensmeyer, Jiuxiang Gu, Ani Nenkova

专题命中 文生图 ：image generation(abstract)；text-to-image(abstract)

Comments Accepted at EMNLP 2023 (Main, long); 9 pages, 5 figures

Selective Amnesia: A Continual Learning Approach to Forgetting in Deep Generative Models

Alvin Heng, Harold Soh

专题命中 文生图 ：text-to-image(abstract)；diffusion(abstract)

Language as Reality: A Co-Creative Storytelling Game Experience in 1001 Nights using Generative AI

Yuqian Sun, Zhouyi Li, Ke Fang, Chang Hee Lee, Ali Asadipour

专题命中 文生图 ：text-to-image(abstract)；diffusion(abstract)

Comments The paper was accepted by The 19th AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment (AIIDE 23)

Catch You Everything Everywhere: Guarding Textual Inversion via Concept Watermarking

Weitao Feng, Jiyan He, Jie Zhang, Tianwei Zhang, Wenbo Zhou, Weiming Zhang, Nenghai Yu

专题命中 文生图 ：text-to-image(abstract)；diffusion(abstract)

Gender Bias in Multimodal Models: A Transnational Feminist Approach Considering Geographical Region and Culture

Abhishek Mandal, Suzanne Little, Susan Leavy

专题命中 文生图 ：text-to-image(abstract)；diffusion(abstract)

Comments Selected for publication at the Aequitas 2023: Workshop on Fairness and Bias in AI | co-located with ECAI 2023, Kraków, Poland

Grimm in Wonderland: Prompt Engineering with Midjourney to Illustrate Fairytales

Martin Ruskov

专题命中 文生图 ：image generation(abstract)；text-to-image(abstract)

Comments 19th Conference on Information and Research science Connecting to Digital and Library Science, February 23-24, 2023, Bari, Italy

Journal ref in 19th IRCDL, CEUR WS vol. 3365, pp. 180-191 (2023)

Learning Disentangled Discrete Representations

David Friede, Christian Reimers, Heiner Stuckenschmidt, Mathias Niepert

专题命中 文生图 ：image generation(abstract)；text-to-image(abstract)

Hard Prompts Made Easy: Gradient-Based Discrete Optimization for Prompt Tuning and Discovery

Yuxin Wen, Neel Jain, John Kirchenbauer, Micah Goldblum, Jonas Geiping, Tom Goldstein

专题命中 文生图 ：text-to-image(abstract)；diffusion(abstract)

Comments 15 pages, 12 figures, Code is available at https://github.com/YuxinWenRick/hard-prompts-made-easy

Instruct2Act: Mapping Multi-modality Instructions to Robotic Actions with Large Language Model

Siyuan Huang, Zhengkai Jiang, Hao Dong, Yu Qiao, Peng Gao, Hongsheng Li

专题命中 文生图 ：image generation(abstract)；text-to-image(abstract)

Constructing Dreams using Generative AI

Safinah Ali, Daniella DiPaola, Randi Williams, Prerna Ravi, Cynthia Breazeal

专题命中 文生图 ：image generation(abstract)；text-to-image(abstract)

The Prompt Artists

Minsuk Chang, Stefania Druga, Alex Fiannaca, Pedro Vergani, Chinmay Kulkarni, Carrie Cai, Michael Terry

专题命中 文生图 ：text-to-image(abstract)；image editing(abstract)

Comments 20 pages, 7 figures

ODIN: On-demand Data Formulation to Mitigate Dataset Lock-in

SP Choi, Jihun Lee, Hyeongseok Ahn, Sanghee Jung, Bumsoo Kang

专题命中 文生图 ：text-to-image(abstract)；diffusion(abstract)

Comments 15 pages