Current human image customization methods leverage Stable Diffusion (SD) for its rich semantic prior. However, since SD is not specifically designed for human-oriented generation, these methods often require extensive fine-tuning on large-scale datasets, which renders them susceptible to overfitting and hinders their ability to personalize individuals with previously unseen styles. Moreover, these methods extensively focus on single-concept human image synthesis and lack the flexibility to customize individuals using multiple given concepts, thereby impeding their broader practical application. This paper proposes MagicFace, a novel training-free method for multi-concept universal-style human image personalized synthesis. Our core idea is to simulate how humans create images given specific concepts, i.e., first establish a semantic layout considering factors such as concepts' shape and posture, then optimize details by comparing with concepts at the pixel level. To implement this process, we introduce a coarse-to-fine generation pipeline, involving two sequential stages: semantic layout construction and concept feature injection. This is achieved by our Reference-aware Self-Attention (RSA) and Region-grouped Blend Attention (RBA) mechanisms. In the first stage, RSA enables the latent image to query features from all reference concepts simultaneously, extracting the overall semantic understanding to facilitate the initial semantic layout establishment. In the second stage, we employ an attention-based semantic segmentation method to pinpoint the latent generated regions of all concepts at each step. Following this, RBA divides the pixels of the latent image into semantic groups, with each group querying fine-grained features from the corresponding reference concept. Extensive experiments demonstrate the superiority of our MagicFace.
HiCAST: Highly Customized Arbitrary Style Transfer with Adapter Enhanced Diffusion Models
Harbin Institute of Technology(哈尔滨工业大学);Baidu Research(百度研究院);Baidu Inc.(百度公司);University of Chinese Academy of Sciences(中国科学院大学);ETH Zurich(苏黎世联邦理工学院)
MuseumMaker: Continual Style Customization without Catastrophic Forgetting
State Key Laboratory of Robotics, the Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences(中国科学院机器人与智能制造研究院机器人国家重点实验室);University of Chinese Academy of Sciences(中国科学院大学);School of Automation Science and Engineering, South China University of Technology(华南理工大学自动化科学与工程学院);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);Salesforce AI Research(Salesforce AI研究部门)
Evaluating Dataset Watermarking for Fine-tuning Traceability of Customized Diffusion Models: A Comprehensive Benchmark and Removal Approach
Donghua University(东华大学);Shanghai Jiao Tong University(上海交通大学);Xidian University(西安电子科技大学);Hefei University of Technology(合肥工业大学);East China Normal University(华东师范大学)
SplitFlux: Learning to Decouple Content and Style from a Single Image
School of Computing and Artificial Intelligence(计算与人工智能学院);University College London, University of London(伦敦大学大学学院);College of Computer Science and Technology(计算机科学与技术学院)
LatRef-Diff: Latent and Reference-Guided Diffusion for Facial Attribute Editing and Style Manipulation
GuangDong Province Key Lab of Information Security Technology and School of Computer Science and Engineering(广东信息安全技术重点实验室和计算机科学与工程学院);School of Cyber Science and Technology, Shenzhen Campus(深圳校区网络科学与技术学院);Guangdong Laboratory of Machine Perception and Intelligent Computing, Faculty of Engineering(广东机器感知与智能计算实验室,工程学院)
CreativeSynth: Cross-Art-Attention for Artistic Image Synthesis with Multimodal Diffusion
Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);Pengcheng Laboratory(鹏城实验室);MAIS, Institute of Automation, Chinese Academy of Sciences(自动化所MAIS部);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);University of Chinese Academy of Sciences(中国科学院大学);ByteDance Inc.(字节跳动公司);National Cheng Kung University(国立成功大学)
PhotoDoodle: Learning Artistic Image Editing from Few-Shot Pairwise Data
National University of Singapore(新加坡国立大学);Shanghai Jiao Tong University(上海交通大学);Beijing University of Posts and Telecommunications(北京邮电大学);Tiamat(提亚马特)
Open Vocabulary Word Recognition From Transcribed Bangla Texts
Department of Computer Science;Engineering Khulna University of Engineering \& Technology Khulna-9203, Bangladesh;Engineering Khulna University of Engineering \& Technology Khulna-9203, Bangladesh Email: 1 3