We propose a dual-domain generative model to estimate a texture map from a single image for colorizing a 3D human model. When estimating a texture map, a single image is insufficient as it reveals only one facet of a 3D object. To provide sufficient information for estimating a complete texture map, the proposed model simultaneously generates multi-view hallucinations in the image domain and an estimated texture map in the texture domain. During the generating process, each domain generator exchanges features to the other by a flow-based local attention mechanism. In this manner, the proposed model can estimate a texture map utilizing abundant multi-view image features from which multiview hallucinations are generated. As a result, the estimated texture map contains consistent colors and patterns over the entire region. Experiments show the superiority of our model for estimating a directly render-able texture map, which is applicable to 3D animation rendering. Furthermore, our model also improves an overall generation quality in the image domain for pose and viewpoint transfer tasks.
Sequential Dual Deep Learning with Shape and Texture Features for Sketch Recognition
DUT-RU International School of Information and Software Engineering, Dalian University of Technology(大连理工大学 DUT-RU 国际信息与软件学院);Key Laboratory for Ubiquitous Network and Service Software of Liaoning Province(辽宁省泛在网络与服务软件重点实验室);School of Software, Dalian University of Technology(大连理工大学软件学院)
Image Inpainting via Conditional Texture and Structure Dual Generation
State Key Laboratory of Software Development Environment, Beihang University(北京航空航天大学软件开发环境国家重点实验室);School of Computer Science and Engineering, Beihang University(北京航空航天大学计算机科学与工程学院)
针对大面积图像修复中结构与纹理交互不足的问题,提出双流 CTSDG 网络,通过 Bi-GFF 和 CFA 耦合生成结构与纹理,在多个数据集上取得更优修复效果。
Joint Face Hallucination and Deblurring via Structure Generation and Detail Enhancement
Sensetime Research(商汤科技研究院);Tencent(腾讯);South China University of Technology(华南理工大学);University of Science and Technology of China(中国科学技术大学);University of California at Merced(加州大学默塞德分校);Tencent AI Lab(腾讯人工智能实验室);Nanjing University of Science and Technology(南京理工大学)
RSHallu: Dual-Mode Hallucination Evaluation for Remote-Sensing Multimodal Large Language Models with Domain-Tailored Mitigation
College of Computer Science, Chongqing University(重庆大学计算机科学学院);Heavy Rainfall Research Center of China(中国强降水研究中心);CMA Key Open Laboratory of Transforming Climate Resources to Economy, Chongqing Institute of Meteorological Sciences(中国气象局气候资源转化经济重点开放实验室、重庆气象科学研究院);Chongqing Metropolitan College of Science(重庆科学理工学院);School of Intelligence Science(智能科学学院);College of Artificial Intelligence, Harbin Institute of Technology(人工智能学院、哈尔滨工业大学);BNU-UIC Institute of Artificial Intelligence(北京师范大学-国际学院人工智能与未来网络研究院);Future Networks, Beijing Normal University at Zhuhai(未来网络、北京师范大学珠海分校)
SMPL Normal Map Is All You Need for Single-view Textured Human Reconstruction
Nanyang Technological University(南洋理工大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州));National University of Singapore(国立新加坡大学);Zhejiang University of Technology(浙江工业大学);University of Technology Sydney(悉尼大学)
An efficient dual-branch framework via implicit self-texture enhancement for arbitrary-scale histopathology image super-resolution
Digital Medical Research Center, School of Basic Medical Sciences, Fudan University(复旦大学基础医学院数字医学研究中心);Academy for Engineering and Technology, Fudan University(复旦大学工程技术研究院)
Dual-Path Learning based on Frequency Structural Decoupling and Regional-Aware Fusion for Low-Light Image Super-Resolution
Hefei University of Technology(合肥工业大学);University of Science and Technology of China(中国科学技术大学);Zhejiang University(浙江大学);The University of Electro-Communications(电气通信大学)
Video Demoireing using Focused-Defocused Dual-Camera System
School of Artificial Intelligence, Beijing University of Posts and Telecommunications(北京邮电大学人工智能学院);DeepScience Co., Ltd.(深科科技有限公司);School of Computer Science and Engineering, Beihang University(北航计算机科学与工程学院)
Defending Deepfake via Texture Feature Perturbation
Key Laboratory of Computing Power Network and Information Security, Ministry of Education, Qilu University of Technology (Shandong Academy of Sciences)(计算机网络与信息安全重点实验室,教育部,齐鲁工业大学(山东省科学院));Shandong Artificial Intelligence Institute, Qilu University of Technology (Shandong Academy of Sciences)(山东省人工智能研究院,齐鲁工业大学(山东省科学院));School of Computing, National University of Singapore(新加坡国立大学计算机学院)
SynMind: Reducing Semantic Hallucination in fMRI-Based Image Reconstruction
School of Artificial Intelligence, Beijing University of Posts and Telecommunications(人工智能学院,北京邮电大学);SketchX Lab, Centre for Vision, Speech and Signal Processing (CVSSP), University of Surrey(SketchX实验室,视觉、语音和信号处理中心(CVSSP), Surrey大学)
Toward Robust Hyper-Detailed Image Captioning: A Multiagent Approach and Dual Evaluation Metrics for Factuality and Coverage
Department of Electrical and Computer Engineering, Seoul National University(电气与计算机工程系,首尔国立大学);Interdisciplinary Program in Artificial Intelligence, Seoul National University(人工智能交叉学科项目,首尔国立大学);Adobe Research(Adobe研究)
Mitigating Image Captioning Hallucinations in Vision-Language Models
Department of Computer Science, The University of Alabama at Birmingham(亚拉巴马大学伯明翰分校计算机科学系);Department of Computer Science, University of Waterloo(滑铁卢大学计算机科学系)
MM-Snowball: Evaluating and Mitigating Hallucination Snowballing in Multimodal Multi-Turn Dialogue
College of Intelligent Robotics and Advanced Manufacturing, Fudan University(复旦大学智能机器人与先进制造学院);Southern University of Science and Technology(南方科技大学);TMLR Group, Hong Kong Baptist University(香港 Baptist 大学 TMLR 团体);MM Lab, CUHK(CUHK 多模态实验室);RAMS Lab, Huawei Technologies Co., Ltd.(华为技术有限公司 RAMS 实验室)