Image outpainting aims to generate the content of an input sub-image beyond its original boundaries. It is an important task in content generation yet remains an open problem for generative models. This paper pushes the technical frontier of image outpainting in two directions that have not been resolved in literature: 1) outpainting with arbitrary and continuous multiples (without restriction), and 2) outpainting in a single step (even for large expansion multiples). Moreover, we develop a method that does not depend on a pre-trained backbone network, which is in contrast commonly required by the previous SOTA outpainting methods. The arbitrary multiple outpainting is achieved by utilizing randomly cropped views from the same image during training to capture arbitrary relative positional information. Specifically, by feeding one view and positional embeddings as queries, we can reconstruct another view. At inference, we generate images with arbitrary expansion multiples by inputting an anchor image and its corresponding positional embeddings. The one-step outpainting ability here is particularly noteworthy in contrast to previous methods that need to be performed for $N$ times to obtain a final multiple which is $N$ times of its basic and fixed multiple. We evaluate the proposed approach (called PQDiff as we adopt a diffusion-based generator as our embodiment, under our proposed \textbf{P}ositional \textbf{Q}uery scheme) on public benchmarks, demonstrating its superior performance over state-of-the-art approaches. Specifically, PQDiff achieves state-of-the-art FID scores on the Scenery (\textbf{21.512}), Building Facades (\textbf{25.310}), and WikiArts (\textbf{36.212}) datasets. Furthermore, under the 2.25x, 5x and 11.7x outpainting settings, PQDiff only takes \textbf{40.6\%}, \textbf{20.3\%} and \textbf{10.2\%} of the time of the benchmark state-of-the-art (SOTA) method.
Learning Where to Embed: Noise-Aware Positional Embedding for Query Retrieval in Small-Object Detection
Southeast University(东南大学);Fudan University(复旦大学);The University of Texas at Dallas(德克萨斯大学达拉斯分校);Zhejiang Normal University(浙江师范大学);Data Space Research Institute, Hefei Comprehensive National Science Center(合肥综合国家科学中心数据空间研究院);Rice University(里士满大学);Huazhong Agricultural University(华中农业大学);City University of Hong Kong (Dongguan)(香港城市大学(东莞));Wake Forest University(威克森林大学)
VAGeo: View-specific Attention for Cross-View Object Geo-Localization
School of Computer Science and Technology, Wuhan University of Science and Technology(武汉科技大学计算机科学与技术学院);Hubei Province Key Laboratory of Intelligent Information Processing and Real-Time Industrial System(湖北省智能信息处理与实时工业系统重点实验室)
OrientedFormer: An End-to-End Transformer-Based Oriented Object Detector in Remote Sensing Images
School of Computer Science and Technology, China University of Mining and Technology(中国矿业大学计算机科学与技术学院);School of Electrical Engineering and Computer Science, University of Ottawa(渥太华大学电气与计算机科学学院)
DS-Det: Single-Query Paradigm and Attention Disentangled Learning for Flexible Object Detection
RITAS, Southern University of Science and Technology(南方科技大学RITAS);Pengcheng Laboratory(鹏城实验室);Pazhou Laboratory (Huangpu)(黄埔实验室);Department of Computer Science and Engineering, Southern University of Science and Technology(南方科技大学计算机科学与工程系);Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳))
StructDiff: A Structure-Preserving and Spatially Controllable Diffusion Model for Single-Image Generation
Institute of Information Science, Beijing Jiaotong University(信息科学研究院,北京交通大学);Visual Intelligence +X International Cooperation Joint Laboratory of MOE, Beijing(教育部视觉智能+X国际合作联合实验室,北京);College of Computing and Data Science, Nanyang Technological University(计算与数据科学学院,南洋理工大学)