自由视角草图绘制：视角感知的细粒度基于草图的图像检索

Deep Factorised Inverse-Sketching

Modelling human free-hand sketches has become topical recently, driven by practical applications such as fine-grained sketch based image retrieval (FG-SBIR). Sketches are clearly related to photo edge-maps, but a human free-hand sketch of a photo is not simply a clean rendering of that photo's edge map. Instead there is a fundamental process of abstraction and iconic rendering, where overall geometry is warped and salient details are selectively included. In this paper we study this sketching process and attempt to invert it. We model this inversion by translating iconic free-hand sketches to …

Improving Fairness in Image Classification via Sketching

Fairness is a fundamental requirement for trustworthy and human-centered Artificial Intelligence (AI) system. However, deep neural networks (DNNs) tend to make unfair predictions when the training data are collected from different sub-populations with different attributes (i.e. color, sex, age), leading to biased DNN predictions. We notice that such a troubling phenomenon is often caused by data itself, which means that bias information is encoded to the DNN along with the useful information (i.e. class information, semantic information). Therefore, we propose to use sketching to handle this p…

Fine-Grained VR Sketching: Dataset and Insights

We present the first fine-grained dataset of 1,497 3D VR sketch and 3D shape pairs of a chair category with large shapes diversity. Our dataset supports the recent trend in the sketch community on fine-grained data analysis, and extends it to an actively developing 3D domain. We argue for the most convenient sketching scenario where the sketch consists of sparse lines and does not require any sketching skills, prior training or time-consuming accurate drawing. We then, for the first time, study the scenario of fine-grained 3D VR sketch to 3D shape retrieval, as a novel VR sketching application…

通过素描学习几何感知表示

Learning Geometry-aware Representations by Sketching

本文提出 Learning by Sketching (LBS) 方法，通过将图像转换为显式编码几何信息的彩色笔画并生成素描，在无需素描数据集的情况下学习几何感知表示，理论证明其对仿射变换等变，并在 CLEVR、STL-10 及多种下游任务上显著提升性能。

PS-StyleGAN：基于注意力的风格自适应进行示意性人像素描

PS-StyleGAN: Illustrative Portrait Sketching using Attention-Based Style Adaptation

本文提出PS-StyleGAN，利用StyleGAN的W+潜空间和注意力仿射变换模块，在少量成对样本和短训练时间下实现可编辑且保持身份的人像素描生成，并在多个数据集上优于现有方法。

Mixing realities for sketch retrieval in Virtual Reality

Drawing tools for Virtual Reality (VR) enable users to model 3D designs from within the virtual environment itself. These tools employ sketching and sculpting techniques known from desktop-based interfaces and apply them to hand-based controller interaction. While these techniques allow for mid-air sketching of basic shapes, it remains difficult for users to create detailed and comprehensive 3D models. In our work, we focus on supporting the user in designing the virtual environment around them by enhancing sketch-based interfaces with a supporting system for interactive model retrieval. Throu…