arXiv 1507.063322015-07-22cs.CV

Part Localization using Multi-Proposal Consensus for Fine-Grained Categorization

Kevin J. Shih, Arun Mallya, Saurabh Singh, Derek Hoiem

备注：: BMVC 2015

英文摘要：

We present a simple deep learning framework to simultaneously predict keypoint locations and their respective visibilities and use those to achieve state-of-the-art performance for fine-grained classification. We show that by conditioning the predictions on object proposals with sufficient image support, our method can do well without complicated spatial reasoning. Instead, inference methods with robustness to outliers, yield state-of-the-art for keypoint localization. We demonstrate the effectiveness of our accurate keypoint localization and visibility prediction on the fine-grained bird recognition task with and without ground truth bird bounding boxes, and outperform existing state-of-the-art methods by over 2%.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

Part-Aware Fine-grained Object Categorization using Weakly Supervised Part Detection Network

South China University of Technology（华南理工大学）

Fine-grained object categorization aims for distinguishing objects of subordinate categories that belong to the same entry-level object category. The task is challenging due to the facts that (1) training images with ground-truth labels are difficult to obtain, and (2) variations among different subordinate categories are subtle. It is well established that characterizing features of different subordinate categories are located on local parts of object instances. In fact, careful part annotations are available in many fine-grained categorization datasets. However, manually annotating object pa…

2019-12-04cs.CV

Weakly Supervised Fine-Grained Image Categorization

Advanced Digital Sciences Center（高级数字科学中心）；Nanjing University（南京大学）；Nanyang Technological University（南洋理工大学）

In this paper, we categorize fine-grained images without using any object / part annotation neither in the training nor in the testing stage, a step towards making it suitable for deployments. Fine-grained image categorization aims to classify objects with subtle distinctions. Most existing works heavily rely on object / part detectors to build the correspondence between object parts by using object or object part annotations inside training images. The need for expensive object annotations prevents the wide usage of these methods. Instead, we propose to select useful parts from multi-scale pa…

2015-04-20cs.CV

Two-Stream Consensus Network for Weakly-Supervised Temporal Action Localization

Xi’an Jiaotong University（西安交通大学）；University of Illinois at Chicago（伊利诺伊大学芝加哥分校）；HERE Technologies（HERE科技公司）；State University of New York at Buffalo（纽约州立大学布法罗分校）；Wormpex AI Research（沃姆派克斯人工智能研究院）

Weakly-supervised Temporal Action Localization (W-TAL) aims to classify and localize all action instances in an untrimmed video under only video-level supervision. However, without frame-level annotations, it is challenging for W-TAL methods to identify false positive action proposals and generate action proposals with precise temporal boundaries. In this paper, we present a Two-Stream Consensus Network (TSCN) to simultaneously address these challenges. The proposed TSCN features an iterative refinement training method, where a frame-level pseudo ground truth is iteratively updated, and used t…

2020-10-22cs.CV

Part-based R-CNNs for Fine-grained Category Detection

University of California, Berkeley（加州大学伯克利分校）

Semantic part localization can facilitate fine-grained categorization by explicitly isolating subtle appearance differences associated with specific object parts. Methods for pose-normalized representations have been proposed, but generally presume bounding box annotations at test time due to the difficulty of object detection. We propose a model for fine-grained categorization that overcomes these limitations by leveraging deep convolutional features computed on bottom-up region proposals. Our method learns whole-object and part detectors, enforces learned geometric constraints between them, …

2014-07-15cs.CV

Two-Stream CNN with Loose Pair Training for Multi-modal AMD Categorization

Renmin University of China（中国人民大学）；Visionary Intelligence Ltd.（远景智能有限公司）；Peking Union Medical College Hospital（北京协和医院）；Chinese Academy of Medical Sciences（中国医学科学院）

This paper studies automated categorization of age-related macular degeneration (AMD) given a multi-modal input, which consists of a color fundus image and an optical coherence tomography (OCT) image from a specific eye. Previous work uses a traditional method, comprised of feature extraction and classifier training that cannot be optimized jointly. By contrast, we propose a two-stream convolutional neural network (CNN) that is end-to-end. The CNN's fusion layer is tailored to the need of fusing information from the fundus and OCT streams. For generating more multi-modal training instances, we…

2019-07-28cs.CVeess.IV

Human Detection and Segmentation via Multi-view Consensus

EPFL（洛桑联邦理工学院）；UBC（不列颠哥伦比亚大学）；Balgrist University Hospital（巴尔格里斯特大学医院）；ClearSpace SA（ClearSpace公司）

Self-supervised detection and segmentation of foreground objects aims for accuracy without annotated training data. However, existing approaches predominantly rely on restrictive assumptions on appearance and motion. For scenes with dynamic activities and camera motion, we propose a multi-camera framework in which geometric constraints are embedded in the form of multi-view consistency during training via coarse 3D localization in a voxel grid and fine-grained offset regression. In this manner, we learn a joint distribution of proposals over multiple views. At inference time, our method operat…

2021-08-18cs.CV

更多相关论文收起更多论文

Multi-branch and Multi-scale Attention Learning for Fine-Grained Visual Categorization

China University of Mining and Technology (Beijing)（中国矿业大学（北京））

ImageNet Large Scale Visual Recognition Challenge (ILSVRC) is one of the most authoritative academic competitions in the field of Computer Vision (CV) in recent years. But applying ILSVRC's annual champion directly to fine-grained visual categorization (FGVC) tasks does not achieve good performance. To FGVC tasks, the small inter-class variations and the large intra-class variations make it a challenging problem. Our attention object location module (AOLM) can predict the position of the object and attention part proposal module (APPM) can propose informative part regions without the need of b…

2020-07-21cs.CVcs.LGeess.IV

HyrCap：用于时间事件理解的动作提案混合排名校准

HyrCap: Hybrid Rank-Calibration of Action Proposals for Temporal Event Understanding

Peking University（北京大学）；Zhongguancun Academy（中关村学院）；Zhongguancun Institute of Artificial Intelligence（中关村人工智能研究院）；Harbin Institute of Technology, Shenzhen（哈尔滨工业大学（深圳））

提出HyrCap框架，结合混合特征与排名校准处理时间动作检测问题，经分阶段评估在公开基准上达最优性能，为时间事件理解提供新范式。

2026-10-14cs.CV

Pointly-Supervised Action Localization

Universiteit van Amsterdam（阿姆斯特丹大学）

This paper strives for spatio-temporal localization of human actions in videos. In the literature, the consensus is to achieve localization by training on bounding box annotations provided for each frame of each training video. As annotating boxes in video is expensive, cumbersome and error-prone, we propose to bypass box-supervision. Instead, we introduce action localization based on point-supervision. We start from unsupervised spatio-temporal proposals, which provide a set of candidate regions in videos. While normally used exclusively for inference, we show spatio-temporal proposals can al…

2018-10-01cs.CV