arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2003.08741cs.CVcs.IR

A Convolutional Neural Network-based Patent Image Retrieval Method for Design Ideation

Shanghai Jiao Tong University(上海交通大学);Massachusetts Institute of Technology(麻省理工学院);Singapore University of Technology and Design(新加坡科技设计大学)

Shuo Jiang, Jianxi Luo, Guillermo Ruiz Pava, Jie Hu, Christopher L. Magee

英文摘要:

The patent database is often used in searches of inspirational stimuli for innovative design opportunities because of its large size, extensive variety and rich design information in patent documents. However, most patent mining research only focuses on textual information and ignores visual information. Herein, we propose a convolutional neural network (CNN)-based patent image retrieval method. The core of this approach is a novel neural network architecture named Dual-VGG that is aimed to accomplish two tasks: visual material type prediction and international patent classification (IPC) class label prediction. In turn, the trained neural network provides the deep features in the image embedding vectors that can be utilized for patent image retrieval and visual mapping. The accuracy of both training tasks and patent image embedding space are evaluated to show the performance of our model. This approach is also illustrated in a case study of robot arm design retrieval. Compared to traditional keyword-based searching and Google image searching, the proposed method discovers more useful visual information for engineering design.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑