In traditional innovation practices, concept and IP generation are often iteratively integrated. Both processes demand an intricate understanding of advanced technical domain knowledge. Existing large language models (LLMs), while possessing massive pre-trained knowledge, often fall short in the innovative concept generation due to a lack of specialized knowledge necessary for the generation. To bridge this critical gap, we propose a novel knowledge finetuning (KFT) framework to endow LLM-based AI with the ability to autonomously mine, understand, and apply domain-specific knowledge and concepts for invention generation, i.e., concept and patent generation together. Our proposed PatentGPT integrates knowledge injection pre-training (KPT), domain-specific supervised finetuning (SFT), and reinforcement learning from human feedback (RLHF). Extensive evaluation shows that PatentGPT significantly outperforms the state-of-the-art models on patent-related benchmark tests. Our method not only provides new insights into data-driven innovation but also paves a new path to fine-tune LLMs for applications in the context of technology. We also discuss the managerial and policy implications of AI-generating inventions in the future.
AutoPatent: A Multi-Agent Framework for Automatic Patent Generation
Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);Dalian University of Technology(大连理工大学);Southern University of Science and Technology(南方科技大学);The University of New South Wales(新南威尔士大学);Shenzhen University of Advanced Technology(深圳理工大学)
From scratch to silver: Creating trustworthy training data for patent-SDG classification using Large Language Models
Department of Industrial Engineering, Polytechnic University of Turin(工业工程系,都灵理工学院);Venice School of Management, Ca Foscari University of Venice(威尼斯管理学院,威尼斯福斯卡里大学)
ERA-IT: Aligning Semantic Models with Revealed Economic Preference for Real-Time and Explainable Patent Valuation
School of Computing(计算学院);Macquarie University(麦考瑞大学);School of Computer Science(计算机科学学院);University of Technology Sydney(悉尼技术大学);School of Management(管理学院);Zhejiang University(浙江大学)
Adaptive Multi-Stage Patent Claim Generation with Unified Quality Assessment
Shenzhen Kaihong Digital Industry Development Co., Ltd.(深圳凯鸿数字工业发展有限公司);Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(深圳先进技术研究所)
Agentic generation of verifiable rules for deterministic, self-expanding reaction classification
École Polytechnique Fédérale de Lausanne (EPFL)(洛桑联邦理工学院);Laboratory for Chemical Technology, Ghent University(根特大学化学技术实验室);NCCR Catalysis(瑞士国家研究能力中心催化项目)
Self-Knowledge Retrieval Augmented Generation Framework for Patent Matching
School of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);ZJU-UIUC Institute, Zhejiang University(浙江大学ZJU-UIUC学院);Shaoxing K3i Technology Co. Ltd(绍兴K3i科技有限公司);State Key Laboratory of CAD&CG, Zhejiang University(浙江大学CAD&CG国家重点实验室)
Query Generation for Patent Retrieval with Keyword Extraction based on Syntactic Features
Amsterdam Business School, University of Amsterdam(阿姆斯特丹大学阿姆斯特丹商学院);European Patent Office(欧洲专利局);Institute of Informatics, University of Amsterdam(阿姆斯特丹大学信息学院)
The Master-Slave Encoder Model for Improving Patent Text Summarization: A New Approach to Combining Specifications and Claims
School of Information Management, Nanjing University(南京大学信息管理学院);Key Laboratory of Data Engineering and Knowledge Services in Jiangsu Provincial Universities, Nanjing University(江苏省高校数据工程与知识服务重点实验室(南京大学));Baidu, Inc.(百度公司)
Pretraining Data Detection for Large Language Models: A Divergence-based Calibration Method
CAS Key Lab of Network Data Science and Technology, ICT, CAS, Beijing, China(中国科学院信息科技研究所网络数据科学与技术重点实验室);University of Chinese Academy of Sciences, Beijing, China(中国科学院大学北京校区);Zhongguancun Laboratory, Beijing, China(中关村实验室);University of Amsterdam, Amsterdam, The Netherlands(阿姆斯特丹大学)
Improving Scientific Document Retrieval with Concept Coverage-based Query Set Generation
Korea University(高丽大学);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Pohang University of Science and Technology(浦项科技大学);Texas A&M University(德克萨斯农工大学);Yonsei University(延世大学)
Concept-Grounded Reasoning with Prompt-Driven Localization for Interpretable Structured Report Generation
The Hong Kong University of Science and Technology(香港科技大学);The Chinese University of Hong Kong(香港中文大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Saarland University(萨尔兰大学);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);University of Cambridge(剑桥大学)