This paper presents an experience report on the development of Retrieval Augmented Generation (RAG) systems using PDF documents as the primary data source. The RAG architecture combines generative capabilities of Large Language Models (LLMs) with the precision of information retrieval. This approach has the potential to redefine how we interact with and augment both structured and unstructured knowledge in generative models to enhance transparency, accuracy, and contextuality of responses. The paper details the end-to-end pipeline, from data collection, preprocessing, to retrieval indexing and response generation, highlighting technical challenges and practical solutions. We aim to offer insights to researchers and practitioners developing similar systems using two distinct approaches: OpenAI's Assistant API with GPT Series and Llama's open-source models. The practical implications of this research lie in enhancing the reliability of generative AI systems in various sectors where domain-specific knowledge and real-time information retrieval is important. The Python code used in this work is also available at: https://github.com/GPT-Laboratory/RAG-LLM-Development-Guidebook-from-PDFs.
Hyper-RAG: Combating LLM Hallucinations using Hypergraph-Driven Retrieval-Augmented Generation
School of Software, Tsinghua University(清华大学软件学院);Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University(西安交通大学人工智能与机器人研究所);School of Software Engineering, Xi’an Jiaotong University(西安交通大学软件工程学院);School of Science, Shanghai University(上海大学理学院);School of Information and Electronics, Beijing Institute of Technology(北京理工大学信息与电子学院)
C-RAG: Certified Generation Risks for Retrieval-Augmented Language Models
University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Delft University of Technology(代尔夫特理工大学);Netflix Eyeline Studios;University of California, Berkeley(加州大学伯克利分校);University of Chicago(芝加哥大学)
RAGAR, Your Falsehood Radar: RAG-Augmented Reasoning for Political Fact-Checking using Multimodal Large Language Models
Institute for Natural Language Processing, University of Stuttgart(斯图加特大学自然语言处理研究所);appliedAI Institute for Europe gGmbH(欧洲appliedAI研究所(非营利有限责任公司));appliedAI Initiative GmbH(appliedAI倡议有限责任公司)
RAG-HAR: Retrieval Augmented Generation-based Human Activity Recognition
University of Sydney Australia(悉尼大学澳大利亚分校);University of Sri Jayewardenepura Sri Lanka(Sri Jayewardenepura大学 Sri Lanka);Curtin University Australia(Curtin大学澳大利亚分校);Colorado State University USA(科罗拉多州立大学美国分校)
DH-RAG: A Dynamic Historical Context-Powered Retrieval-Augmented Generation Method for Multi-Turn Dialogue
Hong Kong University of Science and Technology(香港科技大学);Huazhong University of Science and Technology(华中科技大学);University of California San Diego(加州大学圣地亚哥分校);University of Science and Technology of China(中国科学技术大学);Beihang University(北京航空航天大学)
Eliciting Critical Reasoning in Retrieval-Augmented Language Models via Contrastive Explanations
Idiap Research Institute(Idiap研究机构);Department of Computer Science, University of Manchester(曼彻斯特大学计算机科学系);National Biomarker Centre (NBC), CRUK Manchester Institute(国家生物标志物中心(NBC),CRUK曼彻斯特研究所)
HyCE-RAG: Hypergraph Chain-of-Evidence Retrieval-Augmented Generation for Explainable Multi-hop Question Answering
University of Macau(澳门大学);Shenzhen Kaihong Digital Industry Development Co., Ltd.(深圳开鸿数字产业发展有限公司);University of New South Wales(新南威尔士大学);Zhejiang University(浙江大学);Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院)
RAG-Star: Enhancing Deliberative Reasoning with Retrieval Augmented Verification and Refinement
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);Wuhan University of Science and Technology(武汉科技大学);National University of Singapore(新加坡国立大学);Northeastern University at Qinhuangdao(东北大学秦皇岛分校);BOSS Zhipin(BOSS直聘)
RAG-WM: An Efficient Black-Box Watermarking Approach for Retrieval-Augmented Generation of Large Language Models
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Science and Technology, Shandong University(山东大学网络空间安全学院);Indiana University Bloomington(印第安纳大学伯明顿分校);Department of Computer Science, Metropolitan College, Boston University(波士顿大学大都会学院计算机科学系);Institute for Clarity in Documentation(文档清晰研究所);Inria Paris-Rocquencourt(法国国家信息与自动化研究所巴黎-罗康分所);Rajiv Gandhi University(拉吉夫·甘地大学);Tsinghua University(清华大学);Palmer Research Laboratories(帕尔默研究实验室)