Given the growing trend of many organizations integrating Retrieval Augmented Generation (RAG) into their operations, we assess RAG on domain-specific data and test state-of-the-art models across various optimization techniques. We incorporate four optimizations; Multi-Query, Child-Parent-Retriever, Ensemble Retriever, and In-Context-Learning, to enhance the functionality and performance in the academic domain. We focus on data retrieval, specifically targeting various study programs at a large technical university. We additionally introduce a novel evaluation approach, the RAG Confusion Matrix designed to assess the effectiveness of various configurations within the RAG framework. By exploring the integration of both open-source (e.g., Llama2, Mistral) and closed-source (GPT-3.5 and GPT-4) Large Language Models, we offer valuable insights into the application and optimization of RAG frameworks in domain-specific contexts. Our experiments show a significant performance increase when including multi-query in the retrieval phase.
Optimizing Retrieval-Augmented Generation of Medical Content for Spaced Repetition Learning
Poznań University of Medical Sciences(波兹南医科大学);Adam Mickiewicz University(亚当·密茨凯维奇大学);Wydawnictwo Naukowe PWN(PWN科学出版社);SuperMemo World(SuperMemo世界公司);Association for Research and Applications of Artificial Intelligence(人工智能研究与应用协会)
TreeReader: A Hierarchical Academic Paper Reader Powered by Language Models
University of Toronto(多伦多大学);Vector Institute for Artificial Intelligence(向量人工智能研究所);University of Toronto Mississauga(多伦多大学密西沙加分校);Acceleration Consortium(加速联盟);Canadian Institute for Advanced Research (CIFAR)(加拿大高级研究院);NVIDIA(英伟达)
LCAi: Life Cycle Assessment with big data fusion and retrieval-augmented generation-assisted interpretation
Institute for Chemical and Bioengineering, Department of Chemistry and Applied Biosciences, ETH Zürich(苏黎世联邦理工学院化学与应用生物科学系化学与生物工程研究所);NCCR Catalysis(瑞士国家研究能力中心催化研究所)
Department of Mathematics and Computer Science, University of Catania, Italy(卡塔尼亚大学数学与计算机科学系,意大利);Institute for Cognitive Science and Technology, National Research Council, Italy(意大利国家研究委员会认知科学与技术研究所)
Optimizing Medical Question-Answering Systems: A Comparative Study of Fine-Tuned and Zero-Shot Large Language Models with RAG Framework
Department of Electrical Engineering;Computer Science University of Toledo Toledo, USA;Institute of Mathematical Sciences Claremont Graduate University Claremont, USA;Department of Bioengineering University of Toledo Toledo, USA;Department of Computer Science Bowling Green State University Bowling Green, USA
PA-RAG: RAG Alignment via Multi-Perspective Preference Optimization
School of Data Science and Engineering, East China Normal University(华东师范大学数据科学与工程学院);Chinese Academy of Sciences(中国科学院);Baidu Inc(百度公司);Peking University(北京大学)
Graph Your Way to Inspiration: Integrating Co-Author Graphs with Retrieval-Augmented Generation for Large Language Model Based Scientific Idea Generation
School of Computing Newcastle University(计算学院新castle大学)
Optimizing Health Coverage in Ethiopia: A Learning-augmented Approach and Persistent Proportionality Under an Online Budget
John A. Paulson School of Engineering and Applied Sciences(约翰·A·保罗森工程与应用科学学院);Harvard University(哈佛大学);National Data Management and Analytics Center for Health(健康国家数据管理与分析中心);Ethiopian Public Health Institute(埃塞俄比亚公共卫生研究所);Ministry of Health, Ethiopia(埃塞俄比亚卫生部);Department of Global Health and Population(全球卫生与人口部门);Harvard T.H. Chan School of Public Health(哈佛T.H. Chan公共卫生学院)
Retrieval Augmented Diffusion Model for Structure-informed Antibody Design and Optimization
Global Institute of Future technology, Shanghai Jiao Tong University(未来科技全球研究院,上海交通大学);School of Software & Microelectronics, Peking University(软件与微电子学院,北京大学)
AI Slop or AI-enhancement? Student perceptions of AI-generated media for an English for Academic Purposes course
Everwrite Limited(Everwrite有限公司);Faculty of Education, The University of Hong Kong(香港大学教育学院);Faculty of Education, The Chinese University of Hong Kong(香港中文大学教育学院)