Retrieval-augmented question-answering systems combine retrieval techniques with large language models to provide answers that are more accurate and informative. Many existing toolkits allow users to quickly build such systems using off-the-shelf models, but they fall short in supporting researchers and developers to customize the model training, testing, and deployment process. We propose LocalRQA, an open-source toolkit that features a wide selection of model training algorithms, evaluation methods, and deployment tools curated from the latest research. As a showcase, we build QA systems using online documentation obtained from Databricks and Faire's websites. We find 7B-models trained and deployed using LocalRQA reach a similar performance compared to using OpenAI's text-ada-002 and GPT-4-turbo.
LLMRouter: Unified Infrastructure for Developing, Evaluating, and Deploying LLM Routers
University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of Maryland, College Park(马里兰大学帕克分校);Nanyang Technological University(南洋理工大学);Purdue University(普渡大学);University of Illinois Chicago(芝加哥伊利诺伊大学)
RAEE: A Robust Retrieval-Augmented Early Exit Framework for Efficient Inference
City University of Hong Kong(香港城市大学);Mohamed bin Zayed University of Artificial Intelligence (MBZUAI)(穆罕默德·本·扎耶德人工智能大学);MILA, McGill University(麦吉尔大学机器学习研究院);National Taiwan University(台湾国立大学)
TCRA-LLM: Token Compression Retrieval Augmented Large Language Model for Inference Cost Reduction
Meetyou AI Lab(美柚人工智能实验室);Xiamen Key Laboratory of Women’s Internet Health Management(厦门市女性互联网健康管理重点实验室);Osaka University(大阪大学);Agency for Science, Technology and Research (A*STAR)(新加坡科技研究局)
Smarter, not Bigger: Fine-Tuned RAG-Enhanced LLMs for Automotive HIL Testing
Communication Systems Group CSG, Department of Informatics IfI, University of Zurich UZH, 8050 Zürich, Switzerland(苏黎世大学信息学院通信系统组);Volvo Car Corporation, 405 31 Göteborg, Sweden(沃尔沃汽车公司)
DRAG: Distilling RAG for SLMs from LLMs to Transfer Knowledge and Mitigate Hallucination via Evidence and Graph-based Distillation
VILA Lab(VILA实验室);Mohamed bin Zayed University of AI(莫扎伊德·本·泽德人工智能大学);McGill University(麦吉尔大学);National University of Science and Technology(国家科学与技术大学)
An Agile Method for Implementing Retrieval Augmented Generation Tools in Industrial SMEs
LAMIH CNRS/Université Polytechnique Hauts-de-France(LAMIH CNRS/上法兰西理工大学);CIRRELT;Polytechnique Montréal(蒙特利尔理工学院);Meedia;Arts et Métiers Institute of Technology(法国国立高等工程技术学院)
Domain Fine-Tuning vs. Retrieval-Augmented Generation for Medical Multiple-Choice Question Answering: A Controlled Comparison at the 4B-Parameter Scale
Department of Information Science and Applied Artificial Intelligence(信息科学与应用人工智能系)
Confident RAG: Enhancing the Performance of LLMs for Mathematics Question Answering through Multi-Embedding and Confidence Scoring
Faculty of Education, The University of Hong Kong(香港大学教育学院);Department of Civil and Environmental Engineering, The Hong Kong University of Science and Technology(香港科学与技术大学土木与环境工程系)