Towards Enhanced RAC Accessibility: Leveraging Datasets and LLMs
Universidad de Barcelona(巴塞罗那大学);Universidad Nacional de Colombia(哥伦比亚国立大学);Fund. Univ. Los Libertadores(自由者大学基金会)
Edison Jair Bejarano Sepulveda, Nicolai Potes Hector, Santiago Pineda Montoya, Felipe Ivan Rodriguez, Jaime Enrique Orduy, Alec Rosales Cabezas, Danny Traslaviñ… 展开作者
Edison Jair Bejarano Sepulveda, Nicolai Potes Hector, Santiago Pineda Montoya, Felipe Ivan Rodriguez, Jaime Enrique Orduy, Alec Rosales Cabezas, Danny Traslaviña Navarrete, Sergio Madrid Farfan
This paper explores the potential of large language models (LLMs) to make the Aeronautical Regulations of Colombia (RAC) more accessible. Given the complexity and extensive technicality of the RAC, this study introduces a novel approach to simplifying these regulations for broader understanding. By developing the first-ever RAC database, which contains 24,478 expertly labeled question-and-answer pairs, and fine-tuning LLMs specifically for RAC applications, the paper outlines the methodology for dataset assembly, expert-led annotation, and model training. Utilizing the Gemma1.1 2b model along with advanced techniques like Unsloth for efficient VRAM usage and flash attention mechanisms, the research aims to expedite training processes. This initiative establishes a foundation to enhance the comprehensibility and accessibility of RAC, potentially benefiting novices and reducing dependence on expert consultations for navigating the aviation industry's regulatory landscape.
You can visit the dataset (https://huggingface.co/somosnlp/gemma-1.1-2b-it_ColombiaRAC_FullyCurated_format_chatML_V1) and the model (https://huggingface.co/datasets/somosnlp/ColombiaRAC_FullyCurated) here.
AccessGuru: Leveraging LLMs to Detect and Correct Web Accessibility Violations in HTML Code
University of Stuttgart, Artificial Intelligence(斯图加特大学人工智能学院);Artificial Intelligence, University of Stuttgart(人工智能学院,斯图加特大学);University of Stuttgart(斯图加特大学);University of Southampton(南安普顿大学)
ACCESS: Prompt Engineering for Automated Web Accessibility Violation Corrections
Carlmont High School(卡尔蒙特高中);Crofton House School(克罗夫顿豪斯学校);Lynbrook High School(林布鲁克高中);International School of Zug and Luzern(楚格与卢塞恩国际学校);Columbia University(哥伦比亚大学);Taipei American School(台北美国学校);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of California Berkeley(加州大学伯克利分校)
Slide2Text: Leveraging LLMs for Personalized Textbook Generation from PowerPoint Presentations
East China Normal University(华东师范大学);Shanghai Institute of Artificial Intelligence for Education(上海人工智能教育研究院);School of Computer Science and Technology, East China Normal University(华东师范大学计算机科学与技术学院)
Leveraging Transformers for StarCraft Macromanagement Prediction
University of Central Florida(中佛罗里达大学)
受最近Transformers在自然语言处理和计算机视觉应用中的成功启发,我们引入了一个基于transformer的神经架构,用于两个关键的星际争霸2(SC2)宏观管理任务:全局状态和构建顺序预测。与受近因偏差影响的递归神经网络不同,Transformers能够在很长的时间范围内捕获模式,使其非常适合完整的游戏分析。我们的模型利用MSC(Macromanagement in StarCraft II)数据集,并改进了性能最佳的门控递归单元(GRU)架构,以预测全局状态和构建顺序,并通过多个时间范围内的平均准确度进行测量。我们目前的消融研究,我们提出的架构,支持我们的设计决策。Transformers的一个关键优势是它们能够很好地泛化,我们证明了我们的模型在迁移学习环境中使用时达到了更好的准确性,在这种环境中,模型在一个种族比赛的游戏上训练(例如,人族对神族)被转移到一个不同的。我们相信Transformers对长时间游戏的建模能力,并行化的潜力和泛化性能使其成为星际争霸代理的绝佳选择。
Leveraging large language models for structured information extraction from pathology reports
National Cancer Institute(美国国家癌症研究所);The Institute of Cancer Research, London(伦敦癌症研究院);Imperial College London(伦敦帝国理工学院);The Breast Cancer Now Toby Robins Research Centre, The Institute of Cancer Research, London(伦敦癌症研究院乳腺癌现在托比·罗宾斯研究中心)
In2Core: Leveraging Influence Functions for Coreset Selection in Instruction Finetuning of Large Language Models
Institute for Infocomm Research (IR), A*STAR(新加坡科技研究局信息通信研究院);CNRS(法国国家科学研究中心);IRIT(图卢兹计算机科学、建模与信息工程研究所);National University of Singapore(新加坡国立大学);Centre for Frontier AI Research (CFAR), A*STAR(新加坡科技研究局前沿人工智能研究中心)
HIST-AID: Leveraging Historical Patient Reports for Enhanced Multi-Modal Automatic Diagnosis
Courant Institute of Mathematical Sciences, New York University(纽约大学柯朗数学科学研究所);New York University Grossman School of Medicine(纽约大学格罗斯曼医学院);Center of Data Science, New York University(纽约大学数据科学中心);Prescient Design, Genentech(基因泰克公司Prescient Design部门);CIFAR LMB(加拿大高级研究院学习算法与机器智能实验室)