Regulatory compliance reporting in the pharmaceutical industry relies on detailed tables, but these are often under-utilized beyond compliance due to their unstructured format and arbitrary content. Extracting and semantically representing tabular data is challenging due to diverse table presentations. Large Language Models (LLMs) demonstrate substantial potential for semantic representation, yet they encounter challenges related to accuracy and context size limitations, which are crucial considerations for the industry applications. We introduce HySem, a pipeline that employs a novel context length optimization technique to generate accurate semantic JSON representations from HTML tables. This approach utilizes a custom fine-tuned model specifically designed for cost- and privacy-sensitive small and medium pharmaceutical enterprises. Running on commodity hardware and leveraging open-source models, HySem surpasses its peer open-source models in accuracy and provides competitive performance when benchmarked against OpenAI GPT-4o and effectively addresses context length limitations, which is a crucial factor for supporting larger tables.
Small Models are LLM Knowledge Triggers on Medical Tabular Prediction
College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);Thrust of Artificial Intelligence, Information Hub, HKUST (GZ)(香港科技大学(广州)信息枢纽人工智能方向);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);The Second Affiliated Hospital Zhejiang University School of Medicine(浙江大学医学院附属第二医院);Zhejiang Key Laboratory of Medical Imaging Artificial Intelligence(浙江省医学影像人工智能重点实验室)
NeedleInATable: Exploring Long-Context Capability of Large Language Models towards Long-Structured Tables
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络安全学院)
P-Transformer: A Prompt-based Multimodal Transformer Architecture For Medical Tabular Data
Saw Swee Hock School of Public Health, National University of Singapore(新加坡国立大学苏瑞福公共卫生学院);Institute of Data Science, National University of Singapore(新加坡国立大学数据科学研究院);Singapore General Hospital(新加坡综合医院)
MulTaBench: Benchmarking Multimodal Tabular Learning with Text and Image
Technion – Israel Institute of Technology(技术ion – 以色列理工学院);Prior Labs(Prior实验室);NVIDIA;SODA Team, INRIA Saclay, Palaiseau(SODA团队,INRIA萨克莱,帕莱索);University of Freiburg(弗赖堡大学);Probabl;ELLIS Institute Tübingen(图宾根ELLIS研究所)
H2: A Dual Hybrid Semantic Data Lake Architecture for Medical Data Harmonization with Human-In-the-Loop verified, LLM Driven Metadata Annotation System
Institute of Communication and Computer Systems (ICCS)(通信与计算机系统研究所(ICCS));University of Macedonia (UOM)(马其顿大学(UOM))