arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2212.01217cs.CLcs.AI
收藏

使用大型预训练语言模型辅助FDA进行医疗器械上市前评估

Using Large Pre-Trained Language Model to Assist FDA in Premarket Medical Device

Washington University in St. Louis(圣路易斯华盛顿大学)

Zongzhe Xu

摘要:

本文提出了一种使用自然语言处理的可能方法,该方法可能有助于FDA医疗器械上市过程。获取实际器械描述,并与FDA CFR第21条中的器械描述进行匹配,以确定其相应的器械类型。预训练的词嵌入(如FastText)和大型预训练的句子嵌入模型(如句子Transformers)都根据其表征一段设备描述的准确性进行评估。实验还做了测试,这些模型是否可以识别FDA数据库中错误分类的设备。结果表明,与必须手动搜索的2585种设备描述相比,使用T5和MPNet以及GPT-3语义搜索嵌入的句子Transformer通过缩小要包含在前15个最可能的结果中的正确标签来识别正确分类时显示出高准确性。另一方面,所有方法在识别完全错误标记的器械方面都表现出很高的准确性,但都无法识别错误但与真实标签密切相关的虚假器械分类。

英文摘要:

This paper proposes a possible method using natural language processing that might assist in the FDA medical device marketing process. Actual device descriptions are taken and matched with the device description in FDA Title 21 of CFR to determine their corresponding device type. Both pre-trained word embeddings such as FastText and large pre-trained sentence embedding models such as sentence transformers are evaluated on their accuracy in characterizing a piece of device description. An experiment is also done to test whether these models can identify the devices wrongly classified in the FDA database. The result shows that sentence transformer with T5 and MPNet and GPT-3 semantic search embedding show high accuracy in identifying the correct classification by narrowing down the correct label to be contained in the first 15 most likely results, as compared to 2585 types of device descriptions that must be manually searched through. On the other hand, all methods demonstrate high accuracy in identifying completely incorrectly labeled devices, but all fail to identify false device classifications that are wrong but closely related to the true label.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑