This study proposes a universal flow field prediction framework based on knowledge transfer
from large language model (LLM), addressing the high computational costs of traditional
computational fluid dynamics (CFD) methods and the limited cross-condition transfer capability
of existing deep learning models. The framework innovatively integrates Proper Orthogonal
Decomposition (POD) dimensionality reduction with fine-tuning strategies for pretrained LLM,
where POD facilitates compressed representation of flow field features while the fine-tuned model
learns to encode system dynamics in state space. To enhance the model's adaptability to flow field
data, we specifically designed fluid dynamics-oriented text templates that improve predictive
performance through enriched contextual semantic information. Experimental results demonstrate
that our framework outperforms conventional Transformer models in few-shot learning scenarios while
exhibiting exceptional generalization across various inflow conditions and airfoil geometries.
Ablation studies reveal the contributions of key components in the FlowBERT architecture. Compared
to traditional Navier-Stokes equation solvers requiring hours of computation, our approach reduces
prediction time to seconds while maintaining over 90% accuracy. The developed knowledge transfer
paradigm establishes a new direction for rapid fluid dynamics prediction, with potential
applications extending to aerodynamic optimization, flow control, and other engineering domains.
PEL-BERT: A Joint Model for Protocol Entity Linking
University of Chinese Academy of Sciences(中国科学院大学);The Institute of Software, Chinese Academy of Sciences(中国科学院软件研究所);Sichuan University(四川大学);Beijing Jiaotong University(北京交通大学)
Ensemble BERT for Medication Event Classification on Electronic Health Records (EHRs)
Center of Excellence in Research and Education for Big Military Data Intelligence (CREDIT Center)(大数据智能研究与教育中心);Department of Electrical and Computer Engineering(电气与计算机工程系);Prairie View A&M University(普拉姆维尤农业与机械大学);Texas A&M University System(德克萨斯农工大学系统)
ReCAM@IITK at SemEval-2021 Task 4: BERT and ALBERT based Ensemble for Abstract Word Prediction
Indian Institute of Technology Kanpur(坎普尔印度理工学院)
本文介绍了我们的系统SemEval-2021的任务4:阅读理解的抽象意义(ReCAM)。我们参与了所有的子任务,主要目标是预测一个陈述中缺少的抽象词。我们微调了预先训练的掩蔽语言模型,即BERT和AL BERT,并将其作为我们在子任务1(ReCAM-不可感知性)和子任务2(ReCAM-非特异性)上提交的系统。对于子任务3(ReCAM-Intersection),我们提交了ALBERT模型,因为它给出了最好的结果。我们尝试了多种方法,发现基于Masked Language Modeling(MLM)的方法效果最好。