Constraint-based Pre-training: From Structured Constraints to Scalable Model Initialization
基于约束的预训练:从结构化约束到可扩展的模型初始化
Fu Feng, Yucheng Xie, Ruixiao Shi, Jing Wang, Xin Geng
机构
*
School of Computer Science and Engineering, Southeast University, Nanjing, China(东南大学计算机科学与工程学院,南京,中国)
;
Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications (Southeast University), Ministry of Education, China(新一代人工智能技术及其跨学科应用重点实验室(东南大学),教育部,中国)