Teaching Pretrained Language Models to Think Deeper with Retrofitted Recurrence
机构 * University of Maryland(马里兰大学) ; New York University(纽约大学) ; Lawrence Livermore National Laboratory(劳伦斯利弗莫尔国家实验室) ; University of North Carolina(北卡罗来纳大学) ; ELLIS Institute Tübingen, Max Planck Institute for Intelligent Systems, Tübingen AI Center(图宾根ELLIS研究所、马克斯·普朗克智能系统研究所、图宾根人工智能中心) ; Columbia University(哥伦比亚大学)
Comments code: https://github.com/mcleish7/retrofitting-recurrence, models: https://huggingface.co/collections/tomg-group-umd/retrofitting-recurrence