MetaAID 2.0:一个可扩展的框架,用于通过人可控的预训练模型开发Metaverse应用程序
MetaAID 2.0: An Extensible Framework for Developing Metaverse Applications via Human-controllable Pre-trained Models
摘要:
预训练模型(PM)在内容生成方面取得了可喜的成果。但人类创造力和想象力的空间是无穷的,现有的模式能否满足需求还不得而知。模型生成的内容面临着无法控制的责任和潜在的不道德问题。本文提出了MetaAID2.0框架,致力于人为可控PM信息流。通过PM信息流,人类可以自主控制自己的创造力。通过统一资源标识符扩展(URI扩展),可以控制模型输出的责任。我们的框架包括处理多模态数据和支持转换和生成的模块。URI扩展由URI、详细描述和URI嵌入组成,并支持模型输出的模糊检索。基于该框架,我们对PM信息流和URI嵌入进行了实验,实验结果证明了我们的系统具有良好的性能。
英文摘要:
Pre-trained models (PM) have achieved promising results in content generation. However, the space for human creativity and imagination is endless, and it is still unclear whether the existing models can meet the needs. Model-generated content faces uncontrollable responsibility and potential unethical problems. This paper presents the MetaAID 2.0 framework, dedicated to human-controllable PM information flow. Through the PM information flow, humans can autonomously control their creativity. Through the Universal Resource Identifier extension (URI-extension), the responsibility of the model outputs can be controlled. Our framework includes modules for handling multimodal data and supporting transformation and generation. The URI-extension consists of URI, detailed description, and URI embeddings, and supports fuzzy retrieval of model outputs. Based on this framework, we conduct experiments on PM information flow and URI embeddings, and the results demonstrate the good performance of our system.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。