Ducho 2.0:迈向更先进的推荐中多模态特征提取统一框架
Ducho 2.0: Towards a More Up-to-Date Unified Framework for the Extraction of Multimodal Features in Recommendation
AI总结:
Ducho 2.0 是一个更新版的多模态特征提取统一框架,支持自定义模型和多模态大模型,提供完整推荐流水线,便于基准测试。
摘要:
在这项工作中,我们介绍了 Ducho 2.0,这是我们框架的最新稳定版本。与 Ducho 不同,Ducho 2.0 通过定义和导入针对特定任务和数据集微调的自定义提取模型,提供了更个性化的用户体验。此外,新版本能够通过多模态设计的大型模型提取和处理特征。值得注意的是,所有这些新功能都得到了优化数据加载和本地内存存储的支持。为了展示 Ducho 2.0 的能力,我们演示了一个完整的多模态推荐流水线,从提取/处理到最终推荐。我们的想法是为从业者和经验丰富的学者提供一个即用型工具,将其置于任何多模态推荐框架之上,使他们能够进行广泛的基准分析。所有材料可在以下网址获取:\url{https://github.com/sisinflab/Ducho}。
英文摘要:
In this work, we introduce Ducho 2.0, the latest stable version of our framework. Differently from Ducho, Ducho 2.0 offers a more personalized user experience with the definition and import of custom extraction models fine-tuned on specific tasks and datasets. Moreover, the new version is capable of extracting and processing features through multimodal-by-design large models. Notably, all these new features are supported by optimized data loading and storing to the local memory. To showcase the capabilities of Ducho 2.0, we demonstrate a complete multimodal recommendation pipeline, from the extraction/processing to the final recommendation. The idea is to provide practitioners and experienced scholars with a ready-to-use tool that, put on top of any multimodal recommendation framework, may permit them to run extensive benchmarking analyses. All materials are accessible at: \url{https://github.com/sisinflab/Ducho}.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。