arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.04503cs.IR
收藏

Ducho 2.0:迈向更先进的推荐中多模态特征提取统一框架

Ducho 2.0: Towards a More Up-to-Date Unified Framework for the Extraction of Multimodal Features in Recommendation

Matteo Attimonelli, Danilo Danese, Daniele Malitesta, Claudio Pomo, Giuseppe Gassi, Tommaso Di Noia

AI总结:

Ducho 2.0 是一个更新版的多模态特征提取统一框架,支持自定义模型和多模态大模型,提供完整推荐流水线,便于基准测试。

摘要:

在这项工作中,我们介绍了 Ducho 2.0,这是我们框架的最新稳定版本。与 Ducho 不同,Ducho 2.0 通过定义和导入针对特定任务和数据集微调的自定义提取模型,提供了更个性化的用户体验。此外,新版本能够通过多模态设计的大型模型提取和处理特征。值得注意的是,所有这些新功能都得到了优化数据加载和本地内存存储的支持。为了展示 Ducho 2.0 的能力,我们演示了一个完整的多模态推荐流水线,从提取/处理到最终推荐。我们的想法是为从业者和经验丰富的学者提供一个即用型工具,将其置于任何多模态推荐框架之上,使他们能够进行广泛的基准分析。所有材料可在以下网址获取:\url{https://github.com/sisinflab/Ducho}。

英文摘要:

In this work, we introduce Ducho 2.0, the latest stable version of our framework. Differently from Ducho, Ducho 2.0 offers a more personalized user experience with the definition and import of custom extraction models fine-tuned on specific tasks and datasets. Moreover, the new version is capable of extracting and processing features through multimodal-by-design large models. Notably, all these new features are supported by optimized data loading and storing to the local memory. To showcase the capabilities of Ducho 2.0, we demonstrate a complete multimodal recommendation pipeline, from the extraction/processing to the final recommendation. The idea is to provide practitioners and experienced scholars with a ready-to-use tool that, put on top of any multimodal recommendation framework, may permit them to run extensive benchmarking analyses. All materials are accessible at: \url{https://github.com/sisinflab/Ducho}.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑