arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2009.07162cs.CL
收藏

电子商业产品多模态联合属性预测与价值提取

Multimodal Joint Attribute Prediction and Value Extraction for E-commerce Product

JD AI Research(京东人工智能研究院)

Tiangang Zhu, Yue Wang, Haoran Li, Youzheng Wu, Xiaodong He, Bowen Zhou

摘要:

产品属性值在很多电子商业场景中都是必不可少的,比如客服机器人、产品推荐、产品检索等。而在现实世界中,产品的属性值往往是不完整的,并随着时间的推移而变化,这极大地阻碍了实际应用。在本文中,我们提出了一种多模态方法,以联合预测产品属性和提取价值的文本产品描述的帮助下的产品图像。我们认为,产品属性和价值是高度相关的,例如,在给定产品属性的条件下,将更容易提取值。因此,我们从多个方面对属性和值之间的相互作用联合建模属性预测和值提取任务。此外,产品形象对我们的任务有不同的产品属性和价值观的影响。因此,我们选择性地从产品图像中提取有用的视觉信息来增强我们的模型。我们标注了一个包含87,194个实例的多模态产品属性值数据集,该数据集上的实验结果表明,显式建模属性和值之间的关系有助于我们的方法建立它们之间的对应关系,并且有选择地利用视觉产品信息是必要的任务。我们的代码和数据集将向公众发布。

英文摘要:

Product attribute values are essential in many e-commerce scenarios, such as customer service robots, product recommendations, and product retrieval. While in the real world, the attribute values of a product are usually incomplete and vary over time, which greatly hinders the practical applications. In this paper, we propose a multimodal method to jointly predict product attributes and extract values from textual product descriptions with the help of the product images. We argue that product attributes and values are highly correlated, e.g., it will be easier to extract the values on condition that the product attributes are given. Thus, we jointly model the attribute prediction and value extraction tasks from multiple aspects towards the interactions between attributes and values. Moreover, product images have distinct effects on our tasks for different product attributes and values. Thus, we selectively draw useful visual information from product images to enhance our model. We annotate a multimodal product attribute value dataset that contains 87,194 instances, and the experimental results on this dataset demonstrate that explicitly modeling the relationship between attributes and values facilitates our method to establish the correspondence between them, and selectively utilizing visual product information is necessary for the task. Our code and dataset will be released to the public.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑