arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2204.04347cs.CLcs.AI
收藏

论Karaka框架在多模态Grounding中的重要性

On the Importance of Karaka Framework in Multi-modal Grounding

IIIT Hyderabad(印度海得拉巴国际信息技术学院)

Sai Kiran Gorthi, Radhika Mamidi

摘要:

计算Paninian语法模型有助于将自然语言表达式解码为一系列修饰符-修饰关系,因此与通常的Stanford依赖关系相比,有助于识别更接近语言(上下文)语义的依赖关系。然而,这种CPG依赖方案的重要性尚未在多模态视觉和语言应用的背景下进行研究。在IIIT海得拉巴,我们计划进行一项新的研究,以探索CPG框架在视觉语言导航任务设置中的潜在优势和劣势,这是一种流行且具有挑战性的多模态接地任务。

英文摘要:

Computational Paninian Grammar model helps in decoding a natural language expression as a series of modifier-modified relations and therefore facilitates in identifying dependency relations closer to language (context) semantics compared to the usual Stanford dependency relations. However, the importance of this CPG dependency scheme has not been studied in the context of multi-modal vision and language applications. At IIIT Hyderabad, we plan to perform a novel study to explore the potential advantages and disadvantages of CPG framework in a vision-language navigation task setting, a popular and challenging multi-modal grounding task.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑