AromaGen:基于多模态语言模型的交互式丰富嗅觉体验生成
AromaGen: Interactive Generation of Rich Olfactory Experiences with Multimodal Language Models
AI总结:
AromaGen利用多模态语言模型实现基于文本和视觉输入的实时嗅觉生成,通过迭代优化提升嗅觉混合物的自然度,达到与真实食物香气相似的水平。
摘要:
气味与食物、记忆和社会体验的深刻联系长期以来激励研究者将嗅觉引入交互系统。然而,大多数嗅觉界面仍局限于固定香氛胶囊和预定义生成模式,大规模嗅觉数据集的匮乏进一步限制了基于AI的方法。我们提出了AromaGen,一种由多模态大语言模型驱动的可穿戴接口,能够从自由形式文本或视觉输入中实时生成通用芳香物。AromaGen通过潜藏的嗅觉知识将语义输入映射到由12种精心挑选的基础嗅觉物质组成的结构化混合物,并通过佩戴在颈部的释放器释放。用户可通过自然语言反馈通过上下文学习迭代优化生成的香气。通过受控的用户研究(N=26),AromaGen在零样本生成中与人工编写的混合物相匹配,并在迭代优化后显著超越,达到中位相似度8/10与真实食物香气,将感知到的不自然性降低到与真实食物相当的水平。AromaGen是实现现实世界交互式香气生成的一步,为通信、福祉和沉浸式技术开辟了新的可能性。
英文摘要:
Smell's connections with food, memory, and social experience have motivated researchers to bring olfaction into interactive systems. Multimodal AI opens new possibilities for generating smells from natural language, yet it remains unclear whether pretrained models encode sufficient olfactory knowledge to translate language into perceptible compositions. We present AromaGen, an AI-powered 12-channel wearable olfactory system that maps free-form natural-language descriptions to 12 base odorants selected to cover a semantically derived olfactory space, while supporting iterative refinement through natural-language feedback. In a between-subjects study (N=60) across 50 real-world benchmark smells, participants distinguished AromaGen-generated target smells above chance in a three-alternative forced-choice task, with retrieval-augmented AI composition performing comparably to human-expert composition and zero-shot AI composition. Natural-language feedback significantly improved the perceived similarity of both AI- and human-expert compositions. Our findings demonstrate the feasibility of using pretrained multimodal AI, with human aroma composition data, to generate perceptible olfactory experiences from natural language.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。