arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.00848cs.CV
收藏

Eating Smart:基于 Grounding DINO 的智能饮食助手应用推进健康信息学

Eating Smart: Advancing Health Informatics with the Grounding DINO based Dietary Assistant App

Al Akhawayn University(阿卡韦恩大学)

Abdelilah Nossair, Hamza El Housni

AI总结:

本研究开发了基于 Grounding DINO 模型的智能饮食助手应用,通过零样本食物图像检测与多平台集成,为糖尿病患者等提供个性化饮食建议和实时扫描,助力健康管理与生活方式优化。

摘要:

智能饮食助手利用机器学习提供个性化饮食建议,专注于糖尿病等疾病患者。该应用利用 Grounding DINO 模型,该模型结合文本编码器和图像骨干网络,无需标注数据集即可增强食物项目检测。在 COCO 数据集上 AP 得分为 52.5,该模型在真实场景中展现出高准确度,利用注意力机制根据用户提供的标签和图像精确识别物体。该应用使用 React Native 和 TypeScript 开发,在多平台无缝运行,并集成自托管 PostgreSQL 数据库,确保数据完整性并增强用户隐私。关键功能包括个性化营养档案、实时食物扫描和健康洞察,促进明智的饮食选择以进行健康管理和生活方式优化。未来发展旨在集成可穿戴技术以提供更量身定制的健康建议。

英文摘要:

The Smart Dietary Assistant utilizes Machine Learning to provide personalized dietary advice, focusing on users with conditions like diabetes. This app leverages the Grounding DINO model, which combines a text encoder and image backbone to enhance food item detection without requiring a labeled dataset. With an AP score of 52.5 on the COCO dataset, the model demonstrates high accuracy in real-world scenarios, utilizing attention mechanisms to precisely recognize objects based on user-provided labels and images. Developed using React Native and TypeScript, the app operates seamlessly across multiple platforms and integrates a self-hosted PostgreSQL database, ensuring data integrity and enhancing user privacy. Key functionalities include personalized nutrition profiles, real-time food scanning, and health insights, facilitating informed dietary choices for health management and lifestyle optimization. Future developments aim to integrate wearable technologies for more tailored health recommendations. Keywords: Food Image Recognition, Machine Learning in Nutrition, Zero-Shot Object Detection

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑