Oitijjo-3D:从街景图像快速进行3D遗产重建的生成式AI框架
Oitijjo-3D: Generative AI Framework for Rapid 3D Heritage Reconstruction from Street View Imagery
AI总结:
本文提出Oitijjo-3D,一个免费的生成式AI框架,利用公开街景图像通过多模态推理与神经图像转3D生成技术,快速重建文化遗产的3D模型,显著降低经济与技术门槛。
摘要:
孟加拉国的文化遗产修复面临资源有限和技术专长稀缺的双重挑战。传统的3D数字化方法(如摄影测量或LiDAR扫描)需要昂贵的硬件、专业操作人员和广泛的现场访问,这在发展中国家的背景下通常是不可行的。因此,从Paharpur佛教寺院到Ahsan Manzil,孟加拉国的许多建筑瑰宝仍然面临衰败的危险,且无法以数字形式访问。本文介绍了Oitijjo-3D,这是一个免费的生成式AI框架,旨在实现3D文化保护的普及。通过使用公开的Google Street View图像,Oitijjo-3D通过两阶段流程重建遗产结构的忠实3D模型:利用Gemini 2.5 Flash Image进行多模态视觉推理以实现结构-纹理合成,以及通过Hexagen进行神经图像到3D生成以恢复几何结构。该系统在几秒钟内生成照片级真实且度量一致的重建结果,与传统的Structure-from-Motion流程相比实现了显著加速,且无需任何专用硬件或专家监督。在Ahsan Manzil、Choto Sona Mosque和Paharpur等地标上的实验表明,Oitijjo-3D在保持视觉和结构保真度的同时,大幅降低了经济和技术门槛。通过将开放图像转化为数字遗产,这项工作将保护重新定义为资源有限国家中由社区驱动、AI辅助的文化延续行为。
英文摘要:
Cultural heritage restoration in Bangladesh faces a dual challenge of limited resources and scarce technical expertise. Traditional 3D digitization methods, such as photogrammetry or LiDAR scanning, require expensive hardware, expert operators, and extensive on-site access, which are often infeasible in developing contexts. As a result, many of Bangladesh's architectural treasures, from the Paharpur Buddhist Monastery to Ahsan Manzil, remain vulnerable to decay and inaccessible in digital form. This paper introduces Oitijjo-3D, a cost-free generative AI framework that democratizes 3D cultural preservation. By using publicly available Google Street View imagery, Oitijjo-3D reconstructs faithful 3D models of heritage structures through a two-stage pipeline - multimodal visual reasoning with Gemini 2.5 Flash Image for structure-texture synthesis, and neural image-to-3D generation through Hexagen for geometry recovery. The system produces photorealistic, metrically coherent reconstructions in seconds, achieving significant speedups compared to conventional Structure-from-Motion pipelines, without requiring any specialized hardware or expert supervision. Experiments on landmarks such as Ahsan Manzil, Choto Sona Mosque, and Paharpur demonstrate that Oitijjo-3D preserves both visual and structural fidelity while drastically lowering economic and technical barriers. By turning open imagery into digital heritage, this work reframes preservation as a community-driven, AI-assisted act of cultural continuity for resource-limited nations.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。