arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.11706cs.CVcs.AIcs.RO
收藏

基于大语言模型的农业模拟环境3D场景生成

LLM-Driven 3D Scene Generation of Agricultural Simulation Environments

Faculty of Applied Engineering – Dept. of Electronics and ICT, University of Antwerp(应用工程学院——电子与信息通信技术系,安特卫普大学);Flanders Make Strategic Research Centre(弗拉芒制造战略研究中心)

Arafa Yoncalik, Wouter Jansen, Nico Huebel, Mohammad Hasan Rahmani, Jan Steckel

AI总结:

本文提出基于多LLM流水线的农业模拟环境3D场景生成方法,通过模块化设计提升领域特定场景生成的可靠性与精度。

摘要:

程序化生成技术在3D渲染引擎中已革新了复杂环境的创建,减少了对手动设计的依赖。最近使用大语言模型(LLMs)进行3D场景生成的方法显示出潜力,但通常缺乏领域特定的推理、验证机制和模块化设计。这些限制导致控制能力下降和可扩展性差。本文研究了利用LLMs从自然语言提示生成农业合成模拟环境的方法,特别是为了解决缺乏领域特定推理、验证机制和模块化设计的局限性。开发了一种模块化的多LLM流水线,整合了3D资产检索、领域知识注入和代码生成,用于Unreal渲染引擎的API。这产生了基于输入提示和领域知识的3D环境,具有逼真的种植布局和环境上下文。为了提高准确性和可扩展性,系统采用混合策略,结合LLM优化技术,如少样本提示、检索增强生成(RAG)、微调和验证。不同于单一模型,模块化架构使系统能够处理结构化数据、中间验证和灵活扩展。系统使用结构化提示和语义准确性指标进行评估。用户研究评估了真实感和熟悉度,与真实世界图像相比,专家比较显示在手动场景设计上节省了显著时间。结果证实了多LLM流水线在自动化领域特定3D场景生成中的有效性,具有改进的可靠性和精度。未来的工作将探索扩展资产层次结构、整合实时生成,并将该流水线适应到农业以外的其他模拟领域。

英文摘要:

Procedural generation techniques in 3D rendering engines have revolutionized the creation of complex environments, reducing reliance on manual design. Recent approaches using Large Language Models (LLMs) for 3D scene generation show promise but often lack domain-specific reasoning, verification mechanisms, and modular design. These limitations lead to reduced control and poor scalability. This paper investigates the use of LLMs to generate agricultural synthetic simulation environments from natural language prompts, specifically to address the limitations of lacking domain-specific reasoning, verification mechanisms, and modular design. A modular multi-LLM pipeline was developed, integrating 3D asset retrieval, domain knowledge injection, and code generation for the Unreal rendering engine using its API. This results in a 3D environment with realistic planting layouts and environmental context, all based on the input prompt and the domain knowledge. To enhance accuracy and scalability, the system employs a hybrid strategy combining LLM optimization techniques such as few-shot prompting, Retrieval-Augmented Generation (RAG), finetuning, and validation. Unlike monolithic models, the modular architecture enables structured data handling, intermediate verification, and flexible expansion. The system was evaluated using structured prompts and semantic accuracy metrics. A user study assessed realism and familiarity against real-world images, while an expert comparison demonstrated significant time savings over manual scene design. The results confirm the effectiveness of multi-LLM pipelines in automating domain-specific 3D scene generation with improved reliability and precision. Future work will explore expanding the asset hierarchy, incorporating real-time generation, and adapting the pipeline to other simulation domains beyond agriculture.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑