Translating configurations between different network devices is a common yet challenging task in modern network operations. This challenge arises in typical scenarios such as replacing obsolete hardware and adapting configurations to emerging paradigms like Software Defined Networking (SDN) and Network Function Virtualization (NFV). Engineers need to thoroughly understand both source and target configuration models, which requires considerable effort due to the complexity and evolving nature of these specifications. To promote automation in network configuration translation, we propose INTA, an intent-based translation framework that leverages Large Language Model (LLM) agents. The key idea of INTA is to use configuration intent as an intermediate representation for translation. It first employs LLMs to decompose configuration files and extract fine-grained intents for each configuration fragment. These intents are then used to retrieve relevant manuals of the target device. Guided by a syntax checker, INTA incrementally generates target configurations. The translated configurations are further verified and refined for semantic consistency. We implement INTA and evaluate it on real-world configuration datasets from the industry. Our approach outperforms state-of-the-art methods in translation accuracy and exhibits strong generalizability. INTA achieves an accuracy of 98.15% in terms of both syntactic and view correctness, and a command recall rate of 84.72% for the target configuration. The semantic consistency report of the translated configuration further demonstrates its practical value in real-world network operations.
Operationalising Multi-Dimensional Evaluation for Conversational Agents: A Scalable, Governed Pipeline with Selective Re-evaluation and Model Benchmarking
A Reproducible Semantic Benchmark for Multivendor DSM-to-CLI Translation
Federal University of Rio Grande do Sul (UFRGS)(里约格朗德杜斯·鲁伊斯联邦大学);AI Horizon Labs(AI地平线实验室);PPGES -- Federal University of Pampa (UNIPAMPA)(PGEs -- 皮亚蒙特联邦大学)
Towards Reliable Machine Translation: Scaling LLMs for Critical Error Detection and Safety
Rheinische Friedrich-Wilhelms-Universität Bonn, Bonn, Germany(莱茵-威斯巴登大学波恩分校);Fraunhofer IAIS, Sankt Augustin, Germany(弗劳恩霍夫人工智能研究所);Lamarr Institute for Machine Learning(拉马尔人工智能与机器学习研究所)
ORION: Intent-Aware Orchestration in Open RAN for SLA-Driven Network Management
National Telecommunications Institute (INATEL)(国家电信研究所);University of Vale do Rio dos Sinos (UNISINOS)(里奥多斯西诺斯谷大学);Federal Technological University of Paraná (UFTPR)(巴拉那联邦技术大学)