arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2411.00852cs.LGcs.AI
收藏

EF-LLM:具备AI辅助自动化、增强稀疏预测与幻觉检测的能源预测LLM

EF-LLM: A Continual Learning-Based Framework for AI-Assisted Automation, Enhanced Sparse Prediction, and Hallucination Detection

Zihang Qiu, Jayashri Ravishankar, Anam Malik, Zhongju Wang, Renyou Xie

AI总结:

针对传统模型缺乏AI辅助且难以处理稀疏数据的问题,提出能源预测大模型EF-LLM,通过可更新LoRA、多通道架构及F-PEFT方法融合多模态数据实现稀疏预测,并首创基于多任务学习与ANOVA的幻觉检测机制,在多种能源预测场景中取得成功。

摘要:

准确的预测有助于实现能源系统的供需平衡,支持决策制定与调度。传统模型缺乏AI辅助自动化,依赖专家,产生高昂成本,且难以应对稀疏数据预测。为应对这些挑战,我们提出了能源预测大型语言模型(EF-LLM),它融合领域知识和时间数据进行时间序列预测,同时支持预测前操作和预测后决策支持。EF-LLM的人机交互能力降低了预测任务的门槛,减少了对额外专家参与的需求。为此,我们提出了一种具有可更新LoRA的持续学习方法和用于对齐异构多模态数据的多通道架构,使EF-LLM能够持续学习异构多模态知识。此外,EF-LLM通过处理多模态数据的能力,实现了在稀疏数据条件下的准确预测。为此,我们提出了融合参数高效微调(F-PEFT)方法,以有效利用时间序列数据和文本。EF-LLM也是首个能够检测幻觉并量化其发生率的特定能源LLM,这是通过多任务学习、语义相似度分析和ANOVA实现的。我们在负荷、光伏和风电预测的能源预测场景中取得了成功。

英文摘要:

Accurate prediction helps achieve supply-demand balance in energy systems,thereby supporting operational decision-making and scheduling.Traditional models,which lack AI-assisted automation,often rely heavily on expert knowledge,incur high labor costs,and perform poorly under sparse-data conditions.To address these challenges,this work proposes an Energy Forecasting Large Language Model (EF-LLM),which integrates domain knowledge and temporal data for time-series forecasting while supporting both pre-forecast operations and post-forecast decision-making.EF-LLM's human-artificial intelligence (AI) interaction capabilities further lower the entry barrier for forecasting tasks and reduce the need for additional expert involvement.To support these functions, a continual learning framework with updatable Low-Rank Adaptation (LoRA) and a multi-channel architecture is developed to align heterogeneous multimodal data, enabling EF-LLM to continuously acquire and adapt multimodal knowledge.In addition,EF-LLM improves prediction accuracy under sparse-data conditions by leveraging its ability to process and fuse multimodal information.A Fusion Parameter-Efficient Fine-Tuning (F-PEFT) method is further introduced to effectively exploit both time-series data and textual information.EF-LLM is also the first energy-specific LLM to detect hallucinations and quantify their occurrence rate, achieved via multi-task learning and semantic similarity analysis.This work has achieved success in energy prediction scenarios for load, PV, and wind power forecast.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑