实用好奇心:通过主动推断实现混合学习与优化的统一框架
Pragmatic Curiosity: A Unified Framework for Hybrid Learning and Optimization via Active Inference
AI总结:
本文提出Pragmatic Curiosity框架,通过主动推断统一处理混合学习与优化问题,减少决策风险,提升关键结果区域覆盖率,并联合学习预测与偏好结构。
摘要:
许多工程和科学工作流程依赖于昂贵的黑盒评估,需要在提高任务性能和减少不确定性之间做出顺序决策。贝叶斯优化(BO)和贝叶斯实验设计(BED)提供了强大的但各自独立的处理目标导向优化和信息寻求实验的方法,限制了在学习和优化本质上耦合的混合设置中的指导。我们提出Pragmatic Curiosity(PraC),一种通过主动推断实现混合学习与优化的统一框架。PraC通过在任务相关潜在符号的信息增益与基于预期遗憾的潜在势能之间进行权衡来评估候选查询。这种形式暴露了三个操作设计选择:应澄清哪个潜在量,如何将任务价值编码为遗憾,以及信息增益应如何与务实价值进行交换。我们将在三个渐进复杂性程度的领域中实例化PraC:具有固定全局符号和已知下游损失的决策导向烟雾监测,具有诱导局部符号和演变覆盖目标的定向主动搜索,以及在未知偏好下进行复合贝叶斯优化的层次化遗憾学习。在这些领域中,PraC减少了下游决策风险,提高了关键结果区域的覆盖率,并在不依赖任务特定阶段规则的情况下联合学习预测和偏好结构。
英文摘要:
Many engineering and scientific workflows rely on expensive black-box evaluations, requiring sequential decisions that must both improve task performance and reduce uncertainty. Bayesian optimization (BO) and Bayesian experimental design (BED) provide powerful but largely separate treatments of goal-directed optimization and information-seeking experimentation, leaving limited guidance for hybrid settings in which learning and optimization are intrinsically coupled. We propose Pragmatic Curiosity (PraC), a unified framework for hybrid learning and optimization via active inference. PraC evaluates candidate queries by trading information gain about a task-relevant latent symbol against an expected regret-based potential over outcomes. This formulation foregrounds three operational design choices: which latent quantity should be clarified, how task value is encoded as regret, and how strongly information gain should be exchanged against pragmatic regret. We instantiate PraC across three regimes of increasing complexity: decision-oriented monitoring with fixed global symbols and known downstream losses, targeted active search with induced local symbols and evolving coverage goals, and composite Bayesian optimization with hierarchical regret learning under unknown preferences. Across these regimes, PraC reduces downstream decision risk, improves coverage of critical outcome regions, and jointly learns predictive and preference structures without relying on task-specific staging rules.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。