arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2607.02835cs.GT
收藏

一种用于为时间不一致代理设计干预措施的可处理连续时间模型

A Tractable Continuous-Time Model for Designing Interventions for Time-Inconsistent Agents

NTT Human Informatics Laboratories(NTT人类信息学实验室);NTT Communication Science Laboratories(NTT通信科学实验室);NTT Network Service Systems Laboratories(NTT网络服务系统实验室)

Yasunori Akagi, Hideaki Kim, Daichi Fushihara, Ryosuke Nakahama, Hiroyasu Miyazaki, Takeshi Kurashima

AI总结:

研究为时间不一致代理在有期限约束的基于进度的任务中设计干预措施,提出可处理连续时间模型,分析代理行为并研究最优目标设定与奖励调度问题,给出结果及与离散时间模型的差异。

摘要:

为时间不一致代理设计有效目标和奖励是长期任务核心问题。本文开发连续时间模型分析和设计干预措施,证明广义双曲贴现下轨迹有简洁解析表示,刻画代理任务完成等情况,研究最优目标设定和奖励调度问题,结果提供干预设计框架并阐明与离散模型差异。

英文摘要:

Designing effective goals and rewards for time-inconsistent agents is a central problem in many long-term tasks, such as learning, exercise, work, and project completion. An agent may initially plan to complete a task, but later abandon it because, under non-exponential discounting, the perceived trade-off between immediate effort and delayed reward changes over time. This paper develops a tractable continuous-time model for analyzing and designing interventions for such agents in deadline-constrained progress-based tasks. In the model, an agent repeatedly chooses a future progress trajectory that minimizes perceived cost and then follows its infinitesimal initial direction. Although this leads to a continuous-time dynamic behavior defined through a variational problem, we show that the resulting trajectory admits a concise analytical representation under generalized hyperbolic discounting, a broad class of discount functions that includes exponential and hyperbolic discounting as special cases. Using this representation, we characterize when the agent completes the task, abandons it immediately, or exhibits time-inconsistent abandonment after making partial progress. We then study two intervention design problems: optimal goal setting and optimal reward scheduling. For goal setting, we derive optimal goals both when exploitative rewards are allowed and when they are prohibited, and we identify conditions under which exploitative rewards are ineffective. For reward scheduling, we show that, for a fixed number of stages, equal-length periods and equal rewards are optimal, and that finer reward splitting monotonically improves final progress up to a discount-independent limit. These results provide a continuous-time framework for intervention design for time-inconsistent agents and clarify how optimal interventions differ from those in existing discrete-time models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑