一种用于为时间不一致代理设计干预措施的可处理连续时间模型
A Tractable Continuous-Time Model for Designing Interventions for Time-Inconsistent Agents
AI总结:
研究为时间不一致代理在有期限约束的基于进度的任务中设计干预措施,提出可处理连续时间模型,分析代理行为并研究最优目标设定与奖励调度问题,给出结果及与离散时间模型的差异。
摘要:
为时间不一致代理设计有效目标和奖励是长期任务核心问题。本文开发连续时间模型分析和设计干预措施,证明广义双曲贴现下轨迹有简洁解析表示,刻画代理任务完成等情况,研究最优目标设定和奖励调度问题,结果提供干预设计框架并阐明与离散模型差异。
英文摘要:
Designing effective goals and rewards for time-inconsistent agents is a central problem in many long-term tasks, such as learning, exercise, work, and project completion. An agent may initially plan to complete a task, but later abandon it because, under non-exponential discounting, the perceived trade-off between immediate effort and delayed reward changes over time. This paper develops a tractable continuous-time model for analyzing and designing interventions for such agents in deadline-constrained progress-based tasks. In the model, an agent repeatedly chooses a future progress trajectory that minimizes perceived cost and then follows its infinitesimal initial direction. Although this leads to a continuous-time dynamic behavior defined through a variational problem, we show that the resulting trajectory admits a concise analytical representation under generalized hyperbolic discounting, a broad class of discount functions that includes exponential and hyperbolic discounting as special cases. Using this representation, we characterize when the agent completes the task, abandons it immediately, or exhibits time-inconsistent abandonment after making partial progress. We then study two intervention design problems: optimal goal setting and optimal reward scheduling. For goal setting, we derive optimal goals both when exploitative rewards are allowed and when they are prohibited, and we identify conditions under which exploitative rewards are ineffective. For reward scheduling, we show that, for a fixed number of stages, equal-length periods and equal rewards are optimal, and that finer reward splitting monotonically improves final progress up to a discount-independent limit. These results provide a continuous-time framework for intervention design for time-inconsistent agents and clarify how optimal interventions differ from those in existing discrete-time models.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。