Barriers to Discrete Reasoning with Transformers: A Survey Across Depth, Exactness, and Bandwidth
Transformer在离散推理中的障碍:深度、精确性与带宽的跨领域综述
机构 * Oracle AI
AI总结 本文综述了Transformer在离散推理任务中的理论限制,从电路复杂度、近似理论和通信复杂度三个角度分析了深度、精确性和带宽等障碍,并探讨了模型设计的改进方向。
Comments Accepted to EACL 2026 Main Conference