一类信息传递问题的回归解法
A Regression Approach to Certain Information Transmission Problems
摘要:
利用广义互信息的性能指标,研究了在独立同分布高斯码本和最近邻译码规则下的通用信息传输模型。当编码器和解码器知道统计信道模型时,发现最优信道输出处理函数是条件期望算子,从而暗示了回归(机器学习中的经典主题)对于该模型的潜在作用。在不利用统计信道模型的情况下,建立了受机器学习原理启发的问题公式,并引入了合适的性能度量。提出了一种数据驱动的推理算法来解决该问题,并通过数值实验验证了算法的有效性。更一般的信息传输模型的扩展也进行了讨论。
英文摘要:
A general information transmission model, under independent and identically distributed Gaussian codebook and nearest neighbor decoding rule with processed channel output, is investigated using the performance metric of generalized mutual information. When the encoder and the decoder know the statistical channel model, it is found that the optimal channel output processing function is the conditional expectation operator, thus hinting a potential role of regression, a classical topic in machine learning, for this model. Without utilizing the statistical channel model, a problem formulation inspired by machine learning principles is established, with suitable performance metrics introduced. A data-driven inference algorithm is proposed to solve the problem, and the effectiveness of the algorithm is validated via numerical experiments. Extensions to more general information transmission models are also discussed.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。