时间和数据的价值
Time and the Value of Data
摘要:
管理人员通常认为,收集更多的数据将不断提高其机器学习模型的准确性。然而,我们在本文中认为,当数据随着时间的推移失去相关性时,最好收集有限数量的最近数据,而不是保持无限的旧数据(不太相关)。此外,我们认为,通过包括较旧的数据集来增加数据存量实际上可能会损害模型的准确性。可以预期的是,模型的准确性通过增加数据流(定义为数据汇集率)来提高;然而,它需要在更频繁地刷新或重新训练机器学习模型方面进行其他权衡。利用这些结果,我们研究了机器学习模型所创造的商业价值如何随着数据的变化而变化,以及数据存量何时建立了可持续的竞争优势。我们认为,数据的时间依赖性削弱了数据存量所创造的进入壁垒。因此,一个拥有有限(但足够)的最新数据的竞争公司可以开发出更准确的模型。这一结果,再加上较旧的数据集可能会降低模型的准确性,表明所创造的业务价值不会随着可用数据的存量而扩展,除非公司从其数据存储库中卸载不太相关的数据。因此,公司的增长政策应该在历史数据存量和新数据流之间保持平衡。我们用实验来补充我们的理论结果。在实验中,我们根据经验测量了在不同时间段的数据集上训练的下一个单词预测模型的准确性损失。我们的实证测量证实了价值随时间下降的经济意义。例如,100 MB的文本数据在七年后变得与50 MB的当前数据一样有价值,用于下一个单词预测任务。
英文摘要:
Managers often believe that collecting more data will continually improve the accuracy of their machine learning models. However, we argue in this paper that when data lose relevance over time, it may be optimal to collect a limited amount of recent data instead of keeping around an infinite supply of older (less relevant) data. In addition, we argue that increasing the stock of data by including older datasets may, in fact, damage the model's accuracy. Expectedly, the model's accuracy improves by increasing the flow of data (defined as data collection rate); however, it requires other tradeoffs in terms of refreshing or retraining machine learning models more frequently. Using these results, we investigate how the business value created by machine learning models scales with data and when the stock of data establishes a sustainable competitive advantage. We argue that data's time-dependency weakens the barrier to entry that the stock of data creates. As a result, a competing firm equipped with a limited (yet sufficient) amount of recent data can develop more accurate models. This result, coupled with the fact that older datasets may deteriorate models' accuracy, suggests that created business value doesn't scale with the stock of available data unless the firm offloads less relevant data from its data repository. Consequently, a firm's growth policy should incorporate a balance between the stock of historical data and the flow of new data. We complement our theoretical results with an experiment. In the experiment, we empirically measure the loss in the accuracy of a next word prediction model trained on datasets from various time periods. Our empirical measurements confirm the economic significance of the value decline over time. For example, 100MB of text data, after seven years, becomes as valuable as 50MB of current data for the next word prediction task.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。