arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1306.3890cs.AI
收藏

大数据和智能的SP理论

Big data and the SP theory of intelligence

J. Gerard Wolff

摘要:

本文探讨了如何将“智能SP理论”及其在“SP机”上的实现,以其优势应用于大数据的管理和分析。SP系统-在文章中介绍并在其他地方充分描述-可能有助于克服大数据中的多样性问题:它有可能成为“表示和处理各种知识的通用框架”(UFK),有助于减少知识形式和格式的多样性以及处理它们的不同方式。它在无监督学习或数据结构发现、模式识别、自然语言的解析和生成、几种推理等方面都有优势。它适用于流数据的分析,有助于克服大数据中的速度问题。该系统工作的核心是信息的无损压缩:使大数据更小,减少存储和管理问题。在数据传输、计算能耗的大幅削减、更快的处理速度以及更小更轻的计算机方面,存在着巨大的经济潜力。该系统解决了大数据的准确性问题,有可能协助管理数据中的错误和不确定性。它有助于知识结构和推理过程的可视化。一个高并行、开源的SP机器版本将为世界各地的研究人员提供一种手段,让他们探索该系统可以做什么,并创建新的版本。

英文摘要:

This article is about how the "SP theory of intelligence" and its realisation in the "SP machine" may, with advantage, be applied to the management and analysis of big data. The SP system -- introduced in the article and fully described elsewhere -- may help to overcome the problem of variety in big data: it has potential as "a universal framework for the representation and processing of diverse kinds of knowledge" (UFK), helping to reduce the diversity of formalisms and formats for knowledge and the different ways in which they are processed. It has strengths in the unsupervised learning or discovery of structure in data, in pattern recognition, in the parsing and production of natural language, in several kinds of reasoning, and more. It lends itself to the analysis of streaming data, helping to overcome the problem of velocity in big data. Central in the workings of the system is lossless compression of information: making big data smaller and reducing problems of storage and management. There is potential for substantial economies in the transmission of data, for big cuts in the use of energy in computing, for faster processing, and for smaller and lighter computers. The system provides a handle on the problem of veracity in big data, with potential to assist in the management of errors and uncertainties in data. It lends itself to the visualisation of knowledge structures and inferential processes. A high-parallel, open-source version of the SP machine would provide a means for researchers everywhere to explore what can be done with the system and to create new versions of it.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑