MacroBase：在快速数据中优先考虑注意力
MacroBase: Prioritizing Attention in Fast Data
摘要：
随着数据量的不断增加，人工检查变得越来越难以为继。作为回应，我们提出了MacroBase，这是一个数据分析引擎，它在大容量快速数据流中优先考虑最终用户的注意力。MacroBase能够进行高效、准确和模块化的分析，突出和聚合重要和不寻常的行为，充当快速数据的搜索引擎。MacroBase能够通过优化解释和分类任务的组合，并利用新的水库采样器和专门用于快速数据流的重量级草图，提供比替代方案高出一个数量级的加速。因此，MacroBase在单个核心上以高达每秒2 M事件/查询的速度提供准确的结果。该系统在生产中取得了有意义的成果，包括在一家监控数十万辆汽车的远程信息处理公司。
英文摘要：
As data volumes continue to rise, manual inspection is becoming increasingly untenable. In response, we present MacroBase, a data analytics engine that prioritizes end-user attention in high-volume fast data streams. MacroBase enables efficient, accurate, and modular analyses that highlight and aggregate important and unusual behavior, acting as a search engine for fast data. MacroBase is able to deliver order-of-magnitude speedups over alternatives by optimizing the combination of explanation and classification tasks and by leveraging a new reservoir sampler and heavy-hitters sketch specialized for fast data streams. As a result, MacroBase delivers accurate results at speeds of up to 2M events per second per query on a single core. The system has delivered meaningful results in production, including at a telematics company monitoring hundreds of thousands of vehicles.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
