FlexFlood:高效可更新的学习型多维索引
FlexFlood: Efficiently Updatable Learned Multi-dimensional Index
AI总结:
针对数据更新导致分布倾斜进而降低搜索性能的问题,提出学习型多维索引FlexFlood,通过部分重建内部结构并保证更新时间复杂度,在倾斜数据下搜索速度提升达10倍。
摘要:
学习型多维索引是一种利用机器学习模型理解数据分布,从而高效回答多维正交查询的数据结构。现有问题之一是,当数据结构中存储的数据因更新操作而变得倾斜时,搜索性能会显著下降。为克服此问题,我们提出了FlexFlood,即Flood的灵活变体。当数据分布变得倾斜时,FlexFlood会部分重建其内部结构。此外,FlexFlood是首个保证更新操作时间复杂度的学习型多维索引。通过使用人工和真实数据的实验,我们证明在数据分布变得倾斜时,其搜索性能比现有方法快达10倍。我们还发现,部分重建所需时间仅约为朴素数据更新的两倍。
英文摘要:
A learned multi-dimensional index is a data structure that efficiently answers multi-dimensional orthogonal queries by understanding the data distribution using machine learning models. One of the existing problems is that the search performance significantly decreases when the distribution of data stored in the data structure becomes skewed due to update operations. To overcome this problem, we propose FlexFlood, a flexible variant of Flood. FlexFlood partially reconstructs the internal structure when the data distribution becomes skewed. Moreover, FlexFlood is the first learned multi-dimensional index that guarantees the time complexity of the update operation. Through experiments using both artificial and real-world data, we demonstrate that the search performance when the data distribution becomes skewed is up to 10 times faster than existing methods. We also found that partial reconstruction takes only about twice as much time as naive data updating.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。