Humboldt:元数据驱动的可扩展数据发现
Humboldt: Metadata-Driven Extensible Data Discovery
AI总结:
Humboldt框架通过解耦元数据源与UI实现,基于声明性规范自动生成交互式数据发现界面,解决元数据更新导致UI重复开发的问题,提升可扩展性。
摘要:
数据发现对于数据管理和分析至关重要,并且可以通过更好地利用元数据而受益。例如,用户可能希望使用诸如“查找由Alex创建并由Mike认可且包含销售数字的表”之类的查询来搜索数据。他们还可能希望了解所查看的数据与其他数据的关系、其谱系,或其上游数据集的质量和合规性,这些都属于元数据。然而,通过交互式用户界面(UI)有效呈现元数据以增强数据发现面临挑战。每次更新元数据源(或提供者)时不断重新设计UI会消耗大量开发资源,并且缺乏可扩展性和可扩展性。为此,我们引入了Humboldt,这是一个新框架,使交互式数据系统能够有效利用元数据进行数据发现,并快速演进其UI以支持元数据变化。Humboldt将元数据源与支持使用元数据字段进行搜索和数据集可视化的数据发现UI的实现解耦。它根据声明性规范自动生成交互式数据发现界面,避免了昂贵的特定于元数据的(重新)实现。
英文摘要:
Data discovery is crucial for data management and analysis and can benefit from better utilization of metadata. For example, users may want to search data using queries like ``find the tables created by Alex and endorsed by Mike that contain sales numbers.'' They may also want to see how the data they view relates to other data, its lineage, or the quality and compliance of its upstream datasets, all metadata. Yet, effectively surfacing metadata through interactive user interfaces (UIs) to augment data discovery poses challenges. Constantly revamping UIs with each update to metadata sources (or providers) consumes significant development resources and lacks scalability and extensibility. In response, we introduce Humboldt, a new framework enabling interactive data systems to effectively leverage metadata for data discovery and rapidly evolve their UIs to support metadata changes. Humboldt decouples metadata sources from the implementation of data discovery UIs that support search and dataset visualization using metadata fields. It automatically generates interactive data discovery interfaces from declarative specifications, avoiding costly metadata-specific (re)implementations.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。