arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1403.2656cs.DLcs.CY
收藏

使用定制实验室信息管理系统处理光伏研究机构中的大型复杂数据

Handling Large and Complex Data in a Photovoltaic Research Institution Using a Custom Laboratory Information Management System

Robert R. White, Kristin Munch

摘要:

25年前,台式计算机开始在科学实验室中变得无处不在。研究人员对它在单个系统上既能控制仪器又能获取数据的能力感到高兴,但他们并不完全满意。他们认为,如果他们有更多的数据,他们就可以更快地获得数据,那么他们的知识往往存在差距。计算机技术的发展符合摩尔定律,满足了这些愿望;然而,这些改进最近对研究人员来说既有好处也有坏处。计算机现在能够产生包含兆兆字节信息的高速数据流;这种能力的发展速度比上个世纪想象的要快。处理大型科学数据集的软件没有跟上。有多少信息可能因意外的管理不善而丢失,或有多少发现因数据过载而错过,这是现在至关重要的问题。在大多数科学学科中,一项重要的新任务是开发解决这些问题的方法,并创建能够处理大型数据集的软件,同时考虑到可扩展性。该软件必须从异构仪器中创建存档,索引和可搜索的数据,以实现强大的数据驱动的材料开发策略。在国家可再生能源实验室的国家光化学中心,我们几年前开始开发实验室信息管理系统(LIMS),旨在处理实验室范围内的物理和材料科学数据的科学数据采集、管理、处理和挖掘需求。并特别关注新设备或研究重点的未来可扩展性。我们将介绍我们在建立材料研究LIMS时所做的决定、过程和遇到的问题,以及它当前的运行状态和我们未来的发展步骤。

英文摘要:

Twenty-five years ago the desktop computer started becoming ubiquitous in the scientific lab. Researchers were delighted with its ability to both control instrumentation and acquire data on a single system, but they were not completely satisfied. There were often gaps in knowledge that they thought might be gained if they just had more data and they could get the data faster. Computer technology has evolved in keeping with Moore's Law meeting those desires; however those improvement have of late become both a boon and bane for researchers. Computers are now capable of producing high speed data streams containing terabytes of information; capabilities that evolved faster than envisioned last century. Software to handle large scientific data sets has not kept up. How much information might be lost through accidental mismanagement or how many discoveries are missed through data overload are now vital questions. An important new task in most scientific disciplines involves developing methods to address those issues and to create software that can handle large data sets with an eye towards scalability. This software must create archived, indexed, and searchable data from heterogeneous instrumentation for the implementation of a strong data-driven materials development strategy. At the National Center for Photovoltaics in the National Renewable Energy Lab, we began development a few years ago on a Laboratory Information Management System (LIMS) designed to handle lab-wide scientific data acquisition, management, processing, and mining needs for physics and materials science data. and with a specific focus on future scalability for new equipment or research focuses. We will present the decisions, process, and problems we went through while building our LIMS for materials research, its current operational state, and our steps for future development.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑