Designing a multi-petabyte database for LSST [electronic resource].
- Published:
- Washington, D.C. : United States. Dept. of Energy, 2005.
Oak Ridge, Tenn. : Distributed by the Office of Scientific and Technical Information, U.S. Dept. of Energy. - Physical Description:
- PDF-file: 3 pages; size: 35.9 Kbytes
- Additional Creators:
- Lawrence Berkeley National Laboratory, United States. Department of Energy, and United States. Department of Energy. Office of Scientific and Technical Information
Access Online
- Restrictions on Access:
- Free-to-read Unrestricted online access
- Summary:
- The 3.2 giga-pixel LSST camera will produce over half a petabyte of raw images every month. This data needs to be reduced in under a minute to produce real-time transient alerts, and then cataloged and indexed to allow efficient access and simplify further analysis. The indexed catalogs alone are expected to grow at a speed of about 600 terabytes per year. The sheer volume of data, the real-time transient alerting requirements of the LSST, and its spatio-temporal aspects require cutting-edge techniques to build an efficient data access system at reasonable cost. As currently envisioned, the system will rely on a database for catalogs and metadata. Several database systems are being evaluated to understand how they will scale and perform at these data volumes in anticipated LSST access patterns. This paper describes the LSST requirements, the challenges they impose, the data access philosophy, and the database architecture that is expected to be adopted in order to meet the data challenges.
- Report Numbers:
- E 1.99:ucrl-conf-217858
ucrl-conf-217858 - Subject(s):
- Other Subject(s):
- Note:
- Published through SciTech Connect.
12/21/2005.
"ucrl-conf-217858"
Presented at: Designing a multi-petabyte database for LSST, Orlando, FL, United States, May 24 - May 31, 2005.
Hanushevsky, A; Becla, J. - Funding Information:
- W-7405-ENG-48
View MARC record | catkey: 14345126