Real-time Data Access Monitoring in Distributed, Multi-petabyte Systems [electronic resource].
- Published
- Washington, D.C. : United States. Dept. of Energy, 2008.
Oak Ridge, Tenn. : Distributed by the Office of Scientific and Technical Information, U.S. Dept. of Energy. - Physical Description
- 11 pages : digital, PDF file
- Additional Creators
- Stanford Linear Accelerator Center, United States. Department of Energy, and United States. Department of Energy. Office of Scientific and Technical Information
Access Online
- Restrictions on Access
- Free-to-read Unrestricted online access
- Summary
- Petascale systems are in existence today and will become common in the next few years. Such systems are inevitably very complex, highly distributed and heterogeneous. Monitoring a petascale system in real-time and understanding its status at any given moment without impacting its performance is a highly intricate task. Common approaches and off-the-shelf tools are either unusable, do not scale, or severely impact the performance of the monitored servers. This paper describes unobtrusive monitoring software developed at Stanford Linear Accelerator Center (SLAC) for a highly distributed petascale production data set. The paper describes the employed solutions, the lessons learned, the problems still to be addressed, and explains how the system can be reused elsewhere.
- Report Numbers
- E 1.99:slac-pub-13108
slac-pub-13108 - Subject(s)
- Other Subject(s)
- Note
- Published through SciTech Connect.
04/22/2008.
"slac-pub-13108"
Journal of Physics - Conference Series
Presented at International Conference on Computing in High Energy and Nuclear Physics (CHEP 07), Victoria, BC, Canada, 2-7 Sep 2007.
Becla, Jacek, a=Hanushevsky, Andrew; Azemoon, Tofigh; Turri, Massimiliano. - Funding Information
- AC02-76SF00515
View MARC record | catkey: 14680301