About
The NASA VIIRS Atmosphere SIPS, located at the University of Wisconsin, is responsible for assisting the Science Team in algorithm development and production of VIIRS Level-2 Cloud and Aerosol products. To facilitate algorithm development, the SIPS requires access to multiple years of satellite data occupying petabytes of space. Being able to reprocess the entire mission and provide validation results back to the Science Team in a rapid fashion is critical for algorithm development. In addition to reprocessing the SIPS is responsible for the timely delivery of near real time satellite products to NASA. To accomplish this task the Atmosphere SIPS has deployed a seven petabyte Ceph cluster employing numerous different components such as librados, EC-Pools, RBD, and CephFS. This talk will discuss choices we made to optimize the system allowing for rapid reprocessing of years of satellite data..
0:00:00 Slide 1
0:00:33 Slide 2
0:02:32 Slide 3
0:03:30 Slide 4
0:04:16 Slide 5
0:05:22 Slide 6
0:05:52 Slide 7
0:06:53 Slide 8
0:07:42 Slide 9
0:08:32 Slide 10
0:10:03 Slide 11
The talk
Credits and licence
- Institution
- CERN
- Department
- Ceph Project
- Speaker
- Kevin Hrpcek
- Year
- 2019
- Language
- English
- Source
- CERN
- Licence
- CERN, as CERN states it. CERN's terms
- Attribution
- © CERN. CERN provides its audiovisual media free of charge for educational and informational use, credited to CERN; this lecture is shown in CERN's own player.
- Who can watch
- CERN gives no rating. Invisible Network shows it to Teens profiles and older, judged from what the source says about it. How courses are placed