Learn · CERN

Talk10 min

The ocis storage driver - a deconstructed filesystem

Jörn Dreyer · CERN

Watch At CERN

About

Looking up files by a stable id is an inefficient operation in most filesystems. While an efficient lookup by file id can be cached inside an OCIS storage provider this cache needs to be kept up to date. By deconstructing a filesystem and storing every node by its uuid we can evade the cache invalidation problem at the cost of more stat requests. The ocis storage driver allows an efficient lookup of file metadata by path and by file id while relying solely on the filesystem as a persistence layer. Furthermore, the layout on disk can be used to implement trash, versions and in the future deduplication. It serves as a blueprint for seperating metadata and content in an S3 or librados storage driver..

0:00:00 Slide 1

0:01:00 Slide 2

0:02:00 Slide 3

0:03:00 Slide 4

0:04:00 Slide 5

0:05:00 Slide 6

0:05:59 Slide 7

0:06:59 Slide 8

0:07:59 Slide 9

0:08:59 Slide 10

0:09:59 Slide 11

The talk

  1. The ocis storage driver - a deconstructed filesystem 2021-01-27 · 10 min · CERN's player

Credits and licence

Institution
CERN
Department
HEP Computing
Speaker
Jörn Dreyer
Year
2021
Language
English
Subjects
Computer science
Source
CERN
Licence
CERN, as CERN states it. CERN's terms
Attribution
© CERN. CERN provides its audiovisual media free of charge for educational and informational use, credited to CERN; this lecture is shown in CERN's own player.
Who can watch
CERN gives no rating. Invisible Network shows it to Tweens profiles and older, judged from what the source says about it. How courses are placed