Analyzing metadata performance in distributed file systems

Link:
Autor/in:
Erscheinungsjahr:
2009
Medientyp:
Text
Schlagworte:
  • Digital storage
  • Metadata
  • Metadata server
  • Cloud Computing
  • Clouds
  • Distributed Computer Systems
  • Digital storage
  • Metadata
  • Metadata server
  • Cloud Computing
  • Clouds
  • Distributed Computer Systems
Beschreibung:
  • The performance of metadata processing in large distributed file systems currently presents larger challenges than scaling of data throughput. The paper presents a novel, distributed benchmark called DMetabench for measuring the performance of metadata operations (e.g. file creation). DMetabench runs in environments with potentially thousands of nodes and allows an assessment of the scalability of metadata operations. Additionally, precise run-time performance data is preserved which allows for a better understanding of performance artifacts. Validation results from production file systems at the Leibniz Supercomputing Centre (LRZ) are provided and discussed. Possible applications of knowledge about metadata performance scaling include the choice of an optimal parallelization strategy for metadata-itensive workload in a specific runtime environment. © 2009 Springer Berlin Heidelberg.
Lizenz:
  • info:eu-repo/semantics/closedAccess
Quellsystem:
Forschungsinformationssystem der UHH
Interne Metadaten
Quelldatensatz
oai:www.edit.fis.uni-hamburg.de:publications/c9a2b434-db0a-4952-a3e4-7ecf9e5d3ca6