Publication details
- Structured metadata for the JULEA storage framework (Michael Straßberger), Bachelor's Thesis, School: Universität Hamburg, 2019-05-21
Publication details
Abstract
Today's high performance computing produces large amounts of data for scientific research in different areas. To handle such amounts of data different solutions exists in the HPC (high performance computing) field. In the past, most storage solutions lacked the ability to add own user defined metadata to the files. To accommodate this storage frameworks developed SDDF (self describing data format) standards which stores the metadata alongside with the object data. While SDDF provide a solution for storing metadata, it does not solve the issue of searching in large datasets. A search would have to read every file for its metadata information, instead of searching in a centralized database. This thesis provides a concept and implementation for a flexible structured metadata management based on the JULEA storage framework.
BibTeX
@misc{SMFTJSFS19, author = {Michael Straßberger}, title = {{Structured metadata for the JULEA storage framework}}, advisors = {Michael Kuhn and Kira Duwe}, year = {2019}, month = {05}, school = {Universität Hamburg}, howpublished = {{Online \url{https://wr.informatik.uni-hamburg.de/_media/research:theses:michael_strassberger_structured_metadata_for_the_julea_storage_framework.pdf}}}, type = {Bachelor's Thesis}, abstract = {Today's high performance computing produces large amounts of data for scientific research in different areas. To handle such amounts of data different solutions exists in the HPC (high performance computing) field. In the past, most storage solutions lacked the ability to add own user defined metadata to the files. To accommodate this storage frameworks developed SDDF (self describing data format) standards which stores the metadata alongside with the object data. While SDDF provide a solution for storing metadata, it does not solve the issue of searching in large datasets. A search would have to read every file for its metadata information, instead of searching in a centralized database. This thesis provides a concept and implementation for a flexible structured metadata management based on the JULEA storage framework.}, }