Treffer: Hybrid Cloud Data Storage
Title:
Hybrid Cloud Data Storage
Authors:
Publication Year:
2021
Collection:
Smithsonian Institution: Digital Repository
Subject Terms:
Document Type:
Bild
still image
Language:
unknown
DOI:
10.6084/m9.figshare.13619135.v1
Availability:
Rights:
GPL 2.0+
Accession Number:
edsbas.514CD087
Database:
BASE
Weitere Informationen
A hybrid approach to adding cloud storage to an existing on-premises data processing workflow with less effort will be described. We used a Python program to efficiently transfer data files from local directories to an AWS S3 bucket. Concepts of managing a manifest of files already processed to prevent sending duplicates as well as a description of filtering files will be covered. The end result is a collection of Crowdsourced Bathymetry data accessible for public use. This poster was presented at the 2021 Earth Science Information Partners (ESIP) Winter Meeting held virtually in January 2021.