Migrating data without original checksums
Year: 2024
Type: article
Abstract: The National Library (NLN) has been using SAM-FS (Oracle HSM) as a bit-repository since 2007. SAM-FS is soon reaching "EOL". The NLN has recently developed a front-end software solution called DPS (Digital Preservation Services). DPS uses HPSS from IBM as underlying bit-repository. DPS/HPSS is intended to replace SAM-FS as the preservation solution for digital objects. DPS requires that all objects must be delivered with associated checksums. In the old SAM-FS bit-repository, many objects lack checksums, especially material from the first years of its use. All objects in SAM-FS are stored in 3 instances. If differences were to be uncovered between the 3 instances, there are no checksums to verify which instance is correct. The total amount of data to be migrated from SAM-FS to DPS is approximately 14 Petabytes. It is estimated that about 1/3 of these data lacks checksums. Challenge: How could we ensure that objects migrated from SAM-FS to DPS are the same as those originally archived in SAM-FS when original checksums do not exist?
Authors: Teigen, Trond, Edvardsen, Thomas
Institution: The National Library of Norway
Language: English
Subfield: Conservation
Field: Arts and Humanities
Domain: Social Sciences
Open Access status: green
OpenAlex ID: W6893041550
FWCI:
Cites:
Cited by:
Related to: