Preserv

       
Latest...
Array
Preserv 2 final report 'candid and realistic'
The final report from the Preserv 2 project has been described by the JISC programme manager responsible for funding the project, Neil Grindley, as ”candid and realistic about the ... more
Project Partners

Oxford University Library Services ECS, University of Southampton The National Archives
Project Advisors
The British Library
Funded By
JISC

PRESERV 2 is funded by JISC within its capital programme in response to the September 06 call (Circular 04/06), Repositories and Preservation strand

PRESERV was originally funded by JISC within the 4/04 programme Supporting Digital Preservation and Asset Management in Institutions, theme 3: Institutional repository infrastructure development

MORE INFORMATION?

EMAIL: Steve Hitchcock, Project Manager

TEL: +44 (0)23 8059 3256
FAX: +44 (0)23 8059 2865

PRESERV Project,
IAM (Intelligence, Agents, Multimedia) Group,
Department of Electronics & Computer Science,
University of Southampton,
Highfield,
Southampton
SO17 1BJ, UK
RSS Admin


About the ProjectObjectives & OutcomesNews RSSPapers & Presentations RSSPeopleBlogs  RSS
Storage
       

Repository storage: the impact of data growth and diversity

March 2009 - Once content has been ingested into the repository, it has to be stored and available for access and presentation. This section considers the function of storage in digital preservation, focussing on work done by the Preserv project.

Partial OAIS model - archival storageComputer storage should ideally be cheap, expandable and reliable. A virtuous coincidence of circumstance has allowed us to benefit from the first two factors for some time. As storage hardware costs fall, however, the volume of digital data continues to grow rapidly. As this happens it has become clear that the cost of managing data is more important than hardware costs. In addition, as volumes grow costs can rise to achieve specified levels of storage system reliability (that is, systems with measured probability of digital bit-flips) for storage of particular types of content such as science data. Faced with an increasing range of storage options - large-scale storage services, 'open' storage (cf. open source software), cloud storage - our choices have to take account of these factors as well as to control costs.

"simply having easy access to that quantity of storage can revolutionise the use to which repositories can be put – High Definition video, large collections of high resolution images, automated experimental data collection activities that span years and decades – diverse activities of an institution’s research community can all be accommodated within the institutional repository." Full paper

Computer applications that manage storage on a large scale thus need flexibility to choose, manage and change their storage options. It may not feel like it now, as some struggle to attract content, but repositories are such a case and need to prepare and plan. This section reviews the emerging technologies that Preserv has investigated and developed to widen the storage management choices available to repositories, and includes storage controllers, network 'cloud' storage and 'open' storage

To understand why digital content might be harder to manage than physical artifacts, we have to consider all types of data. Problems handling dynamically-changing data are revealed through a classic 1957 sketch from The Goon Show.
Tutorial presentation Preservation and storage management for Institutional Repositories (slides), Repositories Support Project Summer School, June 2008
Explores the relation between different types of data - images, audio, as well as institutional data types such as Web sites and repositories - and the needs of storage and preservation Summary. There is an associated group worksheet.
1/5 Storage controllers: choosing between local disk and the network 'cloud' --->

This page produced and maintained by the PRESERV Project. Contact us