- Atlas
- Humanities
- Digital Archives And Collections
Digital Archives And Collections
A digital archive is not simply a pile of scanned paper.
8 frameworks, from 1965 to today · Digital Humanities · Humanities
- Metadata Standards and Interoperability 1965-Present
- Electronic Records Management 1970-Present
- Community Archives 1990-Present
- Digital Library 1994-Present
- Digital Preservation 1996-Present
- Web Archiving 1996-Present
- Indigenous Data Sovereignty and Cultural Protocols 2006-Present
- Collections as Data 2011-Present
Overview
A digital archive is not simply a pile of scanned paper. It is a set of files, descriptions, rules, and services that together let people find, trust, and reuse cultural material over time. The subfield of digital archives and collections is the part of digital humanities concerned with building and sustaining those systems: converting and describing materials, keeping them readable for decades, capturing things that were born online, and making collections usable for research and the public. What is at stake is memory itself. A library that loses its catalogue, a website that vanishes when a company folds, or a community whose records are described in someone else's categories all raise the same question: who gets to decide what survives, and on whose terms?
From Machine-Readable Catalogues to Electronic Records
The prehistory lies in library automation after the Second World War. Libraries needed to share catalogue records, and in the 1960s the MARC format (Machine-Readable Cataloguing), developed under Henriette Avram at the Library of Congress, encoded bibliographic description so computers could exchange it1. MARC made the card catalogue into data and established a principle that still governs the field: description is a structured, standardized layer separate from the object described1.
A parallel strand came from government and business. As offices replaced paper with computers in the 1970s and 1980s, archivists confronted records that had no physical carrier to shelve. Electronic records management grew out of this: the idea that records must be captured, classified, and scheduled for retention or destruction from the moment of creation, with their context intact. The University of British Columbia ran a major research project on the preservation of electronic records in the early 1990s, and national archives in several countries began issuing guidance. The hard problem was not storage but evidential trust: a database record could be altered invisibly, so archivists argued for audit trails, fixed metadata, and documented provenance.
The Digital Library Turn
In the 1990s the web turned digitization from a specialist activity into a mass program. The US Digital Library Initiative, funded from 1994, joined computer scientists and librarians to build large testbed collections; Project Gutenberg, begun by Michael Hart in 1971, had already shown that volunteers could produce a vast text corpus. National libraries followed: the Library of Congress's American Memory had begun delivering digitized collections online in the mid-1990s, and the Bibliothèque nationale de France launched Gallica in 1997. These projects established the basic workflow that persists today: select, image, describe, serve.
The description layer became the field's central technical concern. Metadata—literally data about data—had to record who made an object, when, of what, and under what rights. The Dublin Core element set, agreed at a 1995 workshop in Dublin, Ohio, offered a minimal fifteen-element vocabulary simple enough for non-specialists. Richer standards followed for particular domains, such as EAD (Encoded Archival Description) for finding aids and METS for packaging digital objects. Because institutions used different schemas, the problem of metadata interoperability arose: how to make records from one system legible to another. Solutions included crosswalks (mappings between schemas), harvesting protocols such as OAI-PMH (the Open Archives Initiative Protocol for Metadata Harvesting, released in 2001), and later linked data, which identifies entities by persistent web addresses so that a person or place can be referenced consistently across collections.
Preservation as a Discipline
Digitization exposed a problem paper did not have in the same way: digital objects decay silently. Files become unreadable as formats and software disappear, and storage media fail. Digital preservation emerged as a discipline with its own concepts. The Open Archival Information System (OAIS) reference model, published in 2002 and later standardized as ISO 14721, described the functions any trustworthy repository must perform—ingest, archival storage, data management, access, and preservation planning—and gave the field a shared vocabulary. Practical techniques included migration (converting files to current formats) and emulation (recreating the original computing environment so old software can run)2. The LOCKSS program, developed at Stanford from the late 1990s, and the Dutch-led Portico, founded in 2002, built distributed systems in which many libraries hold copies, so that no single failure destroys a journal. Preservation was reframed from saving objects to maintaining access over time.
Capturing the Web
The web created a new kind of collection problem: material that exists only online and changes or disappears constantly. The Internet Archive, founded by Brewster Kahle in 1996, began systematic crawling and by the early 2000s offered the Wayback Machine for viewing past versions of pages34. National libraries built their own programs, often constrained by legal deposit law that had never anticipated websites; the International Internet Preservation Consortium, founded in 2003, coordinated tools and standards. Web archiving raised distinctive questions: what to select from an effectively infinite space, how to capture dynamic pages and embedded media, and how to represent a crawl faithfully when the live site is gone.
Community Archives and Cultural Protocols
A significant correction to the field's institutional bias came from community archives: collections built by and for the groups they document, rather than about them. Grassroots projects—ethnic, LGBTQ, labor, and Indigenous—argued that mainstream archives had often described communities in outsiders' terms or excluded them altogether. The response was participatory: communities deciding what to keep, how to describe it, and who may see it. This connected to Indigenous data sovereignty movements, which hold that communities have the right to govern data about themselves. Protocols such as the First Archivists Circle's "Protocols for Native American Archival Materials" (2006) and later frameworks like the CARE Principles for Indigenous Data Governance (2019) set out expectations for consultation, attribution, and restrictions on culturally sensitive material. The Mukurtu platform, developed with the Warumungu community in Australia from the mid-2000s, implemented culturally specific access rules in software—showing that ethical protocols can be built into systems, not just stated in policy.
Collections as Data
As digitized corpora grew, researchers wanted to compute over them rather than read them one item at a time. Computational reuse of collections—sometimes called "collections as data"—treats a digitized archive as a dataset for text mining, image analysis, or network analysis. This required new work: releasing bulk data with clear rights statements, documenting provenance and gaps, and providing interfaces for machine access. The HathiTrust Research Center, established in 2011, gave scholars computational access to millions of digitized volumes while respecting copyright through a "non-consumptive" research model that returns analysis rather than full text. The field's practitioners increasingly argued that collections should be designed for reuse from the start, and that the biases of digitization—what got scanned, whose language dominates—must be documented as part of the data.
Where the Field Stands
Today the main approaches descend directly from these strands. Repository systems and standards such as OAIS and PREMIS (a metadata standard for preservation events) underpin institutional practice; web archiving is routine for national libraries and increasingly for research projects; community and Indigenous protocols have moved from the margins into professional ethics codes and funding requirements; and collections-as-data work has become a standard expectation for major digitization programs. The open questions are live ones. How should archives preserve and describe machine-generated and algorithmic material? Who bears the cost of perpetual preservation when institutions close? How can computational access be opened without overriding the access restrictions communities have deliberately set? And as generative systems begin to produce records of their own, the field faces the question it has always faced in new form: what counts as a document, and who decides.
References
- MARC standards (introduction, History), Wikipedia
- Digital preservation (Migration, Emulation), Wikipedia
- Web archiving (History and development), Wikipedia
- Internet Archive (introduction, History), Wikipedia
The frameworks of Digital Archives And Collections
Each framework is a way of working the field has used: when it held, and the question it answers.
- 1965-Present
Metadata Standards and Interoperability
How can catalogues be exchanged between systems?
- 1970-Present
Electronic Records Management
How are digital records kept trustworthy over time?
- 1990-Present
- 1994-Present
- 1996-Present
- 1996-Present
- 2006-Present
Indigenous Data Sovereignty and Cultural Protocols
Who has the right to govern data about a people?
- 2011-Present
How the ideas connect
Each arrow runs from an earlier idea to the later one it shaped. The list below says what passed between them.
Digital Library influenced by Metadata Standards and Interoperability
The digital library turn inherited the separation of description from object and the need for exchangeable metadata. Dublin Core, agreed in 1995, and later OAI-PMH harvesting directly extended the interoperability problem MARC had posed for catalogues.
Carried by Dublin Core; OAI-PMH.
Indigenous Data Sovereignty and Cultural Protocols influenced by Community Archives
Indigenous data sovereignty took from community archives the participatory principle that communities decide what is kept, how it is described, and who may see it. The Protocols for Native American Archival Materials and the CARE Principles formalized that community-governance stance into data protocols.
Carried by Protocols for Native American Archival Materials (2006); CARE Principles (2019).
Digital Preservation influenced by Electronic Records Management
Digital preservation took from electronic records management the concern with evidential trust, provenance, and audit trails, and the idea that records must be managed from creation. OAIS and PREMIS preservation metadata carry that archival logic into repository design.
Digital Preservation grew out of Digital Library
Digital preservation grew out of the digital library as its sustainability branch: mass digitization exposed silent decay of files and formats, and the OAIS reference model gave repositories a shared vocabulary for ingest, storage, and access.
Carried by OAIS.
Web Archiving grew out of Digital Library
Web archiving extended the digital library workflow of select, capture, describe, and serve to material born online. The Internet Archive and national library programs applied collection-building methods to the changing web.
Carried by Brewster Kahle; Internet Archive.
Collections as Data grew out of Digital Library
Collections as data grew out of the digital library when large digitized corpora invited computational reuse rather than item-by-item reading. The HathiTrust Research Center's non-consumptive model built directly on mass digitization programs.
Carried by HathiTrust Research Center.
Beyond the field
Where Digital Archives And Collections's ideas came from in other fields, and what they led to there: the strongest 12 of 56 links.
Metadata Standards and Interoperability influenced Institutional Repository and Open Access Model in Digital Libraries
Open access repositories depend on metadata standards such as Dublin Core and OAI-PMH to expose and exchange records of deposited papers. The interoperability framework supplied the harvesting and description conventions repositories implemented.
Carried by Dublin Core Metadata Initiative; Open Archives Initiative Protocol for Metadata Harvesting (2001).
Metadata Standards and Interoperability led to Linked Data and Semantic Bibliographic Modeling in Digital Libraries
Semantic bibliographic modelling grew out of metadata standards and interoperability work, recasting library metadata element sets as linked RDF vocabularies. The interoperability tradition's schemas were the starting point for the semantic models.
Metadata Standards and Interoperability led to Metadata Harvesting and Aggregation in Digital Libraries
Metadata harvesting and aggregation is a direct outgrowth of metadata standards and interoperability work, crystallised in the Open Archives Initiative Protocol for Metadata Harvesting built on unqualified Dublin Core. The protocol generalised earlier interoperability conventions into a harvesting mechanism.
Carried by Open Archives Initiative Protocol for Metadata Harvesting (2001); Dublin Core Metadata Initiative.
Metadata Standards and Interoperability influenced by Library classification and cataloguing in Information Science
Library cataloguing rules and classification schemes provided the descriptive conventions that MARC encoded and that later metadata standards generalized. The shift from card catalogues to machine-readable records carried cataloguing practice directly into metadata interoperability work.
Carried by Anglo-American Cataloguing Rules; Dewey Decimal Classification.
Electronic Records Management influenced by Records life cycle in Records And Information Management
The records life cycle model, formulated in the mid-twentieth century, provided the conceptual frame within which electronic records management defined creation, maintenance, and disposition of digital records. Digital recordkeeping guidance adopted the life-cycle stages directly.
Electronic Records Management influenced by Records life cycle in Archival Science
The archival records life cycle concept gave electronic records management its staged model of record creation, use, and disposition. Later digital recordkeeping standards restated these stages for machine-readable records.
Electronic Records Management influenced by Records Retention Scheduling in Records And Information Management
Records retention scheduling supplied the disposition rules that electronic records management systems had to automate. The appraisal and scheduling concepts developed for paper records were carried into digital recordkeeping practice.
Community Archives led to Participatory archives in Archival Science
Participatory archives grew directly out of community archives practice, extending community control and shared authorship from community-run collections to mainstream archival institutions. The participatory turn generalised the community archives model of documenting marginalized groups with their involvement.
Web Archiving influenced by Digital preservation in Archival Science
Digital preservation theory supplied the core concepts of fixity, format migration, and authenticity that web archiving applied to the web. Web archiving is in large part digital preservation carried out on web content.
Metadata Standards and Interoperability influenced Museum Documentation Standards in Digital Curation And Exhibition
Museum documentation standards converged with cross-domain metadata schemas such as Dublin Core and later CIDOC CRM, adopting their interoperability principles for sharing collection records.
Metadata Standards and Interoperability led to Preservation Metadata Standards in Digital Curation
Preservation metadata standards were built on general metadata standards and interoperability efforts, extending them with fixity, format and provenance elements needed for long-term preservation. The preservation standard is a specialised outgrowth of metadata interoperability work.
Metadata Standards and Interoperability influenced Archival Diplomatics and Records Metadata in Records And Information Management
Metadata standards work in archives and libraries, especially the Dublin Core and encoded archival description efforts, gave records managers the element-based descriptive vocabulary they folded into records metadata frameworks.
Carried by Dublin Core Metadata Initiative.

Digital Archives And Collections is a planet in Nousfarer
Its city has a tower for each of these 8 frameworks. Land, walk in, and climb one concept at a time.
Land on Digital Archives And CollectionsRelated fields
Fields its ideas are linked to
- Records And Information Management 10 links
- Archival Science 9 links
- Digital Curation 8 links
- Digital Libraries 8 links
- Digital Curation And Exhibition 4 links
- Information Science 3 links
- Curatorial Studies 2 links
- Digital History 2 links
- Classics 1 link
- Collection Theory 1 link
- Digital Humanities 1 link
- Digital Scholarly Editing 1 link
More in Digital Humanities
- Digital Humanities
- Digital Scholarly Editing
- Distant Reading And Cultural Analytics
- Geospatial And Spatial Humanities
See where Digital Archives And Collections sits on the Map of Human Knowledge