Memento: Time Travel for the Web
arXiv:0911.1112
Abstract
The Web is ephemeral. Many resources have representations that change over time, and many of those representations are lost forever. A lucky few manage to reappear as archived resources that carry their own URIs. For example, some content management systems maintain version pages that reflect a frozen prior state of their changing resources. Archives recurrently crawl the web to obtain the actual representation of resources, and subsequently make those available via special-purpose archived resources. In both cases, the archival copies have URIs that are protocol-wise disconnected from the URI of the resource of which they represent a prior state. Indeed, the lack of temporal capabilities in the most common Web protocol, HTTP, prevents getting to an archived resource on the basis of the URI of its original. This turns accessing archived resources into a significant discovery challenge for both human and software agents, which typically involves following a multitude of links from the original to the archival resource, or of searching archives for the original URI. This paper proposes the protocol-based Memento solution to address this problem, and describes a proof-of-concept experiment that includes major servers of archival content, including Wikipedia and the Internet Archive. The Memento solution is based on existing HTTP capabilities applied in a novel way to add the temporal dimension. The result is a framework in which archived resources can seamlessly be reached via the URI of their original: protocol-based time travel for the Web.
14 pages, 5 figures
References in corpus (1)
Cited by in corpus (27)
- A Framework for Evaluation of Composite Memento Temporal Coherence
- On the Change in Archivability of Websites Over Time
- Routing Memento Requests Using Binary Classifiers
- Carbon Dating The Web: Estimating the Age of Web Resources
- Losing My Revolution: How Many Resources Shared on Social Media Have Been Lost?
- Difficulties of Timestamping Archived Web Pages
- A Framework for Managing Evolving Information Resources on the Data Web
- HTTP Mailbox - Asynchronous RESTful Communication
- Full-Text and URL Search Over Web Archives
- Archiving Deferred Representations Using a Two-Tiered Crawling Approach
- Archiving the Relaxed Consistency Web
- Modeling Updates of Scholarly Webpages Using Archived Data
- A Plan For Curating "Obsolete Data or Resources"
- How Much of the Web Is Archived?
- Making Web Annotations Persistent over Time
- Adapting the Hypercube Model to Archive Deferred Representations and Their Descendants
- Evaluating the SiteStory Transactional Web Archive With the ApacheBench Tool
- Collecting 16K archived web pages from 17 public web archives
- Web Synchronization Simulations using the ResourceSync Framework
- A 25 Year Retrospective on D-Lib Magazine
- Who and What Links to the Internet Archive
- Access Patterns for Robots and Humans in Web Archives
- Introducing A Dark Web Archival Framework
- An Evaluation of Caching Policies for Memento TimeMaps
- Avoiding Spoilers in Fan Wikis of Episodic Fiction
- Open Annotations on Multimedia Web Resources
- Searching Personal Collections