We clearly explain the mechanism of web archiving and the technologies used for it. (The articles are written in Japanese.)

• "Mechanism of Web Archiving"(in Japanese) [PDF: 3.28MB]

Mechanism of Web Archiving

1. What is Web Archiving?
2. Life Cycle of Web Archiving
3. How to Harvest Websites
4. Granularity of Managing Harvested Pages
5. Harvesting Frequency
6. Deduplication
7. Organization of Archived Websites
8. Long-term Preservation of Archived Websites
9. Providing Access to Archived Websites
10. Technical Challenges of Web Archiving

Web Archiving Technologies

1. Web Crawler "Heritrix"
2. Search Platform "Solr"
3. File Format for Storage "WARC"
4. Application for Viewing "Wayback"

The Workflow of Web Archiving

The following figure simply shows the workflow of web archiving.

The Workflow of Web Archiving [PDF: 549KB]

To Top