Found a very interesting website that captures billions of web pages and archive them.
The Internet Archive Wayback Machine is a service that allows people to visit archived versions of Web sites. Visitors to the Wayback Machine can type in a URL, select a date range, and then begin surfing on an archived version of the Web. Keyword searching is not currently supported. Imagine surfing circa 1999 and looking at all the Y2K hype, or revisiting an older version of your favorite Web site. The Internet Archive Wayback Machine can make all of this possible.
I tried searching for www.raymond.cc at the internet archive wayback machine and I found…
The empty page before this blog even began.
Then I also found the first design I used for this blog.
Brings back the memories…
Anyway, the Internet Archive Wayback Machine contains almost 2 petabytes of data and is currently growing at a rate of 20 terabytes per month. Terabytes is not very common and the Internet Archive Wayback Machine already has petabytes of data!
If you have a web site, and you would like to ensure that it is saved for posterity in the Internet Archive, and you’ve searched wayback and found no results, here’s what you can do to allow the Internet Archive Wayback Machine crawl your web site.
Method 1: Visit the Alexa’s “Webmasters” page.
Method 2: If you have the Alexa tool bar installed, just visit a site.
Method 3: While visiting a site, use the ‘show related links‘ in Internet Explorer, which uses the Alexa service.
Sites are usually crawled within 24 hours and no more than 48. Right now there is a 6-12 month lag between the date a site is crawled and the date it appears in the Wayback Machine.