Internet Archive

From New World Encyclopedia
Previous (Internet)
Next (Interoperability)
Internet Archive headquarters is in the Presidio, a former US military base in San Francisco.

The Internet Archive (IA) is a nonprofit organization dedicated to maintaining an online library and archive of Web and multimedia resources. Located at the Presidio in San Francisco, California, this archive includes "snapshots of the World Wide Web" (archived copies of pages, taken at various points in time), software, movies, books, and audio recordings. To ensure the stability and endurance of the archive, IA is mirrored at the Bibliotheca Alexandrina in Egypt, the only library in the world with a mirror.[1] The IA makes the collections available at no cost to researchers, historians, and scholars. It is a member of the American Library Association and is officially recognized by the State of California as a library.[2]

Internet Archive developed the "Wayback Machine," a popular digital time capsule, in collaboration with Alexa Internet.

History

The Internet Archive was founded by Brewster Kahle in 1996.

According to its website:

Most societies place importance on preserving artifacts of their culture and heritage. Without such artifacts, civilization has no memory and no mechanism to learn from its successes and failures. Our culture now produces more and more artifacts in digital form. The Archive's mission is to help preserve those artifacts and create an Internet library for researchers, historians, and scholars. The Archive collaborates with institutions including the Library of Congress and the Smithsonian.

Because of its goal of preserving human knowledge and artifacts, and making its collection available to all, proponents of the Internet Archive have likened it to the Library of Alexandria.

Wayback Machine

Examples from the Wayback
Machine's archives:

The Wayback Machine is a digital time capsule created by the Internet Archive. It is maintained with content from Alexa Internet. This service allows users to see archived versions of Web pages across time—what the Archive calls a "three dimensional index."

Snapshots become available 6 to 12 months after they are archived. The frequency of snapshots is variable, so not all updates to tracked Web sites are recorded, and intervals of several weeks sometimes occur.

As of 2006 the Wayback Machine contained almost 2 petabytes of data and was growing at a rate of 20 terabytes per month, a two-thirds increase over the 12 terabytes/month growth rate reported in 2003. Its growth rate eclipses the amount of text contained in the world's largest libraries, including the Library of Congress. The data is stored on Petabox rack systems manufactured by Capricorn Technologies.[3]

The name Wayback Machine is a reference to a segment from The Rocky and Bullwinkle Show in which Mr. Peabody, a bow tie-wearing dog with a professorial air, and his human "pet boy" assistant Sherman use a time machine called the "WABAC machine" to witness, participate in, and more often than not alter famous events in history.[4]

Archive-It

Users who want to archive material permanently and immediately cite an archived version can use the Archive-It system, a for-fee subscription service, instead.[5] Data collected with Archive-It is periodically indexed into the general Wayback Machine. As of December 2007, Archive-It had created over 230 million URLs for 466 public collections, including government bodies, universities, and cultural institutions. Some of the organizations participating in Archive-It include the Electronic Literature Organization, the State Archives of North Carolina, the Texas State Library and Archives Commission, Stanford University, the National Library of Australia, the Research Libraries Group (RLG), and many others.

Media collections

In addition to Web archives, the Internet Archive maintains extensive collections of digital media that are either public domain or licensed under a license that allows redistribution, such as the Creative Commons License. The media are organized into collections by media type (moving images, audio, text, etc.), and into sub-collections by various criteria. Each of main collection includes an "Open Source" sub-collection where general contributions by the public can be stored.

Moving image collection

Aside from feature films, IA's Moving Image collection includes: newsreels; classic cartoons; pro- and anti-war propaganda; Skip Elsheimer's "A.V. Geeks" collection; and ephemeral material from Prelinger Archives, such as advertising, educational and industrial films and amateur and home movie collections.

IA's Brick Films collection contains stop-motion animation filmed with LEGO bricks, some of which are 'remakes' of feature films. The Election 2004 collection is a non-partisan public resource for sharing video materials related to the 2004 United States Presidential Election. The Independent News collection includes sub-collections such as the Internet Archive's World At War competition from 2001, in which contestants created short films demonstrating "why access to history matters." Among their most-downloaded video files are eyewitness recordings of the devastating 2004 Indian Ocean earthquake. The September 11th Television Archive contains archival footage from the world's major television networks as the attacks of September 11th, 2001 unfolded on live television.

Some of the films available on the Internet Archive are:

  • Battleship Potemkin
  • The Birth of a Nation
  • The Century of the Self
  • Columbia Revolt
  • D.O.A. (1950)
  • Danger Lights
  • Das Cabinet des Dr. Caligari
  • Dating Do's and Don'ts
  • Detour
  • Duck and Cover
  • Escape From Sobibor
  • Hemp For Victory
  • The Kid
  • Manufacturing Consent: Noam Chomsky and the Media
  • Le voyage dans la Lune
  • Lying Lips
  • M
  • The Man Who Knew Too Much
  • Night of the Living Dead
  • Nosferatu
  • The Power of Nightmares
  • Reefer Madness
  • Sex Madness
  • Triumph of the Will
  • Design for Dreaming
  • Un Chien Andalou
  • All seven episodes of Why We Fight
  • The Negro Soldier (1943)

Audio collection

The audio collection includes music, audio books, news broadcasts, old time radio shows and a wide variety of other audio files.


The Live Music Archive sub-collection includes 40,000 concert recordings from independent artists, as well as more established artists and musical ensembles with permissive rules about recording their concerts such as the Grateful Dead.

Texts collection

The texts collection includes digitized books from various libraries around the world as well as many special collections. As of May 2008, the Internet Archive operated 13 scanning centers in great libraries, digitizing about 1000 books a day, financially supported by libraries and foundations.[6]

Between about 2006 and 2008 Microsoft Corporation had a special relationship with Internet Archive texts through its Live Search Books project, scanning over 300,000 books which were contributed to the collection, as well as financial support and scanning equipment. On May 23, 2008 Microsoft announced it would be ending the Live Book Search project and no longer scanning books.[7] Microsoft will be making its scanned books available without contractual restriction and making the scanning equipment available to its digitization partners and libraries to continue digitization programs. Retrieved June 15, 2008.[7]

Open Library

The Internet Archive is a member of the Open Content Alliance, and operates the Open Library where more than 200,000 scanned public domain books are made available in an easily browsable and printable format.[8] Their "Scribe" book imaging system was used to digitize most of these books.[9] The software that runs it is free/open source software—Scribe Software.

Controversies

Scientology sites

In late 2002, the Internet Archive removed various sites critical of Scientology from the Wayback Machine.[10] The error message stated that this was in response to a "request by the site owner."[11] It was later clarified that lawyers from the Church of Scientology had demanded the removal and that the actual site owners did not want their material removed.[12]

Archived Web pages as evidence

United States civil litigation

Telewizja Polska

In an October 2004 case called "Telewizja Polska SA v. Echostar Satellite," a litigant attempted to use the Wayback Machine archives as a source of admissible evidence, perhaps for the first time. Telewizja Polska is the provider of TVP Polonia and EchoStar operates the Dish Network. Prior to the trial proceedings, EchoStar indicated that it intended to offer Wayback Machine snapshots as proof of the past content of Telewizja Polska’s website. Telewizja Polska brought a motion in limine to suppress the snapshots on the grounds of hearsay and unauthenticated source, but Magistrate Judge Arlander Keys rejected Telewizja Polska’s assertion of hearsay and denied TVP's motion in limine to exclude the evidence at trial.[13] However, at the actual trial, district Court Judge Ronald Guzman, the trial judge, overruled Magistrate Keys' findings, and held that neither the affidavit of the Internet Archive employee nor the underlying pages (i.e., the Telewizja Polska website) were admissible as evidence. Judge Guzman reasoned that the employee's affidavit contained both hearsay and inconclusive supporting statements, and the purported webpage printouts themselves were not self-authenticating.

Healthcare Advocates, Inc.

In 2003, Healthcare Advocates, Inc. were defendants in a trademark violation lawsuit wherein the prosecution attempted to use archived Web material accessed via the Internet Archive. When they lost that suit, the company turned around and attempted to sue the Internet Archive for violating the Digital Millennium Copyright Act (DMCA) and the Computer Fraud and Abuse Act. They claimed that since they had installed a robots.txt file on their website, it should have been avoided by the Internet Archive’s Web crawlers but was not.[14] The initial lawsuit was filed on June 26, 2003, and they added the robots.txt file on July 8, 2003, so pages should have been removed retroactively. The lawsuit with Healthcare Advocates was settled out of court.[15]

Robots.txt is used as part of the Robots Exclusion Standard, a voluntary protocol the Internet Archive respects that disallows bots from indexing certain pages delineated by the creator as off-limits. As a result, the Internet Archive has removed a number of websites that are now inaccessible through the Wayback Machine. This is sometimes due to a new domain owner placing a robots.txt file that disallows indexing of the site. The administrators claim to be working on a system that will allow access to that previous material while excluding material created after the point the domain switched hands. Currently, the Internet Archive applies robots.txt rules retroactively; if a site blocks the Internet Archive, like Healthcare Advocates, any previously archived pages from the domain are also removed. In cases of blocked sites, only the robots.txt file is archived. This practice would appear to be detrimental to researchers looking for information that was available in the past.

However, the Internet Archive also states that, "sometimes a Web site owner will contact us directly and ask us to stop crawling or archiving a site. We comply with these requests." [16] They also say, "The Internet Archive is not interested in preserving or offering access to Web sites or other Internet documents of persons who do not want their materials in the collection." [17]

Patent law

The United States patent office and, provided some additional requirements are met (e.g. providing an authoritative statement of the archivist), the European Patent Office will accept date stamps from the Internet Archive as evidence of when a given Web page was accessible to the public. These dates are used to determine if a Web page is available as prior art for instance in examining a patent application.

Grateful Dead

In November 2005, free downloads of Grateful Dead concerts were removed from the site. John Perry Barlow identified Bob Weir, Mickey Hart, and Bill Kreutzmann as the instigators of the change, according to a New York Times article.[18] Phil Lesh commented on the change in a November 30, 2005, posting to his personal website:

It was brought to my attention that all of the Grateful Dead shows were taken down from Archive.org right before Thanksgiving. I was not part of this decision making process and was not notified that the shows were to be pulled. I do feel that the music is the Grateful Dead's legacy and I hope that one way or another all of it is available for those who want it.[19]

A November 30 forum post from Brewster Kahle summarized what appeared to be the compromise reached among the band members. Audience recordings could be downloaded or streamed, but soundboard recordings were to be available for streaming only. Most of the more than 2300 Grateful Dead live concert recordings have since been re-added.[20]

Automatically entered contracts

On December 12 2005, activist Suzanne Shell demanded Internet Archive pay her US$100,000 for archiving her website profane-justice.org between 1999 and 2004.[21] Internet Archive filed a declaratory judgment action in the United States District Court for the Northern District of California on January 20 2006, seeking a judicial determination that Internet Archive did not violate Shell’s copyright. Shell responded and brought a countersuit against Internet Archive for archiving her site, which she alleges is in violation of her terms of service. On February 13 2007, a judge for the United States District Court for the District of Colorado dismissed all counterclaims except breach of contract.[21] The Internet Archive did not move to dismiss copyright infringement claims Shell asserted arising out of its copying activities, which will also go forward.[22] On April 25 2007, Internet Archive and Suzanne Shell jointly announced the settlement of their lawsuit. The Internet Archive said, “Internet Archive has no interest in including materials in the Wayback Machine of persons who do not wish to have their Web content archived. We recognize that Ms. Shell has a valid and enforceable copyright in her Web site and we regret that the inclusion of her Web site in the Wayback Machine resulted in this litigation. We are happy to have this case behind us.” Ms. Shell said, “I respect the historical value of Internet Archive’s goal. I never intended to interfere with that goal nor cause it any harm.”[23]

Copyright situation in Europe

In Europe the Wayback Machine can sometimes violate copyright laws. Only the creator can decide where his content is published or duplicated, so the Archive would have to delete pages from its system upon request of the creator.[24] The exclusion policies for the Wayback Machine can be found in the FAQ section of the site. The Wayback Machine also retroactively respects robots.txt files.

Rescission of FBI National Security Letter

On May 8, 2008 it was revealed that the Internet Archive successfully challenged a FBI NSL (National Security Letter) asking for logs on an undisclosed user.[25] [26]

See also

Notes

  1. ↑ The Internet Archive at the New Library of Alexandria, Bibliotheca Alexandrina, International School of Information Science (ISIS). Retrieved June 15, 2008.
  2. ↑ "Internet Archive officially a library", Announcements, Internet Archive. May 2, 2007. Retrieved June 15, 2008.
  3. ↑ Michael Kanellos, Big storage on the cheap. CNET News.com July 29, 2005. accessdate 2007-07-29
  4. ↑ Heather Green, February 28, 2002, A Library as Big as the World BusinessWeek accessdate 2007-07-29
  5. ↑ Stefanie Olsen, "Preserving the Web one group at a time", CNet News.com, May 1, 2006. Retrieved June 15, 2008.
  6. ↑ Brewster Khale. "Books Scanning to be Publicly Funded", announcement, Internet Archive. May 23, 2008. Retrieved June 15, 2008.
  7. ↑ 7.0 7.1 "Book search winding down", Live Search Blog. Official announcement from Microsoft. Last accessed May 23, 2008.
  8. ↑ The Open Library Makes Its Online Debut. [1] Chronicle of Higher Education, The Wired Campus, July 19, 2007. accessdate 2007-07-30
  9. ↑ Stefanie Olsen. An open-source rival to Google's book project. October 26, 2005, [2] CNET News.com. accessdate 2007-07-29
  10. ↑ Lisa M. Bowman, "Net archive silences Scientology critic." CNET News.com, September 24, 2002, accessdate 2007-01-04
  11. ↑ Jeff, Blog, Wayback Machine Forum, September 23, 2002, exclusions from the Wayback Machine Internet Archive accessdate 2007-01-04 Author and Date indicate initiation of forum thread
  12. ↑ Ernest Miller, Blog, 24 SeptemberSherman, Set the Wayback Machine for Scientology accessdate 2007-01-04 LawMeme Yale Law School The posting is billed as a 'feature' and lacks an associated year designation; comments by other contributors appear after the 'feature'
  13. ↑ Lauren Gelman, 17 November 2004. Internet Archive’s Web Page Snapshots Held Admissible as Evidence. Packets 2 (3) Retrieved June 15, 2008.
  14. ↑ Jessica Dye, 2005. Website Sued for Controversial Trip into Internet Past. EContent 28 (11): 8–9
  15. ↑ Eric Bangeman, August 31, 2006, Internet Archive Settles Suit Over Wayback Machine. ars technica [3] accessdate 2007-11-29. Retrieved June 15, 2008.
  16. ↑ Some sites are not available because of Robots.txt or other exclusions. What does that mean?, FAQs, Internet Archive Wayback Machine.
  17. ↑ How can I remove my site's pages from the Wayback Machine?, Internet Archive. Retrieved June 15, 2008.
  18. ↑ Jeff Leeds and Jesse Fox Mayshark, Wrath of Deadheads stalls a Web crackdown International Herald Tribune (republication of article from New York Times), December 1, 2005, accessdate 2007-01-04
  19. ↑ Phil Lesh, Blog, 30 November 2005, An Announcement from Phil Lesh accessdate 2007-01-05 Hotline PhilLesh.net
  20. ↑ Brewster Kahle and Matt Vernon, 1 December 2005 ]]Live Music Archive Forum]], Blog Good News and an Apology: GD on the Internet Archive Internet Archive accessdate 2007-01-05 Authors and date indicate the first posting in the forum thread
  21. ↑ 21.0 21.1 Lewis T. Babcock (13 February 2007). Internet Archive v. Shell (PDF), Civil Action No. 06cv01726LTBCBS. Retrieved June 15, 2008.
  22. ↑ Martin Samson, Internet Archive v. Suzanne Shell. via Phillips Nizer LLP. Retrieved June 15, 2008.
  23. ↑ Internet Archive and Suzanne Shell Settle Lawsuit, April 25, 2007. Retrieved June 15, 2008.
  24. ↑ The Wayback Machine und Google Cache - eine Verletzung deutschen Urheberrechts? (German), JurPC Web-Dok. 29/2002, Abs. 1 - 18. Retrieved June 15, 2008.
  25. ↑ Anne Broache, May 7, 2008. FBI rescinds secret order for Internet Archive records, CNet. Retrieved June 15, 2008.
  26. ↑ Ellen Nakashima, "FBI Backs Off From Secret Order for Data After Lawsuit", Washington Post, May 8, 2008. Retrieved June 15, 2008.

References
ISBN links support NWE through referral fees

Books

  • Borghoff, Uwe M. Long-Term Preservation of Digital Documents: Principles and Practices. Berlin: Springer, 2006. ISBN 3540336397
  • Brügger, Niels. Archiving Websites: General Considerations and Strategies. Århus, Denmark: Centre for Internet Research, 2005. ISBN 8799050706
  • Masanès, Julien. Web Archiving. Berlin: Springer, 2006. ISBN 9783540233381

Articles and websites

External links

All links retrieved March 4, 2018. Internet archive

Other organizations and tools

Credits

New World Encyclopedia writers and editors rewrote and completed the Wikipedia article in accordance with New World Encyclopedia standards. This article abides by terms of the Creative Commons CC-by-sa 3.0 License (CC-by-sa), which may be used and disseminated with proper attribution. Credit is due under the terms of this license that can reference both the New World Encyclopedia contributors and the selfless volunteer contributors of the Wikimedia Foundation. To cite this article click here for a list of acceptable citing formats.The history of earlier contributions by wikipedians is accessible to researchers here:

The history of this article since it was imported to New World Encyclopedia:

Note: Some restrictions may apply to use of individual images which are separately licensed.

Retrieved from https://www.newworldencyclopedia.org/p/index.php?title=Internet_Archive&oldid=1138060

Content is available under Creative Commons Attribution/Share-Alike License; additional terms may apply. See Terms of Use for details.
Copyright Logo
Powered by MediaWiki