Down at the bottom of the Awesome page that Aurora mentioned is a Public Data section, which includes probably the largest publicly available pool of WARC data: CommonCrawl:
https://data.commoncrawl.org/
The other one is the End of Term Archive:
https://eotarchive.org/
Both projects hast their WARC data on Amazon S3.
The Internet Archive is probably sitting on the largest pile of WARC data, but they generally don’t make it available to the public.
You’ll know you’ve caught the web archiving bug when you start creating your own WARC data using some of the tools on that Awesome list. Browsertrix [1] is a fun one to try: open source and available as a service. ArchiveBox [2] is another open source project for archiving the web that will write WARC files. Probably one of the most CLI friendly way to create WARC data is using wget to crawl some region of the web. Or you can try Harvard’s scoop tool. There are a lot of fun things to try!
//Ed
[1] https://docs.browsertrix.com/
[2] https://archivebox.io/
[3] https://www.gnu.org/software/wget/manual/
[4] https://github.com/harvard-lil/scoop#readme
> On Jun 18, 2026, at 10:34 AM, Charlow, Aurora <[log in to unmask]> wrote:
>
> Hi Eric,
>
> I'd look at this repo as a first stop: https://github.com/iipc/awesome-web-archiving#tools--software
>
> It splits tools between their uses and gives a great overview.
>
> Sincerely,
>
> Aurora Charlow
>
>
> [Ohio University Logo]
> Aurora Charlow, she/they
> DIGITAL ARCHIVIST
> UNIVERSITY LIBRARIES
> MAHN CENTER FOR ARCHIVES AND SPECIAL COLLECTIONS, PRESERVATION & DIGITAL INITIATIVES
> EMAIL
> [log in to unmask]<mailto:[log in to unmask]>
> PHONE
> 740.593.0055
>
> ________________________________
> From: Code for Libraries <[log in to unmask]> on behalf of Eric Lease Morgan <[log in to unmask]>
> Sent: Thursday, June 18, 2026 10:28 AM
> To: [log in to unmask] <[log in to unmask]>
> Subject: [External] [CODE4LIB] warc files
>
> Use caution with links and attachments.
>
> Where can I search for and download sets of warc files?
>
> I have come to learn there is a whole cadre of tools that can read, write, analyze, etc warc files, and I'd like to play too, but I can't seem to find any and/or they are hidden behind services. Do yo know the location of some?
>
> --
> Eric "Kinda Embarrassed" Morgan <[log in to unmask]>
|