hi Karen, understood. the final draft of the spec is available here: http://www.scribd.com/doc/4303719/WARC-ISO-28500-final-draft-v018-Zentveld-080618 and other (similar) versions here: http://archive-access.sourceforge.net/warc/ [log in to unmask] On 6/2/09 2:15 PM, Karen Coyle wrote: > Unfortunately, being an ISO standard, to obtain it costs 118 CHF (about > $110 USD). Hard to follow a standard you can't afford to read. Is there > an online version somewhere? > > kc > > [log in to unmask] wrote: >> hi code4lib, >> >> if you're archiving web content, please use the WARC format. >> >> thanks, >> [log in to unmask] >> >> >> >> WARC File Format Published as an International Standard >> http://netpreserve.org/press/pr20090601.php >> >> ISO 28500:2009 specifies the WARC file format: >> >> * to store both the payload content and control information from >> mainstream Internet application layer protocols, such as the >> Hypertext Transfer Protocol (HTTP), Domain Name System (DNS), >> and File Transfer Protocol (FTP); >> * to store arbitrary metadata linked to other stored data >> (e.g. subject classifier, discovered language, encoding); >> * to support data compression and maintain data record integrity; >> * to store all control information from the harvesting protocol >> (e.g. request headers), not just response information; >> * to store the results of data transformations linked to other >> stored data; >> * to store a duplicate detection event linked to other stored >> data (to reduce storage in the presence of identical or >> substantially similar resources); >> * to be extended without disruption to existing functionality; >> * to support handling of overly long records by truncation or >> segmentation, where desired. >> >> >> more info here: >> http://www.digitalpreservation.gov/formats/fdd/fdd000236.shtml >> >> > >