warc extraction

47 views
Skip to first unread message

nukleon rusnack

unread,
Jul 9, 2009, 4:04:13 PM7/9/09
to warc-tools
Hello

I have been searching for a way to extract records from (w)arc
archives into files. We would like to build a mirror-like structure
from warc files.
I know that there are some scripts that makes this possible on arc
archives, but missing CRC checks make it useless. Only some portion of
arc archive can be fully extracted.
As far as I know, warc archives dont have this problem. but I havent
found the way to extract file from the warc record. I have compiled
your tools, but warcdump doesnt seem to offer this functionality.
Could you please tell us, if there is a way to extract data
information?

Thanks

Noah Levitt

unread,
Jul 9, 2009, 4:20:51 PM7/9/09
to warc-...@googlegroups.com
Hello Nukleon, is "wrecordbody" what you're looking for?

Noah
Reply all
Reply to author
Forward
0 new messages