This is the new style usage introduced with The command line interface has changed yet again for v0.5.56.
The command line interface is work in progress. There may come more refactoringmain help page only lists command and global options.
Use jwattools help <command> to show a command's usage.
C:\Java\workspace\jwat-tools>target\jwat-tools-0.5.56-SNAPSHOT\jwattools.cmd JWATTools v0.5.56 usage: JWATTools [-dte19] command [file ...<command> [<args>] Commands: arc2warc convert ARC to WARC cdx create a CDX index (unsorted) compress compress decompress decompress extract extract ARC/WARC record(s) interval interval extract pathindex create a heritrix path index (unsorted) test test validity of ARC/WARC/GZip file(s) unpack unpack multifile GZip Options: See 'jwattools help -r<command>' for more information on a recursive -w<x> thread(s) Test options: -e show errors -l relaxed URL URI validation -x to validate text/xml payload (eg. mets) Compress options: -1, --fast compress faster -9, --slow compress better specific command. C:\Java\workspace\jwat-tools>
This is the old style usage Command line interface for v0.5.4. (It will be removed once a binary v0.5.5 has been uploaded)
C:\Java\workspace\jwat-tools>target\jwat-tools-0.5.45-SNAPSHOT\jwattools.cmd JWATTools v0.5.45 usageUsage: JWATTools [-dte19] command [file ...] Commands: -t arc2warc convert ARC to WARC cdx create a CDX index (unsorted) compress compress decompress decompress extract extract ARC/WARC record(s) interval interval extract pathindex create a heritrix path index (unsorted) test test validity of ARC, /WARC and/or GZip file(s) unpack unpack multifile GZip Options: -r recursive (currently has no effect) -w<x> set the amount of worker thread(s) (defaults to 1) Test options: -e show errors -l relaxed URL URI validation -x to validate text/xml payload (eg. mets) Compress -doptions: decompress -1, compress faster -9--fast compress betterfaster -i interval extract -u unpack multifile gzip -c-9, --slow convertcompress arcbetter to warc -C output CDX C:\Java\workspace\jwat-tools>
You can supply one or more files. Each file can contain * and/or ? wildcards, but only in the filename part of the path. You can use more wildcards at the same time if you want.
Reads and validates all the files supplied. Files which are not recognized as either GZip, ARC or WARC are skipped. If wildcards are used, files that do not match are also skipped.
Use -e for more than a summary of errors.
Decompress one or more (multi-part) GZip files and write the decompressed data to a new file, one for each input file.
Useful for decompressing ARC and/or WARC files.
Is currently ignored. All operations are currently recursive.
Compress normal and/or WARC files.
-i (interval extract)
Extract an interval from a given file. Interval can be expressed as offset, offset2 or offset,+length. Offset and length can be expressed in hex by pre-pending "$" or "0x".
Unpack a (multi-file)GZip and save each entry as individual files.
Convert ARC files to WARC.
-C (output CDX)
Index one or more ARC/WARC files and output the result in CDX format.