Harvest Postprocessing fails when harvestjob produces many archive files (> 1000) and ulimit is rather low

When running in metadata warc-mode, at each harvest job produces > 1000 archivefiles, during harvest processing you can run out of files.

This is not an issue when generating metadata ARC-files