Manage reindexing of deduplication records

In the new metadata files there will be the original crawllog and an extra record with a lookup
from the old offsets to the new. In RawMetadataCache.cacheData() we need to call second batch job which fetches this new record (if it exists) and applies it to the output of the first.