Jan 3, 2013 5:24:42 PM dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
FINE: Received ready message: ID:60519-130.226.228.8(c4:bc:5d:5a:b4:1d)-36258-1357230282506: To TEST1_COMMON_HARVESTER_STATUS_TOPIC ReplyTo TEST1_COMMON_ERROR OK
Jan 3, 2013 5:24:53 PM dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
FINE: Received ready message: ID:60519-130.225.27.140(a5:fb:90:ab:9:d5)-41887-1357230293918: To TEST1_COMMON_HARVESTER_STATUS_TOPIC ReplyTo TEST1_COMMON_ERROR OK
Jan 3, 2013 5:24:57 PM dk.netarkivet.harvester.datamodel.HarvestDefinitionDBDAO read
FINE: Reading harvestdefinition w/ id 2
Jan 3, 2013 5:24:57 PM dk.netarkivet.harvester.datamodel.HarvestDefinitionDBDAO read
FINE: Partialharvest found w/ id 2
Jan 3, 2013 5:24:57 PM dk.netarkivet.harvester.datamodel.ScheduleDBDAO read
FINE: Creating frequency for (timeunit,anytime,numtimeunits,hour, minute, dayofweek,dayofmonth) = (1, true,1,null,null,null,null,)
Jan 3, 2013 5:24:57 PM dk.netarkivet.harvester.datamodel.Frequency getNewInstance
FINE: Creating a HOURLY frequency.
Jan 3, 2013 5:24:57 PM dk.netarkivet.harvester.datamodel.ScheduleDBDAO read
FINE: Creating frequency for (timeunit,anytime,numtimeunits,hour, minute, dayofweek,dayofmonth) = (1, true,1,null,null,null,null,)
Jan 3, 2013 5:24:57 PM dk.netarkivet.harvester.datamodel.Frequency getNewInstance
FINE: Creating a HOURLY frequency.
Jan 3, 2013 5:24:57 PM dk.netarkivet.harvester.scheduler.HarvestJobGenerator$JobGeneratorTask generateJobs
INFO: Starting to create jobs for harvest definition #2(EVH)
Jan 3, 2013 5:24:57 PM dk.netarkivet.harvester.scheduler.jobgen.AbstractJobGenerator checkAddDomainConfInvariant
FINE: Job already has a configuration for Domain 'netarkivet.dk'.
Jan 3, 2013 5:24:57 PM dk.netarkivet.harvester.datamodel.JobDBDAO create
FINE: Creating Job 2 (state = NEW, HD = 2, priority = HIGHPRIORITY, forcemaxcount = 1000000000, forcemaxbytes = 1000000000, forcemaxrunningtime = 0, orderxml = frontpages, numconfigs = 3, created = Thu Jan 03 17:24:57 CET 2013)
Jan 3, 2013 5:24:57 PM dk.netarkivet.harvester.datamodel.JobDBDAO create
FINE: Creating Job 3 (state = NEW, HD = 2, priority = HIGHPRIORITY, forcemaxcount = -1, forcemaxbytes = 1000000000, forcemaxrunningtime = 0, orderxml = frontpages_plus_2levels, numconfigs = 2, created = Thu Jan 03 17:24:57 CET 2013)
Jan 3, 2013 5:24:57 PM dk.netarkivet.harvester.scheduler.jobgen.DefaultJobGenerator processDomainConfigurationSubset
FINE: Generated job: 'Job 3 (state = NEW, HD = 2, priority = HIGHPRIORITY, forcemaxcount = -1, forcemaxbytes = 1000000000, forcemaxrunningtime = 0, orderxml = frontpages_plus_2levels, numconfigs = 2, created = Thu Jan 03 17:24:57 CET 2013)'
Jan 3, 2013 5:24:57 PM dk.netarkivet.harvester.scheduler.jobgen.DefaultJobGenerator processDomainConfigurationSubset
FINE: Job configurationsDomain:
 kaarefc.dk:EVH_frontpages_plus_2levels_1000000000Bytes_UnlimitedObjects
 netarkivet.dk:EVH_frontpages_plus_2levels_1000000000Bytes_UnlimitedObjects
Jan 3, 2013 5:24:57 PM dk.netarkivet.harvester.scheduler.jobgen.AbstractJobGenerator generateJobs
WARNING: Refusing to schedule harvest definition 'EVH' in the past. Skipped 1 events. Old nextDate was Thu Jan 03 16:07:50 CET 2013 new nextDate is Thu Jan 03 18:07:50 CET 2013
Jan 3, 2013 5:24:57 PM dk.netarkivet.harvester.scheduler.HarvestJobGenerator$JobGeneratorTask$1 run
INFO: Created 2 jobs for harvest definition (EVH)
Jan 3, 2013 5:24:57 PM dk.netarkivet.harvester.datamodel.HarvestDefinitionDBDAO update
FINE: 1 partialharvests records updated
Jan 3, 2013 5:24:57 PM dk.netarkivet.harvester.scheduler.HarvestJobGenerator$JobGeneratorTask$1 run
FINE: Removed HD #2(EVH) from list of harvestdefinitions to be scheduled. Harvestdefinitions still to be scheduled: []
Jan 3, 2013 5:25:07 PM dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
FINE: Received ready message: ID:60520-130.226.228.7(e6:3:72:26:bd:67)-46124-1357230307161: To TEST1_COMMON_HARVESTER_STATUS_TOPIC ReplyTo TEST1_COMMON_ERROR OK
Jan 3, 2013 5:25:12 PM dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
FINE: Received ready message: ID:60557-130.226.228.8(85:9e:f0:3c:e8:80)-36260-1357230312508: To TEST1_COMMON_HARVESTER_STATUS_TOPIC ReplyTo TEST1_COMMON_ERROR OK
Jan 3, 2013 5:25:12 PM dk.netarkivet.harvester.scheduler.JobDispatcher submitNextNewJob
FINE: Submitting new HIGHPRIORITY job2
Jan 3, 2013 5:25:12 PM dk.netarkivet.harvester.scheduler.JobDispatcher doOneCrawl
FINE: Send crawl request: NO ID: To TEST1_COMMON_ANY_HIGHPRIORITY_HACO ReplyTo TEST1_COMMON_ERROR OK Job: Job 2 (state = SUBMITTED, HD = 2, priority = HIGHPRIORITY, forcemaxcount = 1000000000, forcemaxbytes = 1000000000, forcemaxrunningtime = 0, orderxml = frontpages, numconfigs = 3, created = Thu Jan 03 17:24:57 CET 2013, submitted = Thu Jan 03 17:25:12 CET 2013), metadata: [URL= metadata://netarkivet.dk/crawl/setup/duplicatereductionjobs?majorversion=1&minorversion=0&harvestid=2&harvestnum=0&jobid=2 ; mimetype= text/plain ; data= ]
Jan 3, 2013 5:25:12 PM dk.netarkivet.harvester.scheduler.JobDispatcher submitNextNewJob
INFO: Job #2 submitted
Jan 3, 2013 5:25:12 PM dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
FINE: Received ready message: ID:60520-130.226.228.8(c4:bc:5d:5a:b4:1d)-36258-1357230312509: To TEST1_COMMON_HARVESTER_STATUS_TOPIC ReplyTo TEST1_COMMON_ERROR OK
Jan 3, 2013 5:25:12 PM dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer processCrawlStatusMessage
FINE: Job 2 (state = STARTED, HD = 2, priority = HIGHPRIORITY, forcemaxcount = 1000000000, forcemaxbytes = 1000000000, forcemaxrunningtime = 0, orderxml = frontpages, numconfigs = 3, created = Thu Jan 03 17:24:57 CET 2013, submitted = Thu Jan 03 17:25:12 CET 2013, started = Thu Jan 03 17:25:12 CET 2013) has started crawling.
Jan 3, 2013 5:25:23 PM dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
FINE: Received ready message: ID:60520-130.225.27.140(a5:fb:90:ab:9:d5)-41887-1357230323918: To TEST1_COMMON_HARVESTER_STATUS_TOPIC ReplyTo TEST1_COMMON_ERROR OK
Jan 3, 2013 5:25:23 PM dk.netarkivet.harvester.scheduler.JobDispatcher submitNextNewJob
FINE: Submitting new HIGHPRIORITY job3
Jan 3, 2013 5:25:23 PM dk.netarkivet.harvester.scheduler.JobDispatcher doOneCrawl
FINE: Send crawl request: NO ID: To TEST1_COMMON_ANY_HIGHPRIORITY_HACO ReplyTo TEST1_COMMON_ERROR OK Job: Job 3 (state = SUBMITTED, HD = 2, priority = HIGHPRIORITY, forcemaxcount = -1, forcemaxbytes = 1000000000, forcemaxrunningtime = 0, orderxml = frontpages_plus_2levels, numconfigs = 2, created = Thu Jan 03 17:24:57 CET 2013, submitted = Thu Jan 03 17:25:23 CET 2013), metadata: [URL= metadata://netarkivet.dk/crawl/setup/duplicatereductionjobs?majorversion=1&minorversion=0&harvestid=2&harvestnum=0&jobid=3 ; mimetype= text/plain ; data= ]
Jan 3, 2013 5:25:24 PM dk.netarkivet.harvester.scheduler.JobDispatcher submitNextNewJob
INFO: Job #3 submitted
Jan 3, 2013 5:25:24 PM dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer processCrawlStatusMessage
FINE: Job 3 (state = STARTED, HD = 2, priority = HIGHPRIORITY, forcemaxcount = -1, forcemaxbytes = 1000000000, forcemaxrunningtime = 0, orderxml = frontpages_plus_2levels, numconfigs = 2, created = Thu Jan 03 17:24:57 CET 2013, submitted = Thu Jan 03 17:25:23 CET 2013, started = Thu Jan 03 17:25:24 CET 2013) has started crawling.
Jan 3, 2013 5:25:37 PM dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
FINE: Received ready message: ID:60522-130.226.228.7(e6:3:72:26:bd:67)-46124-1357230337162: To TEST1_COMMON_HARVESTER_STATUS_TOPIC ReplyTo TEST1_COMMON_ERROR OK
Jan 3, 2013 5:25:42 PM dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
FINE: Received ready message: ID:60522-130.226.228.8(c4:bc:5d:5a:b4:1d)-36258-1357230342510: To TEST1_COMMON_HARVESTER_STATUS_TOPIC ReplyTo TEST1_COMMON_ERROR OK
Jan 3, 2013 5:26:07 PM dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
FINE: Received ready message: ID:60523-130.226.228.7(e6:3:72:26:bd:67)-46124-1357230367161: To TEST1_COMMON_HARVESTER_STATUS_TOPIC ReplyTo TEST1_COMMON_ERROR OK
Jan 3, 2013 5:26:12 PM dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
FINE: Received ready message: ID:60523-130.226.228.8(c4:bc:5d:5a:b4:1d)-36258-1357230372509: To TEST1_COMMON_HARVESTER_STATUS_TOPIC ReplyTo TEST1_COMMON_ERROR OK
Jan 3, 2013 5:26:37 PM dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
FINE: Received ready message: ID:60525-130.226.228.7(e6:3:72:26:bd:67)-46124-1357230397162: To TEST1_COMMON_HARVESTER_STATUS_TOPIC ReplyTo TEST1_COMMON_ERROR OK
Jan 3, 2013 5:26:42 PM dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
FINE: Received ready message: ID:60525-130.226.228.8(c4:bc:5d:5a:b4:1d)-36258-1357230402509: To TEST1_COMMON_HARVESTER_STATUS_TOPIC ReplyTo TEST1_COMMON_ERROR OK
Jan 3, 2013 5:27:07 PM dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
FINE: Received ready message: ID:60526-130.226.228.7(e6:3:72:26:bd:67)-46124-1357230427161: To TEST1_COMMON_HARVESTER_STATUS_TOPIC ReplyTo TEST1_COMMON_ERROR OK
Jan 3, 2013 5:27:12 PM dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
FINE: Received ready message: ID:60526-130.226.228.8(c4:bc:5d:5a:b4:1d)-36258-1357230432509: To TEST1_COMMON_HARVESTER_STATUS_TOPIC ReplyTo TEST1_COMMON_ERROR OK
Jan 3, 2013 5:27:37 PM dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
FINE: Received ready message: ID:60528-130.226.228.7(e6:3:72:26:bd:67)-46124-1357230457161: To TEST1_COMMON_HARVESTER_STATUS_TOPIC ReplyTo TEST1_COMMON_ERROR OK
Jan 3, 2013 5:27:42 PM dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
FINE: Received ready message: ID:60528-130.226.228.8(c4:bc:5d:5a:b4:1d)-36258-1357230462509: To TEST1_COMMON_HARVESTER_STATUS_TOPIC ReplyTo TEST1_COMMON_ERROR OK
Jan 3, 2013 5:28:07 PM dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
FINE: Received ready message: ID:60529-130.226.228.7(e6:3:72:26:bd:67)-46124-1357230487161: To TEST1_COMMON_HARVESTER_STATUS_TOPIC ReplyTo TEST1_COMMON_ERROR OK
Jan 3, 2013 5:28:12 PM dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
FINE: Received ready message: ID:60529-130.226.228.8(c4:bc:5d:5a:b4:1d)-36258-1357230492509: To TEST1_COMMON_HARVESTER_STATUS_TOPIC ReplyTo TEST1_COMMON_ERROR OK
Jan 3, 2013 5:28:37 PM dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
FINE: Received ready message: ID:60531-130.226.228.7(e6:3:72:26:bd:67)-46124-1357230517162: To TEST1_COMMON_HARVESTER_STATUS_TOPIC ReplyTo TEST1_COMMON_ERROR OK
Jan 3, 2013 5:28:42 PM dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
FINE: Received ready message: ID:60531-130.226.228.8(c4:bc:5d:5a:b4:1d)-36258-1357230522509: To TEST1_COMMON_HARVESTER_STATUS_TOPIC ReplyTo TEST1_COMMON_ERROR OK