Page tree

Note that the this documentation is for the old 5.1 release.
For the newest documentation, please see the current release documentation home.

Skip to end of metadata
Go to start of metadata

Contents

Install the QuickStart according to the Quick Start Manual, e.g. in /home/test/QUICKSTART

  • Add some domains to harvest using the the ADMGUI e.g. netarkivet.dk, kb.dk, statsbiblioteket.dk
  • Create and run a snapshot with a byte limit of 100.000
  • Wait until the job is done
  • Setup your browser for browsing and index your harvest job

    cd /home/test/QUICKSTART/bitarkiv/filedir
    export CLASSPATH=/home/test/QUICKSTART/lib/netarchivesuite-common-core.jar
    export LOG=-Dlogback.configurationFile=/path/to/logback.xml
    ls 

    e.g.

Extract CDX:

export FILEONE=1-1-20090519083732-00002-dia-test-int-01.kb.dk.warc
java $LOG dk.netarkivet.common.tools.ArchiveExtractCDX $FILEONE > output.cdx 

Get Record using Lucene:

#e.g. an URI from the harvest found in your "viewerproxy"
export URI=http://netarkivet.dk/index-da.php
cd /home/test/QUICKSTART/cache/fullcrawllogindex
cp -r 1-cache 1-cache.unzip
cd 1-cache.unzip/
ls
gunzip *
export SETTINGSFILE=/home/test/QUICKSTART/conf/settings.xml
export LUCENE_INDEX=/home/test/QUICKSTART/cache/fullcrawllogindex/1-cache.unzip
export OPTS=-Ddk.netarkivet.settings.file=$SETTINGSFILE \
      -Dsettings.common.remoteFile.port=5000 
java $LOG $OPTS dk.netarkivet.archive.tools.GetRecord $LUCENE_INDEX $URI

Upload:

cd /home/test/QUICKSTART
cp /home/test/QUICKSTART/bitarkiv/filedir/resulting.arc new_resulting.arc
export SETTINGSFILE=/home/test/QUICKSTART/settings.xml
export OPTS=-Ddk.netarkivet.settings.file=$SETTINGSFILE -Dsettings.common.remoteFile.port=5000
java $LOG $OPTS -cp /home/test/QUICKSTART/lib/netarchivesuite-archive-core.jar dk.netarkivet.archive.tools.Upload new_resulting.arc
#just press <CTRL-C> to stop the job

Batch e.g. with checksum:

cd /home/test/QUICKSTART
mkdir batchprogs

#copy example batchprog ChecksumJob.java to  batchprogs/.
cd batchprogs
javac ChecksumJob.java
export SETTINGSFILE=/home/test/QUICKSTART/settings.xml
java -cp lib/netarchivesuite-archive-core.jar -Dsettings.common.remoteFile.port=5000 \
$LOG -Ddk.netarkivet.settings.file=$SETTINGSFILE dk.netarkivet.archive.tools.RunBatch \
-Cbatchprogs/ChecksumJob.class -Ooutput.checksum

ChecksumJob.java

 

  • No labels

5 Comments

  1. Anonymous

    http://ourlandusa.org/forums/topic/cheap-advair-purchase-no-prescription-advair-canada-online-pharmacy - http://ourlandusa.org/forums/topic/cheap-advair-purchase-no-prescription-advair-canada-online-pharmacy/ http://smallvictoriesfoundation.org/forums/forum/creative-classes - Hydrocortisone Cream without prescription shipped overnight http://dsthost.online/?q=node/648495 - http://dsthost.online/?q=node/648495 http://www.av200.org/forums/forum/general-discussion - Emla Online Canada http://www.av200.org/forums/forum/general-discussion - Buy Ketoconazole Cream For Sale Online, Order Ketoconazole Cream Online Overnight Minocycline For Acne More Drug_interactions Where To Buy Cheap Amoxicillin Pills Online With No Prescription Topamax Discount Otc http://www.salutron.com/forums/forum/how-does-lorem-ipsum-betrasd - Free Shipping Cardura No Prescription http://autographics-inc.com/node/104826 - http://autographics-inc.com/node/104826 http://ourlandusa.org/forums/topic/buy-cheap-nervz-g-purchase-no-prescription-buy-nervz-g-fedex-ups - http://ourlandusa.org/forums/topic/buy-cheap-nervz-g-purchase-no-prescription-buy-nervz-g-fedex-ups/ https://pharmaken.net/forums/forum/discussion - Buy Retin A Mastercard Efectos Secundarios Del Paxil Take 5 Tylenol Pms http://asuh.hawaii.edu/drhazelton/cheap_clozapine_online_no_prescription_clozapine_no_prior_prescription - Clozapine NO PRESCRIPTION Required. How Long On Citalopram Celexa Take Aspirin And Paracetamol Love Simvastatin And Ezetimibe In Aortic Stenosis Lipid Lowering Therapy Keflex Overnight Visa No Prescription . Must Zyban Flagyl Patch . Amitriptyline Death Terol Online NO PRESCRIPTION Canada Tetracycline For Periodontal Disease Lamictal Drowsiness Treatment Of Bipolar Disorder Lovenox Vs Plavix Blood Thinners Zetia Interaction With Lipitor http://www.herballove.com/forum/non-generic-benzac-ac-no-prescription-buy-benzac-ac-cheap-online - purchase Benzac Ac Cheap Online Non generic Benzac Ac no prescription
  2. Anonymous

    topjl89n7n viagra online prescription free - online viagra - buy generic viagra online - <a href="http://viagraonlinetop2017.com"> buy viagra online</a> - cheap viagra online canadian pharmacy
  3. Anonymous

    tophk43p9h male enhancement pills reviews male enhancement surgery <a href="http://bestmalesenhancementpills.com"> extenze male enhancement</a> http://bestmalesenhancementpills.com - best male enhancement rhino male enhancement
  4. Anonymous

    pharmacy price comparison canadian online pharmacies buy prescription drugs without doctor universal drugstore canada compare rx prices green xanax
  5. Anonymous

    online pharmacies no prescription canadian pharmacy drug stores near me sertraline bnf canada drug pharmacy pfizer viagra
Write a comment…