Critical Description
Many uploads fails and odd errors can be found in the logs.
The problem might be with the ftp servers.
The following error messages were found in the log of a bitarchive application:
15-07-2010 13:56:27 dk.netarkivet.archive.bitarchive.distribute.BitarchiveServer visit INFO: Sending reply: ID:21078-130.226.228.71(8f:bb:61:bb:2a:34)-34502-1279195311805: To PROD_KB_ANY_BA ReplyTo PROD_COMMON_THE_REPOS Error: dk.netarkivet.common.exceptions.IOFailure: Can't copy file into archive: 89115-33-20100713200303-00007-sb-prod-har-001.statsbiblioteket.dk.arc dk.netarkivet.common.exceptions.IOFailure: Can't copy file into archive: 89115-33-20100713200303-00007-sb-prod-har-001.statsbiblioteket.dk.arc at dk.netarkivet.archive.bitarchive.Bitarchive.copyRemoteFileToArchive(Bitarchive.java:307) at dk.netarkivet.archive.bitarchive.Bitarchive.upload(Bitarchive.java:198) at dk.netarkivet.archive.bitarchive.distribute.BitarchiveServer.visit(BitarchiveServer.java:281) at dk.netarkivet.archive.bitarchive.distribute.UploadMessage.accept(UploadMessage.java:81) at dk.netarkivet.archive.distribute.ArchiveMessageHandler.onMessage(ArchiveMessageHandler.java:83) at com.sun.messaging.jmq.jmsclient.MessageConsumerImpl.deliverAndAcknowledge(MessageConsumerImpl.java:330) at com.sun.messaging.jmq.jmsclient.MessageConsumerImpl.onMessage(MessageConsumerImpl.java:265) at com.sun.messaging.jmq.jmsclient.SessionReader.deliver(SessionReader.java:102) at com.sun.messaging.jmq.jmsclient.ConsumerReader.run(ConsumerReader.java:174) at java.lang.Thread.run(Unknown Source) Caused by: dk.netarkivet.common.exceptions.IOFailure: IO trouble transferring file at dk.netarkivet.common.distribute.AbstractRemoteFile.copyTo(AbstractRemoteFile.java:119) at dk.netarkivet.archive.bitarchive.Bitarchive.copyRemoteFileToArchive(Bitarchive.java:298) ... 9 more Caused by: dk.netarkivet.common.exceptions.IOFailure: Append operation from '89115-33-20100713200303-00007-sb-prod-har-001.statsbiblioteket.dk.arc-85908-1279195310832' failed at dk.netarkivet.common.distribute.FTPRemoteFile.appendTo(FTPRemoteFile.java:408) at dk.netarkivet.common.distribute.AbstractRemoteFile.copyTo(AbstractRemoteFile.java:107) ... 10 more Caused by: org.apache.commons.net.io.CopyStreamException: IOException caught while copying. at org.apache.commons.net.io.Util.copyStream(Util.java:129) at org.apache.commons.net.ftp.FTPClient.retrieveFile(FTPClient.java:1286) at dk.netarkivet.common.distribute.FTPRemoteFile.appendTo(FTPRemoteFile.java:386) ... 11 more Arcfile: 89115-33-20100713200303-00007-sb-prod-har-001.statsbiblioteket.dk.arc 15-07-2010 13:56:27 dk.netarkivet.archive.bitarchive.distribute.BitarchiveServer visit WARNING: Error while processing upload message 'ID:21078-130.226.228.71(8f:bb:61:bb:2a:34)-34502-1279195311805: To PROD_KB_ANY_BA ReplyTo PROD_COMMON_THE_REPOS OK Arcfile: 89115-33-20100713200303-00007-sb-prod-har-001.statsbiblioteket.dk.arc' dk.netarkivet.common.exceptions.IOFailure: Can't copy file into archive: 89115-33-20100713200303-00007-sb-prod-har-001.statsbiblioteket.dk.arc at dk.netarkivet.archive.bitarchive.Bitarchive.copyRemoteFileToArchive(Bitarchive.java:307) at dk.netarkivet.archive.bitarchive.Bitarchive.upload(Bitarchive.java:198) at dk.netarkivet.archive.bitarchive.distribute.BitarchiveServer.visit(BitarchiveServer.java:281) at dk.netarkivet.archive.bitarchive.distribute.UploadMessage.accept(UploadMessage.java:81) at dk.netarkivet.archive.distribute.ArchiveMessageHandler.onMessage(ArchiveMessageHandler.java:83) at com.sun.messaging.jmq.jmsclient.MessageConsumerImpl.deliverAndAcknowledge(MessageConsumerImpl.java:330) at com.sun.messaging.jmq.jmsclient.MessageConsumerImpl.onMessage(MessageConsumerImpl.java:265) at com.sun.messaging.jmq.jmsclient.SessionReader.deliver(SessionReader.java:102) at com.sun.messaging.jmq.jmsclient.ConsumerReader.run(ConsumerReader.java:174) at java.lang.Thread.run(Unknown Source) Caused by: dk.netarkivet.common.exceptions.IOFailure: IO trouble transferring file at dk.netarkivet.common.distribute.AbstractRemoteFile.copyTo(AbstractRemoteFile.java:119) at dk.netarkivet.archive.bitarchive.Bitarchive.copyRemoteFileToArchive(Bitarchive.java:298) ... 9 more Caused by: dk.netarkivet.common.exceptions.IOFailure: Append operation from '89115-33-20100713200303-00007-sb-prod-har-001.statsbiblioteket.dk.arc-85908-1279195310832' failed at dk.netarkivet.common.distribute.FTPRemoteFile.appendTo(FTPRemoteFile.java:408) at dk.netarkivet.common.distribute.AbstractRemoteFile.copyTo(AbstractRemoteFile.java:107) ... 10 more Caused by: org.apache.commons.net.io.CopyStreamException: IOException caught while copying. at org.apache.commons.net.io.Util.copyStream(Util.java:129) at org.apache.commons.net.ftp.FTPClient.retrieveFile(FTPClient.java:1286) at dk.netarkivet.common.distribute.FTPRemoteFile.appendTo(FTPRemoteFile.java:386) ... 11 more 15-07-2010 13:56:27 dk.netarkivet.common.distribute.FTPRemoteFile appendTo WARNING: Append operation from '89115-33-20100713200303-00007-sb-prod-har-001.statsbiblioteket.dk.arc-85908-1279195310832' failed org.apache.commons.net.io.CopyStreamException: IOException caught while copying. at org.apache.commons.net.io.Util.copyStream(Util.java:129) at org.apache.commons.net.ftp.FTPClient.retrieveFile(FTPClient.java:1286) at dk.netarkivet.common.distribute.FTPRemoteFile.appendTo(FTPRemoteFile.java:386) at dk.netarkivet.common.distribute.AbstractRemoteFile.copyTo(AbstractRemoteFile.java:107) at dk.netarkivet.archive.bitarchive.Bitarchive.copyRemoteFileToArchive(Bitarchive.java:298) at dk.netarkivet.archive.bitarchive.Bitarchive.upload(Bitarchive.java:198) at dk.netarkivet.archive.bitarchive.distribute.BitarchiveServer.visit(BitarchiveServer.java:281) at dk.netarkivet.archive.bitarchive.distribute.UploadMessage.accept(UploadMessage.java:81) at dk.netarkivet.archive.distribute.ArchiveMessageHandler.onMessage(ArchiveMessageHandler.java:83) at com.sun.messaging.jmq.jmsclient.MessageConsumerImpl.deliverAndAcknowledge(MessageConsumerImpl.java:330) at com.sun.messaging.jmq.jmsclient.MessageConsumerImpl.onMessage(MessageConsumerImpl.java:265) at com.sun.messaging.jmq.jmsclient.SessionReader.deliver(SessionReader.java:102) at com.sun.messaging.jmq.jmsclient.ConsumerReader.run(ConsumerReader.java:174) at java.lang.Thread.run(Unknown Source)