Uploaded image for project: 'NetarchiveSuite'
  1. NetarchiveSuite
  2. NAS-2154

Out Of Memory Error during checksum job

    XMLWordPrintable

Details

    • Bug
    • Resolution: Won't Fix
    • Major
    • None
    • None
    • None
    • None

    Description

      In TEST7, when checking checksums for the CS replica:

      Jan 15, 2013 5:10:57 PM dk.netarkivet.archive.arcrepositoryadmin.ReplicaCacheDatabase addChecksumInformation
      INFO: Processed checksum list entry number 3568000 for replica CHECKSUMReplica (CS) CSN
      Jan 15, 2013 5:10:57 PM dk.netarkivet.archive.arcrepositoryadmin.ReplicaCacheDatabase addChecksumInformation
      FINE: Databaseconnection has now been renewed
      Jan 15, 2013 5:10:59 PM dk.netarkivet.archive.arcrepositoryadmin.ReplicaCacheDatabase addChecksumInformation
      WARNING: Found 21 missing files for replica 'CHECKSUMReplica (CS) CSN'.
      Jan 15, 2013 5:11:01 PM dk.netarkivet.archive.arcrepositoryadmin.ReplicaCacheDatabase addChecksumInformation
      INFO: Finished processing of 3568625 checksum entries for replica CS
      Jan 15, 2013 5:11:02 PM dk.netarkivet.archive.arcrepositoryadmin.ReplicaCacheDatabase updateChecksumStatus
      INFO: UpdateChecksumStatus operation commencing
      Jan 15, 2013 5:11:02 PM dk.netarkivet.common.utils.DBUtils executeSQL
      FINE: Executing SQL-statement: UPDATE replicafileinfo SET checksum_status = 2 WHERE checksum_status != 2 AND file_id IN (   SELECT file_id   FROM (     SELECT file_id, COUNT(file_id) AS checksums, SUM(replicas) replicas     FROM (       SELECT file_id, COUNT(checksum) AS replicas, checksum       FROM replicafileinfo       WHERE filelist_status != 1 AND checksum IS NOT NULL       GROUP BY file_id, checksum     ) AS ss1     GROUP BY file_id   ) AS ss2   WHERE checksums = 1 )
      Jan 15, 2013 7:11:15 PM dk.netarkivet.common.utils.DBUtils executeSQL
      WARNING: SQL error updating database with sql: UPDATE replicafileinfo SET checksum_status = 2 WHERE checksum_status != 2 AND file_id IN (   SELECT file_id   FROM (     SELECT file_id, COUNT(file_id) AS checksums, SUM(replicas) replicas     FROM (       SELECT file_id, COUNT(checksum) AS replicas, checksum       FROM replicafileinfo       WHERE filelist_status != 1 AND checksum IS NOT NULL       GROUP BY file_id, checksum     ) AS ss1     GROUP BY file_id   ) AS ss2   WHERE checksums = 1 )
      SQLException trace:
      SQL State:38000
      Error Code:-1
      java.sql.SQLException: The exception 'java.lang.OutOfMemoryError: GC overhead limit exceeded' was thrown while evaluating an expression.
              at org.apache.derby.client.am.SQLExceptionFactory40.getSQLException(Unknown Source)
              at org.apache.derby.client.am.SqlException.getSQLException(Unknown Source)
              at org.apache.derby.client.am.PreparedStatement.executeUpdate(Unknown Source)
              at com.mchange.v2.c3p0.impl.NewProxyPreparedStatement.executeUpdate(NewProxyPreparedStatement.java:105)
              at dk.netarkivet.common.utils.DBUtils.executeSQL(DBUtils.java:1035)
              at dk.netarkivet.archive.arcrepositoryadmin.ReplicaCacheDatabase.updateChecksumStatus(ReplicaCacheDatabase.java:755)
              at dk.netarkivet.archive.arcrepository.bitpreservation.DatabaseBasedActiveBitPreservation.findChangedFiles(DatabaseBasedActiveBitPreservation.java:468)
              at dk.netarkivet.archive.webinterface.BitpreservationUpdateThread.run(BitpreservationUpdateThread.java:77)
      Caused by: org.apache.derby.client.am.SqlException: The exception 'java.lang.OutOfMemoryError: GC overhead limit exceeded' was thrown while evaluating an expression.
      

      Attachments

        Issue Links

          Activity

            People

              nicl@kb.dk Nicholas Clarke (Inactive)
              csr Colin Rosenthal
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: