Uploaded image for project: 'WebDanica'
  1. WebDanica
  2. WEBDAN-209

Errors in ingestTool

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Blocker
    • None
    • None
    • DATABASE, HBase
    • None
    • webdanicasprint - sommer 2017

    Description

      Executing  bash ingestTool.sh /opt/workflows//automatic-workflow/working/harvestLog-20-08-2017-1503258348860.txt  /opt/workflows//automatic-workflow 1.1-RC8
      SLF4J: Class path contains multiple SLF4J bindings.
      SLF4J: Found binding in [jar:file:/opt/workflows/automatic-workflow/lib/phoenix-4.7.0-HBase-1.1-client.jar!/org/slf4j/impl/StaticLoggerBinder.class]
      SLF4J: Found binding in [jar:file:/opt/workflows/automatic-workflow/lib/logback-classic-1.0.13.jar!/org/slf4j/impl/StaticLoggerBinder.class]
      SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
      aug 23, 2017 5:20:45 PM dk.kb.webdanica.core.utils.SettingsUtilities getStringSetting
      INFO: Using value 'hbase-phoenix' for setting 'settings.database.system'.
      aug 23, 2017 5:20:45 PM dk.kb.webdanica.core.datamodel.dao.HBasePhoenixConnectionManager register
      INFO: Now created instance of 'org.apache.phoenix.jdbc.PhoenixDriver
      aug 23, 2017 5:20:45 PM dk.kb.webdanica.core.utils.SettingsUtilities getStringSetting
      INFO: Using value 'jdbc:phoenix:narcana-hbase01.statsbiblioteket.dk,narcana-hbase02.statsbiblioteket.dk,narcana-yarn01.statsbiblioteket.dk,narcana-yarn02.statsbiblioteket.dk,narcana-ambari01.statsbiblioteket.dk:2181:/hbase' for setting 'settings.database.connection'.
      Ignoring line: Harvestlog for  harvests initiated by the Webdanica webapp at Sun Aug 20 21:45:48 CEST 2017
      log4j:WARN No appenders could be found for logger (org.apache.hadoop.metrics2.lib.MutableMetricsFactory).
      log4j:WARN Please initialize the log4j system properly.
      log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
      Skip ingest of harvest 'webdanica-trial-1503258108782' -  a harvest with this name already exists in database
      Skip ingest of harvest 'webdanica-trial-1503258228830' -  a harvest with this name already exists in database
      The list of loaded data settings is empty. Is this OK?aug 23, 2017 5:20:50 PM dk.kb.webdanica.core.utils.SettingsUtilities getBooleanSetting
      INFO: Using value 'true' for setting 'settings.seeds.rejectDkUrls'.
      aug 23, 2017 5:20:50 PM dk.kb.webdanica.core.utils.SettingsUtilities getBooleanSetting
      INFO: Using value 'true' for setting 'settings.seeds.rejectDkUrls'.
      aug 23, 2017 5:20:50 PM dk.kb.webdanica.core.utils.SettingsUtilities getBooleanSetting
      INFO: Using value 'true' for setting 'settings.seeds.rejectDkUrls'.
      aug 23, 2017 5:20:50 PM dk.kb.webdanica.core.utils.SettingsUtilities getBooleanSetting
      INFO: Using value 'true' for setting 'settings.seeds.rejectDkUrls'.
      aug 23, 2017 5:20:50 PM dk.kb.webdanica.core.utils.SettingsUtilities getBooleanSetting
      INFO: Using value 'true' for setting 'settings.seeds.rejectDkUrls'.
      aug 23, 2017 5:20:50 PM dk.kb.webdanica.core.utils.SettingsUtilities getBooleanSetting
      INFO: Using value 'true' for setting 'settings.seeds.rejectDkUrls'.
      aug 23, 2017 5:20:50 PM dk.kb.webdanica.core.utils.SettingsUtilities getBooleanSetting
      INFO: Using value 'true' for setting 'settings.seeds.rejectDkUrls'.
      aug 23, 2017 5:20:50 PM dk.kb.webdanica.core.utils.SettingsUtilities getBooleanSetting
      INFO: Using value 'true' for setting 'settings.seeds.rejectDkUrls'.
      aug 23, 2017 5:20:51 PM dk.kb.webdanica.core.utils.SettingsUtilities getBooleanSetting
      INFO: Using value 'true' for setting 'settings.seeds.rejectDkUrls'.
      aug 23, 2017 5:20:51 PM dk.kb.webdanica.core.utils.SettingsUtilities getBooleanSetting
      INFO: Using value 'true' for setting 'settings.seeds.rejectDkUrls'.
      aug 23, 2017 5:20:51 PM dk.kb.webdanica.core.utils.SettingsUtilities getBooleanSetting
      INFO: Using value 'true' for setting 'settings.seeds.rejectDkUrls'.
      aug 23, 2017 5:20:51 PM dk.kb.webdanica.core.utils.SettingsUtilities getBooleanSetting
      INFO: Using value 'true' for setting 'settings.seeds.rejectDkUrls'.
      aug 23, 2017 5:20:51 PM dk.kb.webdanica.core.utils.SettingsUtilities getBooleanSetting
      INFO: Using value 'true' for setting 'settings.seeds.rejectDkUrls'.
      aug 23, 2017 5:20:51 PM dk.kb.webdanica.core.utils.SettingsUtilities getBooleanSetting
      INFO: Using value 'true' for setting 'settings.seeds.rejectDkUrls'.
      aug 23, 2017 5:20:51 PM dk.kb.webdanica.core.utils.SettingsUtilities getBooleanSetting
      INFO: Using value 'true' for setting 'settings.seeds.rejectDkUrls'.
      aug 23, 2017 5:20:51 PM dk.kb.webdanica.core.utils.SettingsUtilities getBooleanSetting
      INFO: Using value 'true' for setting 'settings.seeds.rejectDkUrls'.
      aug 23, 2017 5:20:51 PM dk.kb.webdanica.core.utils.SettingsUtilities getBooleanSetting
      INFO: Using value 'true' for setting 'settings.seeds.rejectDkUrls'.
      aug 23, 2017 5:20:51 PM dk.kb.webdanica.core.utils.SettingsUtilities getBooleanSetting
      INFO: Using value 'true' for setting 'settings.seeds.rejectDkUrls'.
      dk.kb.webdanica.core.datamodel.dao.DaoException: java.sql.SQLException: ERROR 218 (23018): Constraint violation. DOMAINS.DOMAIN may not be null
      	at dk.kb.webdanica.core.datamodel.dao.HBasePhoenixDomainsDAO.insertDomain(HBasePhoenixDomainsDAO.java:71)
      	at dk.kb.webdanica.core.datamodel.criteria.CriteriaIngest.processFile(CriteriaIngest.java:222)
      	at dk.kb.webdanica.core.interfaces.harvesting.HarvestLog.processCriteriaResults(HarvestLog.java:184)
      	at dk.kb.webdanica.core.datamodel.criteria.CriteriaIngest.ingest(CriteriaIngest.java:59)
      	at dk.kb.webdanica.core.tools.CriteriaIngestTool.main(CriteriaIngestTool.java:71)
      Caused by: java.sql.SQLException: ERROR 218 (23018): Constraint violation. DOMAINS.DOMAIN may not be null
      	at org.apache.phoenix.exception.SQLExceptionCode$Factory$1.newException(SQLExceptionCode.java:422)
      	at org.apache.phoenix.exception.SQLExceptionInfo.buildException(SQLExceptionInfo.java:145)
      	at org.apache.phoenix.schema.ConstraintViolationException.<init>(ConstraintViolationException.java:39)
      	at org.apache.phoenix.schema.PTableImpl.newKey(PTableImpl.java:618)
      	at org.apache.phoenix.compile.UpsertCompiler.setValues(UpsertCompiler.java:137)
      	at org.apache.phoenix.compile.UpsertCompiler.access$500(UpsertCompiler.java:106)
      	at org.apache.phoenix.compile.UpsertCompiler$3.execute(UpsertCompiler.java:917)
      	at org.apache.phoenix.jdbc.PhoenixStatement$2.call(PhoenixStatement.java:338)
      	at org.apache.phoenix.jdbc.PhoenixStatement$2.call(PhoenixStatement.java:326)
      	at org.apache.phoenix.call.CallRunner.run(CallRunner.java:53)
      	at org.apache.phoenix.jdbc.PhoenixStatement.executeMutation(PhoenixStatement.java:324)
      	at org.apache.phoenix.jdbc.PhoenixPreparedStatement.executeUpdate(PhoenixPreparedStatement.java:199)
      	at dk.kb.webdanica.core.datamodel.dao.HBasePhoenixDomainsDAO.insertDomain(HBasePhoenixDomainsDAO.java:67)
      	... 4 more
      ERROR: criteria ingest failed
      

      Attachments

        Issue Links

          Activity

            People

              svc Søren Vejrup Carlsen (Inactive)
              svc Søren Vejrup Carlsen (Inactive)
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: