newspaper-fastcgi-ticket-checker

Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
statistics: Batch summa queries. "chunksize" parameter is size.

The overhead of a Summa SOAP query is substantial and this is slow.

Therefore the inner processing loop was rewritten to gather a

given amount of work before actually querying Summa. This

combined with the improved log file skipping mechanism resulted in

a speedup with a factor of three for Downloads.

statistics: Changed chunking to count unique query_ids instead of lines.

statistics: UUID field fixed. Output now identical for Download in test.

statistics: output is now generated based on batch query.

SNAPSHOT: statistics: now do batch query for Summa.

statistics: chunkified log file reading. Handle midnight logfile rollover.

Logfiles at callisto were found to roll over at midnight so the logfile stamped

2012-12-12 contained log entries from 2012-12-11 and the triggering log entry after

midnight. Therfore we consider one logfile more to get all entries for that day.

statistics: Logfiles with date stamps outside desired range are skipped.

Improved README instructions for tagging and tarballing.

    • -2
    • +2
    /newspaper-usage-statistics/make-tarball.sh
Now transparently support gzipped files (ends with "gz").

    • -2
    • +11
    /newspaper-usage-statistics/CHANGELOG.md
tarball now has example configuration. Use /usr/bin/python for now.

    • -1
    • +1
    /newspaper-usage-statistics/make-tarball.sh
Added make-tarball.sh to create release tarballs.

    • -0
    • +24
    /newspaper-usage-statistics/make-tarball.sh
Renamed stats to newspaper-usage-statistics for easier maintenance.

    • -0
    • +6
    /newspaper-usage-statistics/.gitignore
    • -0
    • +11
    /newspaper-usage-statistics/CHANGELOG.md
    • -0
    • +54
    /newspaper-usage-statistics/README.md
    • -0
    • +3
    /newspaper-usage-statistics/sample-logs/download.log
    • -0
    • +30
    /newspaper-usage-statistics/sample-logs/thumbnails.log
    • -0
    • +50
    /newspaper-usage-statistics/sample-summa/pdf.xml
    • -0
    • +3
    /newspaper-usage-statistics/src/main/newspaper_statistics.py.cfg-example
  1. … 37 more files in changeset.
Preparing for 1.0.1 release.

    • -12
    • +23
    /stats/src/main/scripts/statistics/statistics.py
Now sort result of glob.iglob - we iterate files in sorted order.

Tested against callisto logs (so dates changed). More robust. readded example.

    • -0
    • +3
    /stats/src/main/newspaper_statistics.py.cfg-example
    • -4
    • +10
    /stats/src/main/scripts/statistics/statistics.py
Cleaned up most warnings given by IntelliJ inspection.

Reformatted using IntelliJ.

    • -36
    • +48
    /stats/src/main/scripts/statistics/statistics.py
Added configuration information for Ubuntu 16.04.

Merge branch 'ticket-nonMock' - ABR replaced with real service.

Added comments explaining how ABR did the Nexus reconfiguration.

Configurable ticket issuer

Fixed automated nexus

    • -0
    • +5
    /nexus/sbforge_central.json
mocksumma do not depend on the mockticketservicecontentresolver-ide/pom.xml, as it is removed

Removed unneeded properties file

    • -5
    • +0
    /mockticketservicecontentresolver/src/main/resources/mockticketservice-docker.properties
LicenseModule: Do not allow access to doms id's ending in 1

LicenseModule moved to port 8080

Doc and fixes to licensemodule mock

    • -46
    • +0
    /mockticketservicecontentresolver-ide/pom.xml
    • -5
    • +0
    /mockticketservicecontentresolver-ide/src/main/resources/mockticketservice-ide.properties
    • -2
    • +2
    /mockticketservicecontentresolver/Dockerfile
    • -0
    • +11
    /mockticketservicecontentresolver/README.md
Mock licensemodule works

    • -2
    • +3
    /mockticketservicecontentresolver-ide/src/main/resources/mockticketservice-ide.properties
    • -24
    • +4
    /mockticketservicecontentresolver/Dockerfile
    • -2
    • +0
    /mockticketservicecontentresolver/docker.properties
    • -62
    • +19
    /mockticketservicecontentresolver/pom.xml
Mock of license module, not ticket issuer

    • -0
    • +63
    /TicketDesignScratch.md
    • -1
    • +1
    /mockticketservicecontentresolver/docker.properties
    • -22
    • +0
    /mockticketservicecontentresolver/src/test/java/MockTicketContentGeneratorTest.java
    • -0
    • +18
    /ticketissuer/Dockerfile
    • -0
    • +15
    /ticketissuer/context-default.xml
bitrepository-work: Now pulls unconfigured reference from Nexus into a container.

    • -0
    • +24
    /bitrepository/Dockerfile