HPA Portal sections Data collection Data collection sessions database export

A specific HPA service is running with the Calypso Dataserver dedicated to run regularly database exports. Those requests are made to share an overview of the Calypso activities.

This can be globally activated/deactivated via the agents settings:

  • DATASERVER_RW
  • DataServer
  • HpaDBExtractorService service

The main configuration for this service can be found in db_extractor_config.yml

requests-files-folder-path: ./DBExtractor/requests
anonymization-keys-file: ./anonymization/anonymizationKeys.txt
anonymization-char: "$"
forbidden-chars:
  - "'"
  - "\""
  - ";"
  - ","
  - "."
  - "|"
csv-fields-separator-char: "|"
numerical-separator-char: "."
time-period-start: 0 0 11 ? * SAT
time-period-end: 0 0 15 ? * SUN
sessions-files-folder-path: ./requests/sessions

According to the time period, HPA will run a set of requests, and store their results in the sessions-files_folder-path

A set of requests is provided with HPA default-calypso-requests.yml but this can be enriched with additional requests configuration file(s) in requests-files-folder-path

Example of request configuration file

- name: audit
  order: 201
  sql-request: "select ..."
  output-file-name: audi.csv
- name: st_classical
  order: 301
  sql-request: "select ..."
  output-file-name: st-classical.csv
  condition-type: SQL
  condition-value: "select ..."
- name: st-quartz
  order: 401
  sql-request: "select ..."
  output-file-name: st-quartz.csv
  condition-type: VERSION_GREATER_THAN_INCLUDED
  condition-value: 14
- name: other
  ...
  • Each file can contain one or several configurations
  • Fields name, order, sql-request and output-file-name are mandatory for each
  • It is possible to consider a condition to run a request
    • Eiter via another request condition-type = SQL and condition-value = a SQL request
    • Or condition-type = VERSION_GREATER_THAN_INCLUDED and condition-value = the major version of Calypso from where the condition is considered as true

The result of the process is a zip file moved from agent server (Calypso) to HPA server.
.err files are present in the zip file if some Oracle errors were met

  • agent wise temporary files are stored by default in wily/hpadump + sessions-files-folder-path
  • server wise exported zip are stored by default in var/hpadumpsessions/dbextractor