Commit Graph

41 Commits

Author SHA1 Message Date
Benjamin Dauvergne 47a85d8531 feeder: add option post-sync-commands (#56164)
Exemple:

  [wcs-olap]
  post-sync-commands = ALTER DEFAULT PRIVILEGES IN SCHEMA {schema} GRANT SELECT ON TABLES TO user;
    GRANT USAGE ON SCHEMA {schema} TO user;
    GRANT SELECT ON ALL TABLES IN SCHEMA {schema}  TO user;

Those commands will be launched after the synchronization, interpolation
variables are usable (like {schema} for the target schema name).
2021-08-14 23:41:16 +02:00
Benjamin Dauvergne 7690321265 tests: add test_sentry (#56038) 2021-08-14 10:54:16 +02:00
Benjamin Dauvergne 9476ad799b misc: integrate with sentry (#56038)
To use it add the following lines to /etc/wcs-olap/config.ini:

[sentry]
dsn = https://apikey@sentry.example.com/1
environment = prod
2021-08-07 15:35:30 +02:00
Benjamin Dauvergne f8c4a03464 tests: add invalid integer to wcs fixture (#54702) 2021-06-11 07:41:29 +02:00
Benjamin Dauvergne ee4bcadcc0 feeder: log failing SQL statements (#45314) 2021-05-28 08:19:34 +02:00
Benjamin Dauvergne fe2f5b5d89 do not use count to compute emptyness of formdef (#50368) 2021-01-21 11:37:46 +01:00
Serghei Mihai fc92793e49 feeder: try to cast digit string fields with numeric value only (#48426) 2020-11-26 10:37:47 +01:00
Benjamin Dauvergne a16fb4ee98 misc: accept duplicate fields with the same type (#42429) 2020-09-25 20:39:41 +02:00
Benjamin Dauvergne 9f5ff07675 wcs_api: use WcsApi.batch_size for FormDatas batch size (#44970) 2020-07-09 14:26:43 +02:00
Benjamin Dauvergne afb70fe986 feeder: create measure for integer fields (#43546) 2020-06-26 11:42:54 +02:00
Benjamin Dauvergne e4e8779661 tests: add a string column with digits validation (#43546) 2020-06-26 11:42:50 +02:00
Benjamin Dauvergne af2513e56e jenkins: adopt authentic way of doing tox.ini and Jenkinsfile 2020-06-26 11:40:21 +02:00
Benjamin Dauvergne 6e4cef6d5c feeder: update public.dates atomically (#44244) 2020-06-26 11:38:42 +02:00
Benjamin Dauvergne 579a118a5f tests: test schema name length check 2020-06-03 10:07:42 +02:00
Frédéric Péters f3ed695059 tests: adapt to changes in wcs runscript command (#42098) 2020-05-15 10:57:05 +02:00
Serghei Mihai d11d196fa8 feeder: preseve categories and form names order (#36930) 2020-03-02 22:07:03 +01:00
Benjamin Dauvergne 8fc092f4d7 feeder: add prefix to join's names of fields (#39373) 2020-01-31 17:51:12 +01:00
Benjamin Dauvergne 047d03200c tests: add agents data (#39430) 2020-01-31 17:50:03 +01:00
Benjamin Dauvergne a6af6fd665 remove dead code (#39430) 2020-01-31 17:49:42 +01:00
Benjamin Dauvergne dce418d99d migrate to python3 (#39430) 2020-01-30 23:33:16 +01:00
Valentin Deniaud c304e0f8f8 misc: add slug to cubes (#38597)
This also reverts commit 084b0d06b4,
which has never been actually used.
2019-12-18 10:35:34 +01:00
Benjamin Dauvergne f806b9d675 feeder: define all joins (#38066)
* join with the dates table must be inner because we do not want to
see results for forms outside the dates table (every form must have a
receipt_time),
* all other joins must be left because form's schemas are dynamic and
dimension can be absent from older forms but we still want to count them.
2019-12-04 10:17:24 +01:00
Benjamin Dauvergne 32ff0b75b5 ignore fields with duplicated varname (#26207) 2019-10-03 17:52:30 +02:00
Benjamin Dauvergne 4fc741c9e0 use only unicode strings (#26207) 2019-10-03 17:52:30 +02:00
Benjamin Dauvergne b544f4f938 quote status table (#36503) 2019-09-30 13:40:03 +02:00
Benjamin Dauvergne 9698d7852a quote all templated field and table names (#36503) 2019-09-28 11:01:50 +02:00
Serghei Mihai 238002e5bf feeder: quote item field name in cube schema (#35732) 2019-09-02 17:03:19 +02:00
Benjamin Dauvergne 953ef05f00 keep case in tables' and fields' names (#34559) 2019-08-16 14:26:08 +02:00
Benjamin Dauvergne ba0859492b ignore empty formdefs (#34392) 2019-07-30 19:20:46 +02:00
Thomas NOËL 9a7a280d0a Revert "keep case in tables' and fields' names (#34559)"
This reverts commit 1d3705a7b1.
2019-07-26 09:16:49 +02:00
Benjamin Dauvergne 1d3705a7b1 keep case in tables' and fields' names (#34559) 2019-07-24 17:56:09 +02:00
Emmanuel Cazenave 90cc6318b9 re-use dimension tables from previous run (#30752) 2019-03-01 14:15:36 +01:00
Benjamin Dauvergne a2f21e02e0 feeder: fix value_label SQL for boolean fields (fixes #30477) 2019-02-07 23:43:39 +01:00
Benjamin Dauvergne 63dc0183a3 feeder: prepend field_ to column name for string and bool fields (fixes #30475) 2019-02-07 23:30:18 +01:00
Benjamin Dauvergne de8605c48f wcs_api: return w.c.s. API errors (fixes #17924) 2019-01-30 17:46:50 +01:00
Benjamin Dauvergne 82993d5dd3 import non anonymized string columns (fixes #29203) 2019-01-18 11:10:55 +01:00
Benjamin Dauvergne bd7bc69468 feeder: import boolean form's fields (fixes #13612) 2019-01-18 11:10:39 +01:00
Benjamin Dauvergne 9a31c770d5 tests: add check of JSON schema (#29862) 2019-01-18 09:14:14 +01:00
Benjamin Dauvergne fb8ede1a88 use a Jenkinsfile (fixes #29862) 2019-01-17 23:09:48 +01:00
Benjamin Dauvergne d5debf5200 remove tests from bijoe 2017-03-20 13:38:49 +01:00
Benjamin Dauvergne 9314d9b9c6 bi-joe: BI engine and frontend for PostgreSQL 2016-05-25 01:24:07 +02:00