Commit Graph

173 Commits

Author SHA1 Message Date
Frédéric Péters 5619267c55 add index on dates (#51681) 2021-03-04 21:06:59 +01:00
Benjamin Dauvergne dc36901dde feeder: store truncated temp schema's name (#50835) 2021-02-04 10:35:24 +01:00
Benjamin Dauvergne 1d35d39f6f misc: remove SQL objects in order to use less locks (#43108) 2021-02-03 18:05:25 +01:00
Benjamin Dauvergne fe2f5b5d89 do not use count to compute emptyness of formdef (#50368) 2021-01-21 11:37:46 +01:00
Serghei Mihai 30f6873d27 feeder: write new model file after schema renaming (#42320)
gitea/wcs-olap/pipeline/head There was a failure building this commit Details
2021-01-11 14:28:51 +01:00
Frédéric Péters cbd0ec80a6 build: update to use origin/main 2020-12-26 15:21:15 +01:00
Benjamin Dauvergne ea72fe5d7e use truncate_pg_identifier on fields and table names (#48684) 2020-12-17 14:41:25 +01:00
Serghei Mihai fc92793e49 feeder: try to cast digit string fields with numeric value only (#48426) 2020-11-26 10:37:47 +01:00
Benjamin Dauvergne a16fb4ee98 misc: accept duplicate fields with the same type (#42429) 2020-09-25 20:39:41 +02:00
Frédéric Péters 326f53e84a trivial: use https to download wcs for tests (via #46904#note-2) 2020-09-24 19:57:39 +02:00
Valentin Deniaud 483dfb3089 tox: tell setuptools to use distutils from stdlib (#46252) 2020-09-01 14:26:25 +02:00
Nicolas Roche 3eb714f93a wcs_api: provide new include-disabled parameter (#45898) 2020-08-31 17:24:06 +02:00
Benjamin Dauvergne dd9e234dde Jenkinsfile: use python3-venv 2020-08-31 11:02:21 +02:00
Frédéric Péters 156491657d tox: limit quixote to <3.2, to keep tests working with python 3.5 2020-08-11 08:37:41 +02:00
Benjamin Dauvergne 9f5ff07675 wcs_api: use WcsApi.batch_size for FormDatas batch size (#44970) 2020-07-09 14:26:43 +02:00
Benjamin Dauvergne 909712e15a feeder: remove import six (#43546) 2020-06-26 11:42:54 +02:00
Benjamin Dauvergne afb70fe986 feeder: create measure for integer fields (#43546) 2020-06-26 11:42:54 +02:00
Benjamin Dauvergne e4e8779661 tests: add a string column with digits validation (#43546) 2020-06-26 11:42:50 +02:00
Benjamin Dauvergne af2513e56e jenkins: adopt authentic way of doing tox.ini and Jenkinsfile 2020-06-26 11:40:21 +02:00
Benjamin Dauvergne 6e4cef6d5c feeder: update public.dates atomically (#44244) 2020-06-26 11:38:42 +02:00
Benjamin Dauvergne 579a118a5f tests: test schema name length check 2020-06-03 10:07:42 +02:00
Benjamin Dauvergne d9409b15bd misc: truncate schema_temp to 63 characters (#43165) 2020-05-20 17:37:10 +02:00
Benjamin Dauvergne 44d11e2b02 misc: raise ValueError is schema name is too long (#43165) 2020-05-20 17:30:49 +02:00
Benjamin Dauvergne f45373eb51 misc: quote table names when droping (#43063) 2020-05-19 10:00:31 +02:00
Frédéric Péters f3ed695059 tests: adapt to changes in wcs runscript command (#42098) 2020-05-15 10:57:05 +02:00
Serghei Mihai 799d799565 feeder: fix debug message on schema renaming (#42323) 2020-04-30 16:42:41 +02:00
Serghei Mihai c68304bf96 feeder: drop old schema sequentially (#42322) 2020-04-30 16:42:41 +02:00
Paul Marillonnet 31540a886f debian: adapt dependency overriding to python3 (#41303) 2020-04-03 11:17:24 +02:00
Serghei Mihai d11d196fa8 feeder: preseve categories and form names order (#36930) 2020-03-02 22:07:03 +01:00
Benjamin Dauvergne 3afc79b42e wcs_api: handle empty dict in FormData.workflow (#39373) 2020-01-31 18:26:21 +01:00
Benjamin Dauvergne 8fc092f4d7 feeder: add prefix to join's names of fields (#39373) 2020-01-31 17:51:12 +01:00
Benjamin Dauvergne 04ad4ee2d2 feeder: factorize values in field's schemas (#39373) 2020-01-31 17:51:12 +01:00
Benjamin Dauvergne 047d03200c tests: add agents data (#39430) 2020-01-31 17:50:03 +01:00
Benjamin Dauvergne a6af6fd665 remove dead code (#39430) 2020-01-31 17:49:42 +01:00
Benjamin Dauvergne dce418d99d migrate to python3 (#39430) 2020-01-30 23:33:16 +01:00
Valentin Deniaud c304e0f8f8 misc: add slug to cubes (#38597)
This also reverts commit 084b0d06b4,
which has never been actually used.
2019-12-18 10:35:34 +01:00
Benjamin Dauvergne a368ae716b tox.ini: remove non working py3 test env 2019-12-09 15:35:00 +01:00
Benjamin Dauvergne f806b9d675 feeder: define all joins (#38066)
* join with the dates table must be inner because we do not want to
see results for forms outside the dates table (every form must have a
receipt_time),
* all other joins must be left because form's schemas are dynamic and
dimension can be absent from older forms but we still want to count them.
2019-12-04 10:17:24 +01:00
Frédéric Péters ba95cc7f28 ignore internal/unknown roles assigned to functions (#37015) 2019-10-17 09:46:21 +02:00
Benjamin Dauvergne 32ff0b75b5 ignore fields with duplicated varname (#26207) 2019-10-03 17:52:30 +02:00
Benjamin Dauvergne 0c78cf8731 tox.ini: test with python3 (#26207) 2019-10-03 17:52:30 +02:00
Benjamin Dauvergne 4fc741c9e0 use only unicode strings (#26207) 2019-10-03 17:52:30 +02:00
Emmanuel Cazenave dee2d6ab9e jenkins: use ci@entrouvert.org for notifications 2019-10-02 14:54:51 +02:00
Benjamin Dauvergne e38041b6a8 replace more explicit quoting by quote() (#36503) 2019-09-30 13:42:13 +02:00
Benjamin Dauvergne b544f4f938 quote status table (#36503) 2019-09-30 13:40:03 +02:00
Benjamin Dauvergne 9698d7852a quote all templated field and table names (#36503) 2019-09-28 11:01:50 +02:00
Frédéric Péters 8e60ac10d1 misc: reduce default batch size to 500 items (#36077) 2019-09-15 11:22:53 +02:00
Frédéric Péters 4953b05b75 switch data type of references to option tables to allow more options (#36129) 2019-09-15 10:20:14 +02:00
Serghei Mihai 238002e5bf feeder: quote item field name in cube schema (#35732) 2019-09-02 17:03:19 +02:00
Frédéric Péters a5168d1f15 always update dates table (#35725) 2019-09-02 15:19:31 +02:00