Commit Graph

129 Commits

Author SHA1 Message Date
ea6d78dac2 Switched from an empty hash to indicate download failure to a hash equal to "-1". Fixed a bug where the cache folder would not be removed in case artifact download failed. 2024-08-05 16:29:07 +02:00
Quentin Guilloteau
199d1dc282 minor improvement to protocol 2024-08-02 17:49:55 +02:00
Quentin Guilloteau
43ceead6b0 Continue writing the protocol 2024-08-02 11:04:30 +02:00
Quentin Guilloteau
a24091b390 start writing protocol 2024-08-01 17:49:41 +02:00
114d0e5816 Added support for other virtualization techs in the Nickel contract (close #28). Added Nix dependency for Snakemake diagram generation. 2024-07-30 18:06:16 +02:00
ff2fc2d365 Added version number to the Nickel contracts and artifacts (close #27). 2024-07-29 16:39:30 +02:00
14ca1da160 Now handling the script's own crashes: saving to log and build status file (close #25). 2024-07-29 15:17:22 +02:00
e8b25b74a7 Added build status analysis. Now logging build status even if build is successful, to make analysis easier (as mentionned in #26). Added a new error type. 2024-07-26 19:00:25 +02:00
4db323fb03 Implemented artifact hash analysis. Switched to a table of tables instead of a single table to be able to identify multiple artifacts for the artifact analysis. 2024-07-26 17:01:59 +02:00
f25f5e356d Handling the case where artifact/misc packages cannot be downloaded. 2024-07-26 13:28:26 +02:00
8574c5e238 Softenv analysis written. 2024-07-26 12:58:00 +02:00
3c648c1a09 Written skeleton for output analysis (#26). Renamed some arguments of ECG. 2024-07-25 18:03:14 +02:00
e118cf3da1 Added the convention on config file name on the doc. 2024-07-25 09:32:52 +02:00
1d925ca364 Now using the name of the config file (without ext) as image name, meaning the name of the config file should comply with Docker image naming rules (should be the case). 2024-07-25 09:27:30 +02:00
48d3da9c7d Removed image name from the config file, now generated from the artifact URL (close #24). Fixed the "--no-cache" option when using Docker cache. 2024-07-24 18:58:50 +02:00
d2768d5373 Added initial support for Python venvs, close #21. Disabled the Docker build cache by default, and added an option to reenable it, close #23. Removed conditions on the existance of git_packages and misc_packages, because the workflow enforces their existance with the Nickel artifact contract. 2024-07-24 18:05:31 +02:00
aab563fbfe Fixed shi_welder (wrong path to Git repos). 2024-07-24 16:17:11 +02:00
8687bb03f4 Switching from pip freeze to pip list because of inconsistent output mentionned in #18, close #22. Adding albab_k9db config. 2024-07-24 11:34:05 +02:00
4329e333ea Added shi_welder, renamed OAR timeout error. 2024-07-24 10:13:53 +02:00
cc50349cf5 Almost solved the removing of bash login messages from outputs (#18) but still needs some work ("dace" pip package incorrectly displayed for deinsum). 2024-07-23 21:04:34 +02:00
5ba63ad50e Fixed merge. 2024-07-23 17:27:10 +02:00
687b777912 Merge remote-tracking branch 'origin/workflow_config' 2024-07-23 17:26:03 +02:00
35f8b4c369 Merge branch 'main' of https://forge.chapril.org/GuilloteauQ/study-docker-repro-longevity 2024-07-23 09:38:24 +02:00
557f766a02 Removing global variables, closing #19. 2024-07-23 09:38:03 +02:00
Quentin Guilloteau
944b1bf6f9 checkpoint in case of reaching walltime 2024-07-21 17:32:04 +02:00
Quentin Guilloteau
ef257e6026 add prefix to config 2024-07-21 16:14:58 +02:00
Quentin Guilloteau
566eb778f2 fix execution on grid5000 from namespace 2024-07-21 16:13:52 +02:00
Quentin Guilloteau
318955865c typo 2024-07-21 16:12:40 +02:00
Quentin Guilloteau
dd6eb9bcbb now using tmp dir to decompress the artifact 2024-07-21 16:11:55 +02:00
Quentin Guilloteau
8ed548c435 first try for g5k execution 2024-07-20 15:41:56 +02:00
cc605943a9 Added a comment section for artifacts configuration. Moved hints to the Nickel contract. 2024-07-19 17:05:46 +02:00
Quentin Guilloteau
d7749369b4 move artifacts_nickel and artifacts_json to artifacts/nickel and artifacts/json 2024-07-19 16:38:18 +02:00
Quentin Guilloteau
9769f6b533 Add config for snakemake 2024-07-19 16:33:27 +02:00
9a29c526fb Small doc fixes. 2024-07-19 16:23:39 +02:00
a7bf9cee94 Written a doc for the output. Removed the "type" attribute from the Nickel contract, closing #17. 2024-07-19 16:18:49 +02:00
1861f44f1e Removed the "type" attribute in the misc_package description. 2024-07-19 15:28:58 +02:00
cb98727554 Added artifacts_json to git ignore and deleting, closing #15. Deleted old YAML files. Added hints on the config template. 2024-07-19 15:23:00 +02:00
57ff34e8b9 Written Nickel + JSON artifact config files from their YAML version. Handling unknown errors during image building. 2024-07-18 17:56:57 +02:00
d791064183 Added Nickel constraint on values. 2024-07-17 14:56:38 +02:00
6897091c0d Modified README according to changes. 2024-07-16 17:58:13 +02:00
75056727e5 Fixing quotes for formatted strings. 2024-07-16 17:53:34 +02:00
f2cfceffb0 When no cache dir is specified, cache is disabled. 2024-07-16 17:50:55 +02:00
1aaa77cba3 Fixed Nickel contract and check files. Fixed input/output files in Snakefile. 2024-07-16 17:35:09 +02:00
69e447ab0a Fixed Nickel config files. Added artifact hash log on Snakefile + modified some variables names. Switched from 'tgz' to 'tar' for archive type. 2024-07-16 16:47:17 +02:00
842f9d32a7 Added license. 2024-07-16 16:04:02 +02:00
83a6930593 Merge pull request 'integrate nickel in workflow' (#11) from nickel_workflow into main
Reviewed-on: #11
2024-07-16 15:37:13 +02:00
82af4bd521 Written a doc. Changing the name of the variables related to the hash log. 2024-07-16 15:34:15 +02:00
Quentin Guilloteau
4432a93123 integrate nickel in workflow 2024-07-16 13:59:44 +02:00
f068fb91d0 Added artifact hash logging, closing #3. 2024-07-16 12:04:29 +02:00
0841823096 Switched from YAML to JSON, closing #8. 2024-07-16 11:01:08 +02:00