513b21754c
Changed build status "package_unavailable" to "package_install_failed" to cover more errors. Added an error message for this status. Outputs of ECG are now always created at the beginning to avoid issues with Snakemake (maybe not a good idea).
2024-08-20 18:47:32 +02:00
0bbed9d0f5
Adding missing changes from the previous commit because I wasn't in the root folder...
2024-08-15 12:23:34 +02:00
e2903ffac1
Removed the headers from the output of the analysis, because they will have to be combined. So I made the columns deterministic. Added the supported package sources to the doc. Updated the protocol with the information from the doc + typos.
2024-08-07 19:51:21 +02:00
56c3682124
Finished the package changes analysis.
2024-08-07 12:26:36 +02:00
4b91a6cb5d
Modified analysis according to the fact that logs for multiple executions of ECG will not be appended to the same file, rather written to a new file every time. Added a column for the artifact name in the artifact hash log for that reason. Updated README. Added sed as dependency for Nix. Started writing package changes analysis.
2024-08-07 11:22:54 +02:00
eae7c40d59
Added timestamp to every row in package list ( close #38 ).
2024-08-06 16:59:36 +02:00
ac6c100c6b
Fixed venv pkglist ( close #21 ).
2024-08-05 18:22:38 +02:00
cd9a9000d5
Adding a column with the name of the artifact in each row of the package list ( close #37 ).
2024-08-05 17:04:42 +02:00
ea6d78dac2
Switched from an empty hash to indicate download failure to a hash equal to "-1". Fixed a bug where the cache folder would not be removed in case artifact download failed.
2024-08-05 16:29:07 +02:00
114d0e5816
Added support for other virtualization techs in the Nickel contract ( close #28 ). Added Nix dependency for Snakemake diagram generation.
2024-07-30 18:06:16 +02:00
14ca1da160
Now handling the script's own crashes: saving to log and build status file ( close #25 ).
2024-07-29 15:17:22 +02:00
e8b25b74a7
Added build status analysis. Now logging build status even if build is successful, to make analysis easier (as mentionned in #26 ). Added a new error type.
2024-07-26 19:00:25 +02:00
f25f5e356d
Handling the case where artifact/misc packages cannot be downloaded.
2024-07-26 13:28:26 +02:00
3c648c1a09
Written skeleton for output analysis ( #26 ). Renamed some arguments of ECG.
2024-07-25 18:03:14 +02:00
1d925ca364
Now using the name of the config file (without ext) as image name, meaning the name of the config file should comply with Docker image naming rules (should be the case).
2024-07-25 09:27:30 +02:00
48d3da9c7d
Removed image name from the config file, now generated from the artifact URL ( close #24 ). Fixed the "--no-cache" option when using Docker cache.
2024-07-24 18:58:50 +02:00
d2768d5373
Added initial support for Python venvs, close #21 . Disabled the Docker build cache by default, and added an option to reenable it, close #23 . Removed conditions on the existance of git_packages and misc_packages, because the workflow enforces their existance with the Nickel artifact contract.
2024-07-24 18:05:31 +02:00
8687bb03f4
Switching from pip freeze to pip list because of inconsistent output mentionned in #18 , close #22 . Adding albab_k9db config.
2024-07-24 11:34:05 +02:00
cc50349cf5
Almost solved the removing of bash login messages from outputs ( #18 ) but still needs some work ("dace" pip package incorrectly displayed for deinsum).
2024-07-23 21:04:34 +02:00
5ba63ad50e
Fixed merge.
2024-07-23 17:27:10 +02:00
687b777912
Merge remote-tracking branch 'origin/workflow_config'
2024-07-23 17:26:03 +02:00
557f766a02
Removing global variables, closing #19 .
2024-07-23 09:38:03 +02:00
Quentin Guilloteau
944b1bf6f9
checkpoint in case of reaching walltime
2024-07-21 17:32:04 +02:00
Quentin Guilloteau
dd6eb9bcbb
now using tmp dir to decompress the artifact
2024-07-21 16:11:55 +02:00
57ff34e8b9
Written Nickel + JSON artifact config files from their YAML version. Handling unknown errors during image building.
2024-07-18 17:56:57 +02:00
75056727e5
Fixing quotes for formatted strings.
2024-07-16 17:53:34 +02:00
f2cfceffb0
When no cache dir is specified, cache is disabled.
2024-07-16 17:50:55 +02:00
1aaa77cba3
Fixed Nickel contract and check files. Fixed input/output files in Snakefile.
2024-07-16 17:35:09 +02:00
69e447ab0a
Fixed Nickel config files. Added artifact hash log on Snakefile + modified some variables names. Switched from 'tgz' to 'tar' for archive type.
2024-07-16 16:47:17 +02:00
82af4bd521
Written a doc. Changing the name of the variables related to the hash log.
2024-07-16 15:34:15 +02:00
f068fb91d0
Added artifact hash logging, closing #3 .
2024-07-16 12:04:29 +02:00
0841823096
Switched from YAML to JSON, closing #8 .
2024-07-16 11:01:08 +02:00
9a01db7faf
Now using f-strings, closing #6 . Made path-related cmd args required, closing #7 . Used variables in check_env for readability, closing #5 .
2024-07-16 10:20:04 +02:00
da114662ba
Added stdout to output. Fixed log. Opening build_status file in append mode. Added verbose flag to run script.
2024-07-15 11:28:38 +02:00
0e6b181310
Continued work on buildstatus_saver. Removed headers for CSV files, closing #4 .
2024-07-15 11:00:08 +02:00
2ad37f46f2
Initial support for Docker errors parsing.
2024-07-12 17:50:19 +02:00
23c4f7ede4
Added support for cache. Added run and clean scripts.
2024-07-12 12:10:03 +02:00
27d0331c06
Added logging to a file.
2024-07-12 11:21:14 +02:00
2f779d0ab0
- Config files now contain 1 Dockerfile only.
...
- Removed support for running ECG with multiple config files at the same time: will be called with a single one only
- Removed storage management of outputs, paths are now given using command line args.
- Started working on cache support.
2024-07-11 17:14:58 +02:00
30a82efc70
Adding support for multiple config files. Improving structure of output files.
2024-07-10 19:01:46 +02:00
7dfe12ed80
Added support for packages outside of pkgmgr and git.
2024-07-10 17:06:54 +02:00
03c6602db3
Now running the output formatting commands locally, and not on the container.
2024-07-10 15:44:01 +02:00
a18bed49b1
Added support for Git packages.
2024-07-10 14:50:57 +02:00
6a6ae9370d
Adding comments + doc. Starting the work on git packages.
2024-07-10 12:23:07 +02:00
ba1303aa97
Taking conda into account.
2024-07-10 11:40:49 +02:00
bf6ebc8ab6
Merging all package lists into a single one.
2024-07-10 10:35:30 +02:00
3d695c1ead
Added support for RPM and Pacman.
2024-07-09 18:45:25 +02:00
561748ed59
Initial code.
2024-07-09 18:25:21 +02:00
