flowserv.service.postproc.base module

Definitions of constants for post=processing workflows. This module also contains helper functions that prepare the input data for post-porcessing workflows.

flowserv.service.postproc.base.LABEL_FILES = 'files'

Fixed set of parameter declarations for post-processing workflows. Contains only the declaration for the runs folder.

flowserv.service.postproc.base.RUNS_FILE = 'runs.json'

Labels for metadata objects in the run listing.

flowserv.service.postproc.base.prepare_postproc_data(input_files: List[str], ranking: List[flowserv.model.ranking.RunResult], run_manager: flowserv.model.run.RunManager, store: flowserv.volume.base.StorageVolume)

Create input files for post-processing steps for a given set of runs.

Creates files for a post-processing run in a given base directory on a storage volume. The resulting directory contains files for each run in a given ranking. For each run a sub-folder with the run identifier as the directory name is created. Each folder contains copies of result files for the run for those files that are specified in the input files list. A file runs.json in the base directory lists the runs in the ranking together with their group name.

Parameters

  • input_files (list(string)) – List of identifier for benchmark run output files that are copied into the input directory for each submission.

  • ranking (list(flowserv.model.ranking.RunResult)) – List of runs in the current result ranking

  • run_manager (flowserv.model.run.RunManager) – Manager for workflow runs

  • store (flowserv.volume.base.StorageVolume) – Target storage volume where the created post-processing files are stored.