storage:check
storage:check
Checks if files in a remote location exist. This step either
fails if these files exist (mode: 'FAIL_ON_PRESENCE'),
fast-forwards the job to success without executing any further step (mode: 'COMPLETE_ON_PRESENCE')
fails if the specified files do not exist (mode: FAIL_ON_ABSENCE')
Example:
{
"tool": "storage:check",
"parameters": {
"location": "s3://{aws-credentials}@com.castlabs.vtk.test/contentpath",
"files": [
"tos_3min_video_960x540_1mbps.mp4"
],
"mode": "COMPLETE_ON_PRESENCE"
}
},
Parameter | Properties | Default | Type | Choice | Description |
location | required | | | | A base URL from which files are downloaded (string) |
files | required [list value] | | | | Filenames to be downloaded before processing (list of strings) |
mode | optional | | | 'FAIL_ON_PRESENCE', 'COMPLETE_ON_PRESENCE', 'FAIL_ON_ABSENCE' | FAIL_ON_PRESENCE: If the files are already present the job will fail. |
COMPLETE_ON_PRESENCE: If the files are already present the job will succeed without executing any subsequent steps. | | | | | |
FAIL_ON_ABSENCE: If the files are not there (e.g. if subsequent steps require those files) the job will fail. | | | | | |
base_dir | optional | | str | | A local directory to be used as target or source (default = '') |
role_arn | optional | | | | The role to be assumed for executing the tool |