storage:get
storage:get¶
File Downloader Tool for S3/http(s)/ftp(s)
The following schemes are supported and can be used as the `location`:
* s3:// - AWS S3 (HTTPS)
* http:// - HTTP
* https:// - HTTPS
* ftp:// - FTP
* ftps:// - FTP with TLS
Example with `S3`:
{
"tool": "storage:get",
"parameters": {
"location": "s3://{AWS_ACCESS_KEY}:{AWS_SECRET_KEY}@{BUCKET}/{PATH}",
"files": [
"video.mp4",
"audio_en.mp4",
"audio_es.mp4", ...
]
}
}
Example using the `FTP` protocol for download:
{
"tool": "storage:get",
"parameters": {
"location": "ftp://{USERNAME}:{PASSWORD}@{HOST}{PATH}",
"files": [
"video.mp4",
"audio_en.mp4",
"audio_es.mp4", ...
]
}
}
Parameter | Properties | Default | Type | Choice | Description |
---|---|---|---|---|---|
location | required | A base URL from which files are downloaded (string) | |||
files | required [list value] | Filenames to be downloaded before processing (list of strings) | |||
base_dir | optional | str | A local directory to be used as target or source (default = '') | ||
role_arn | optional | The role to be assumed for executing the tool |