Skip to content

storage:get

storage:get

File Downloader Tool for S3/http(s)/ftp(s)

The following schemes are supported and can be used as the `location`:

* s3:// - AWS S3 (HTTPS)
* http:// - HTTP
* https:// - HTTPS
* ftp:// - FTP
* ftps:// - FTP with TLS

Example with `S3`:

    {
        "tool": "storage:get",
        "parameters": {
            "location": "s3://{AWS_ACCESS_KEY}:{AWS_SECRET_KEY}@{BUCKET}/{PATH}",
            "files": [
                "video.mp4",
                "audio_en.mp4",
                "audio_es.mp4", ...
            ]
        }
    }


Example using the `FTP` protocol for download:

    {
        "tool": "storage:get",
        "parameters": {
            "location": "ftp://{USERNAME}:{PASSWORD}@{HOST}{PATH}",
            "files": [
                "video.mp4",
                "audio_en.mp4",
                "audio_es.mp4", ...
            ]
        }
    }
Parameter Properties Default Type Choice Description
location required A base URL from which files are downloaded (string)
files required [list value] Filenames to be downloaded before processing (list of strings)
base_dir optional str A local directory to be used as target or source (default = '')
role_arn optional The role to be assumed for executing the tool