s5cmd - Command to connect local and S3

It is convenient to link Amazon S3 with various services of AWS, but it can be used simply enough for backup purposes. In such a case, it is client software or the web management screen.

The web management screen is not user-friendly for uploading or downloading a large number of files at once. The one I would like to use is s5 cmd of CLI.

How to use s5cmd

In s5cmd, files can be operated using subcommands. First I will use ls as a list of buckets.

$ s5cmd ls
                    + 2017/02/14 04:34:05  s3://ai-hackathon.moongift.jp
                    + 2015/02/05 00:09:07  s3://devrel.jp
                    + 2015/07/26 03:44:40  s3://moongift.co.jp
                      :
2017/09/04 17:52:11 +OK "ls" (20)

File uploading is also easy.

$ s5cmd cp README.md s3://devrel.tokyo/
                    # Uploading README.md... (3006 bytes)
2017/09/04 17:53:16 +OK "cp README.md s3://devrel.tokyo/README.md"

You can delete it.

$ s5cmd rm s3://devrel.tokyo/README.md 
2017/09/04 17:54:39 +OK "rm s3://devrel.tokyo/README.md"

With s5cmd you can easily upload local files to S3 or download them in reverse. It seems to be good for automatic operation using Cron etc and uploading processing result log file. s5cmd is Go's open source software (MIT License).

peakgames/s5cmd: Parallel S3 and local filesystem execution tool.