From a5ef804e061e5acb58527b54a3d65764221fbef8 Mon Sep 17 00:00:00 2001 From: Derek Prestegard Date: Mon, 16 Dec 2024 11:54:01 -0800 Subject: [PATCH 1/2] Docunent --raw option for commands file This would have been super useful for me to know! --- README.md | 6 ++++++ 1 file changed, 6 insertions(+) diff --git a/README.md b/README.md index f57a98a2f..48a21d5f7 100644 --- a/README.md +++ b/README.md @@ -391,6 +391,12 @@ rm s3://bucket/2020/03/19/file2.gz # rename an S3 object mv s3://bucket/2020/03/18/file1.gz s3://bucket/2020/03/18/original/file.gz + +Note - it's possible to have files on S3 that contain glob pattern characters like `*` and `?`. If you need to work with files like this in a commands file you will receive an error like +`can not contain glob characters`. You can work around this by adding the `--raw` option to that line in the commands file. For example: + +`cp --raw "s3://bucket/foo/bar*.txt" "/var/tmp/bar*.txt"` + ``` #### Sync From d0f8a1f2dc5e792adcaf2831ca57caeb144ed154 Mon Sep 17 00:00:00 2001 From: Derek Prestegard Date: Mon, 16 Dec 2024 11:56:11 -0800 Subject: [PATCH 2/2] typo --- README.md | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/README.md b/README.md index 48a21d5f7..db02bb34d 100644 --- a/README.md +++ b/README.md @@ -392,12 +392,13 @@ rm s3://bucket/2020/03/19/file2.gz # rename an S3 object mv s3://bucket/2020/03/18/file1.gz s3://bucket/2020/03/18/original/file.gz +``` + Note - it's possible to have files on S3 that contain glob pattern characters like `*` and `?`. If you need to work with files like this in a commands file you will receive an error like `can not contain glob characters`. You can work around this by adding the `--raw` option to that line in the commands file. For example: `cp --raw "s3://bucket/foo/bar*.txt" "/var/tmp/bar*.txt"` -``` #### Sync `sync` command synchronizes S3 buckets, prefixes, directories and files between S3 buckets and prefixes as well.