Skip to content

Commit

Permalink
S3:
Browse files Browse the repository at this point in the history
This makes a number of changes to the S3 collections that we advertise.

The region-specific collections have been removed: us-west-2 has
been promoted to be the 'all regions' collection, and the other
collections are no longer mentioned.

(Fun fact: The collections for us-west-1 and us-east-2 were never
accessed, and so have been deleted immediately.)

Also, on the Cloud page, the SCG S3 collection is no longer mentioned,
and is replaced with a link to the 'all regions' collection (that used
to be us-west-2).

(Another fun fact: The 'all regions' collection is still pointing to
us-west-2, but the S3 connector is smart enough to look up what region a
bucket is associated with, and use that region's S3 endpoint.  So, there
will always be a little bit of traffic going to us-west-2, but actual
data transfers will go direct to the appropriate region.)

Finally, a new region has been added for requester-pays buckets.
Nothing else is said about those buckets right now; folks are generally
told when a bucket they are accessing is requester-pays.
  • Loading branch information
akkornel committed Sep 11, 2024
1 parent 254b7e2 commit 3754269
Show file tree
Hide file tree
Showing 2 changed files with 22 additions and 21 deletions.
10 changes: 8 additions & 2 deletions cloud.md
Original file line number Diff line number Diff line change
Expand Up @@ -47,8 +47,14 @@ in the future. If you run into problems accessing it, contact us for <a href="s
raw=collection-under-construction
%}

Amazon S3 buckets—in all regions—may be accessed through the [SRCC SCG AWS
S3](https://app.globus.org/file-manager/collections/6122aa2f-bd3f-4474-b8bf-691c35397822/overview)
Amazon S3 buckets—in all regions other than China—may be accessed through the
[Stanford Amazon (AWS)
S3](https://app.globus.org/file-manager/collections/483837a5-663b-407a-9168-9ec98f82ff36/overview)
collection.

If you need to access a requester-pays bucket, you may do so through the
[Stanford Amazon (AWS) S3
Requester-Pays](https://app.globus.org/file-manager/collections/f73507db-2379-4927-9f45-c91af223c794/overview)
collection.

[Go here for detailed information on how to use Globus with Amazon S3]({{ "cloud/s3.html" | absolute_url }}).
Expand Down
33 changes: 14 additions & 19 deletions cloud/s3.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,18 +7,6 @@ id: cloud
description: Globus works with Amazon S3, but with a number of restrictions.
---

{% capture collection-under-construction %}
<h2>Under Construction</h2>
<p>This collection is still under construction, and is likely going to change
in the future. If you run into problems accessing it, check the announcements
(on the home page) to see if things have changed!</p>
{% endcapture %}

{% include info-box.html
icon="wrench"
raw=collection-under-construction
%}

{% include info-box.html
icon="cloud"
header="Cloud familiarity assumed"
Expand All @@ -27,15 +15,22 @@ in the future. If you run into problems accessing it, check the announcements

# Amazon S3

The following AWS S3 regions are available:
All AWS regions—except for regions in China—are accessible through one Globus
collection:

* [us-east-1: US East (N. Virginia)](https://app.globus.org/file-manager/collections/80414941-1880-4304-8d86-910c28a7356e/overview)
* [us-east-2: US East (Ohio)](https://app.globus.org/file-manager/collections/ca564628-69d2-4dab-be3b-47bcdd158b89/overview)
* [us-west-1: US West (N. California)](https://app.globus.org/file-manager/collections/ef377be5-efc2-4b21-af30-fcba6d7cf2af/overview)
* [us-west-2: US West (Oregon)](https://app.globus.org/file-manager/collections/483837a5-663b-407a-9168-9ec98f82ff36/overview)
* [Stanford Amazon (AWS) S3](https://app.globus.org/file-manager/collections/483837a5-663b-407a-9168-9ec98f82ff36/overview)

For other regions, please [email us](mailto:[email protected]), and we
will add support for them.
If you are working with [requester-pays
buckets](https://docs.aws.amazon.com/AmazonS3/latest/userguide/RequesterPaysBuckets.html),
we have a separate Globus collection you can use:

* [Stanford Amazon (AWS) S3 Requester-Pays](https://app.globus.org/file-manager/collections/f73507db-2379-4927-9f45-c91af223c794/overview)

{% include info-box.html
icon="wrench"
header="Region-specific collections have been deprecated"
content="In the past, there used to be seprate Globus collections for each AWS region. As of September, 2024, those region-specific collections have been deprecated."
%}

Before continuing, you may need to do some one-time setup work. You will need
to…
Expand Down

0 comments on commit 3754269

Please sign in to comment.