Skip to content

Commit ea2ae41

Browse files
authored
Merge pull request #466 from GeoscienceAustralia/coastal_access
Update ArcGIS Pro COG access guide
2 parents c481c78 + d899bb7 commit ea2ae41

File tree

7 files changed

+68
-40
lines changed

7 files changed

+68
-40
lines changed
Binary file not shown.
Loading
Loading
Loading

docs/data/product/dea-intertidal/_access.md

Lines changed: 30 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -30,14 +30,15 @@ The easiest way to access DEA Intertidal data is via our continental-scale cloud
3030
The COG file format is a type of GeoTIFF raster file (`.tif`) that allows you to quickly and efficiently 'stream' data directly from the Amazon S3 cloud without having to download files to your computer.
3131
This allows you to rapidly access data from the entire Australian continent without having to download large files.
3232

33-
See the following guides for how to access the data depending on your use case.
33+
```{tip}
34+
If you encounter difficulty with any of these instructions, or with the COG files themselves, please contact us at <[email protected]>.
35+
```
3436

3537
**Stream continental COG mosaics in QGIS**
3638

3739
1. Open the DEA Intertidal [continental_mosaics](https://data.dea.ga.gov.au/?prefix=derivative/ga_s2ls_intertidal_cyear_3/2-0-0/continental_mosaics/) directory in DEA's Amazon S3 bucket.
3840
1. Enter a directory of a particular year, e.g. `2018--P1Y`
3941
1. Right click one of the `.tif` files representing a particular band e.g. `ga_s2ls_intertidal_cyear_3_2018_elevation.tif` &gt; click **Copy link address**.
40-
1. Open QGIS on your computer.
4142
1. In QGIS, click **Layer** &gt; **Add Layer** &gt; **Add Raster Layer**.
4243
1. For **Source Type**, select **Protocol: HTTP(S), cloud, etc.**.
4344
1. For **Protocol Type**, select **HTTP/HTTPS/FTP**.
@@ -46,37 +47,49 @@ See the following guides for how to access the data depending on your use case.
4647

4748
Learn more about streaming cloud datasets: [How to read a Cloud Optimized GeoTIFF with QGIS](https://cogeo.org/qgis-tutorial.html).
4849

49-
![Streaming COGs in QGIS](/_files/dea-tidal-composites/streaming-cogs.jpg)
50+
![Streaming COGs in QGIS](/_files/dea-tidal-composites/cogs_qgis_streaming.jpg)
5051

5152
**Stream continental COG mosaics in Esri ArcGIS Pro**
5253

53-
To connect Esri ArcGIS Pro to DEA's Amazon S3 bucket, follow Esri's tutorial: [Connect to a cloud store](https://pro.arcgis.com/en/pro-app/latest/help/projects/connect-to-cloud-stores.htm).
54+
To connect Esri ArcGIS Pro to DEA's Amazon S3 bucket, follow Esri's tutorial: [Create a cloud storage connection](https://pro.arcgis.com/en/pro-app/latest/help/projects/connect-to-cloud-stores.htm#ESRI_SECTION1_82576579B8CC43E6AE261E39FACFA947).
5455

55-
1. Use the following configurations for your **cloud storage connection**:
56+
1. In ArcGIS Pro, click the **Insert** tab, then click **Connections** &gt; **Cloud Store** &gt; **New Cloud Storage Connection**.
5657

57-
* **Connection File Name** &mdash; `DEA derived data`
58+
<br>
59+
60+
![Accessing the Connections and Cloud store menu in ArcGIS Pro](/_files/dea-tidal-composites/cog_arcgispro_connections.jpg)
61+
62+
1. Add the following details to the **Create Cloud Storage Connection** dialogue box:
63+
64+
* **Connection File Name** &mdash; `DEA_data`
5865
* **Service Provider** &mdash; `AMAZON`
59-
* **Bucket Name (Container)** &mdash; `data-public-data`
60-
* **Folder** &mdash; `derivative`
66+
* **Bucket Name (Container)** &mdash; `dea-public-data`
6167
* **Region (Environment)** &mdash; `Asia Pacific (Sydney)`
6268
* **Service Endpoint** &mdash; `s3.ap-southeast-2.amazonaws.com`
6369
* **Provider Options**
6470
* `ARC_DEEP_CRAWL` &mdash; `NO`
6571
* `AWS_NO_SIGN_REQUEST` &mdash; `TRUE`
72+
73+
<br>
6674

67-
![Streaming COGs in ArcPro](/_files/dea-tidal-composites/arcpro_cog_settings.png)
75+
![Creating a cloud connection to stream Cloud Optimised GeoTIFF (COG) rasters in ArcGIS Pro](/_files/dea-tidal-composites/cog_arcgispro_cloud_connection.jpg)
6876

6977
1. In the **Catalog** pane:
7078

7179
1. Expand **Cloud Stores**.
72-
1. Expand the **DEA derivative data** cloud store.
73-
1. Navigate to `ga_s2ls_intertidal_cyear_3/2-0-0/continental_mosaics/`.
80+
1. Expand the **DEA_data.acs** cloud store.
81+
1. Navigate to `derivative/ga_s2ls_intertidal_cyear_3/2-0-0/continental_mosaics/`.
7482
1. Enter a directory of a particular year, e.g. `2018--P1Y`.
75-
1. Drag and drop the `.tif` COG file representing a particular band e.g. `ga_s2ls_intertidal_cyear_3_2018_elevation.tif` onto the map.
83+
1. Drag and drop the `.tif` COG file representing a particular band e.g. `ga_s2ls_intertidal_cyear_3_2018_elevation.tif` onto the map (or right-click and "Add to map").
84+
85+
<br>
86+
87+
![Cloud store to stream Cloud Optimised GeoTIFF (COG) rasters in ArcGIS Pro](/_files/dea-tidal-composites/cog_arcgispro_cloud_store.jpg)
7688

77-
1. **Important:** When adding COG files to ArcGIS Pro, select **No** when asked whether to build statistics for the layer.
89+
```{important}
90+
When adding COG files to ArcGIS Pro, select **No** when asked whether to build statistics for the layer.
91+
```
7892

79-
If you encounter difficulty with any of these instructions, or with the COG files themselves, please contact us at <[email protected]>
8093
:::
8194

8295
:::{dropdown} How to download data from ELVIS
@@ -97,7 +110,9 @@ To download the data from the ELVIS (Elevation Information System) platform, fol
97110

98111
:::{dropdown} How to download data from individual tiles (Not recommended)
99112

100-
Downloading individual tiles is **not recommended**, but can be useful for accessing small amounts of data.
113+
```{warning}
114+
Downloading individual tiles is **not recommended**, but can be useful for accessing small amounts of data.
115+
```
101116

102117
1. Open the [DEA Intertidal](https://data.dea.ga.gov.au/?prefix=derivative/ga_s2ls_intertidal_cyear_3/) directory in DEA's Amazon S3 bucket.
103118
1. Click on `ga_summary_grid_c3_32km_coastal.geojson` to download the file to your computer. This file can be used in a GIS package to identify the product tiles that you require for a given location. (Alternatively, you can access this file via DEA Maps to identify the required tiles: **Sea, ocean and coast** &gt; **DEA Intertidal** &gt; **DEA Intertidal 32 km tile grid**.)

docs/data/product/dea-tidal-composites/_access.md

Lines changed: 38 additions & 25 deletions
Original file line numberDiff line numberDiff line change
@@ -24,69 +24,82 @@ The easiest way to access DEA Tidal Composite data is via our continental-scale
2424
The COG file format is a type of GeoTIFF raster file (`.tif`) that allows you to quickly and efficiently 'stream' data directly from the Amazon S3 cloud without having to download files to your computer.
2525
This allows you to rapidly access data from the entire Australian continent without having to download large files.
2626

27-
See the following guides for how to access the data depending on your use case.
27+
```{tip}
28+
If you encounter difficulty with any of these instructions, or with the COG files themselves, please contact us at <[email protected]>.
29+
```
2830

2931
**Stream continental COG mosaics in QGIS**
30-
32+
33+
To load single-band DEA Tidal Composites bands in QGIS:
34+
3135
1. Open the DEA Tidal Composites [continental_mosaics](https://data.dea.ga.gov.au/?prefix=derivative/ga_s2_tidal_composites_cyear_3/1-0-0/continental_mosaics/) directory in DEA's Amazon S3 bucket.
3236
1. Enter a directory of a particular year, e.g. `2018--P1Y`
3337
1. Right click one of the `.tif` files representing a particular band e.g. `ga_s2_tidal_composites_cyear_3_2018_low-blue.tif` &gt; click **Copy link address**.
34-
1. Open QGIS on your computer.
3538
1. In QGIS, click **Layer** &gt; **Add Layer** &gt; **Add Raster Layer**.
3639
1. For **Source Type**, select **Protocol: HTTP(S), cloud, etc.**.
3740
1. For **Protocol Type**, select **HTTP/HTTPS/FTP**.
3841
1. In the **URI** field, paste the link to the band that you copied to the clipboard.
3942
1. Click **Add** to start streaming the layer. Data should appear on the map after a few seconds (or after several minutes on slow internet connections).
4043

44+
We also provide several Virtual Raster (`.vrt`) files to help you easily visualise multiple DEA Tidal Composites bands in true and false colour.
45+
These files combine and stream data from multiple cloud-based COGs, avoiding the need to download multiple files.
46+
To add these to QGIS:
47+
48+
1. Follow the instructions 1-3 above, coping the link to one of the Virtual Raster (`.vrt`) files, e.g. `ga_s2_tidal_composites_cyear_3_2020_vrt-low-falsecolour.vrt`.
49+
1. Continue with steps 4-5 to start streaming the layer. Data should appear on the map after a few seconds (or after several minutes on slow internet connections).
50+
4151
Learn more about streaming cloud datasets: [How to read a Cloud Optimized GeoTIFF with QGIS](https://cogeo.org/qgis-tutorial.html).
4252

43-
![Streaming COGs in QGIS](/_files/dea-tidal-composites/streaming-cogs.jpg)
53+
![Streaming COGs in QGIS](/_files/dea-tidal-composites/cogs_qgis_streaming.jpg)
4454

45-
**Stream multi-band continental COG mosaics in QGIS**
55+
**Stream continental COG mosaics in Esri ArcGIS Pro**
4656

47-
To make it easier to visualise DEA Tidal Composite bands in true and false colour, we provide several Virtual Raster files (`.vrt`) that can be loaded into QGIS.
48-
These Virtual Rasters combine, stream and visualise data from multiple COG files in the cloud simultaneously, avoiding the need to download multiple files.
57+
To connect Esri ArcGIS Pro to DEA's Amazon S3 bucket, follow Esri's tutorial: [Create a cloud storage connection](https://pro.arcgis.com/en/pro-app/latest/help/projects/connect-to-cloud-stores.htm#ESRI_SECTION1_82576579B8CC43E6AE261E39FACFA947).
4958

50-
1. Open the DEA Tidal Composites [continental_mosaics](https://data.dea.ga.gov.au/?prefix=derivative/ga_s2_tidal_composites_cyear_3/1-0-0/continental_mosaics/) directory in DEA's Amazon S3 bucket.
51-
1. Enter a directory of a particular year, e.g. `2018--P1Y`
52-
1. Click to download the `.vrt` file of interest, e.g. `ga_s2_tidal_composites_cyear_3_2018_vrt-low-truecolour.vrt`
53-
1. On your computer, drag the downloaded `.vrt` file into your QGIS project.
54-
1. The multi-band dataset will stream seamlessly into your QGIS project.
59+
1. In ArcGIS Pro, click the **Insert** tab, then click **Connections** &gt; **Cloud Store** &gt; **New Cloud Storage Connection**.
5560

56-
**Stream continental COG mosaics in Esri ArcGIS Pro**
61+
<br>
5762

58-
To connect Esri ArcGIS Pro to DEA's Amazon S3 bucket, follow Esri's tutorial: [Connect to a cloud store](https://pro.arcgis.com/en/pro-app/latest/help/projects/connect-to-cloud-stores.htm).
63+
![Accessing the Connections and Cloud store menu in ArcGIS Pro](/_files/dea-tidal-composites/cog_arcgispro_connections.jpg)
5964

60-
1. Use the following configurations for your **cloud storage connection**:
65+
1. Add the following details to the **Create Cloud Storage Connection** dialogue box:
6166

62-
* **Connection File Name** &mdash; `DEA derived data`
67+
* **Connection File Name** &mdash; `DEA_data`
6368
* **Service Provider** &mdash; `AMAZON`
64-
* **Bucket Name (Container)** &mdash; `data-public-data`
65-
* **Folder** &mdash; `derivative`
69+
* **Bucket Name (Container)** &mdash; `dea-public-data`
6670
* **Region (Environment)** &mdash; `Asia Pacific (Sydney)`
6771
* **Service Endpoint** &mdash; `s3.ap-southeast-2.amazonaws.com`
6872
* **Provider Options**
6973
* `ARC_DEEP_CRAWL` &mdash; `NO`
7074
* `AWS_NO_SIGN_REQUEST` &mdash; `TRUE`
75+
76+
<br>
7177

72-
![Streaming COGs in ArcPro](/_files/dea-tidal-composites/arcpro_cog_settings.png)
78+
![Creating a cloud connection to stream Cloud Optimised GeoTIFF (COG) rasters in ArcGIS Pro](/_files/dea-tidal-composites/cog_arcgispro_cloud_connection.jpg)
7379

7480
1. In the **Catalog** pane:
7581

7682
1. Expand **Cloud Stores**.
77-
1. Expand the **DEA derivative data** cloud store.
78-
1. Navigate to `ga_s2_tidal_composites_cyear_3/1-0-0/continental_mosaics/`.
83+
1. Expand the **DEA_data.acs** cloud store.
84+
1. Navigate to `derivative/ga_s2_tidal_composites_cyear_3/1-0-0/continental_mosaics/`.
7985
1. Enter a directory of a particular year, e.g. `2018--P1Y`.
80-
1. Drag and drop the `.tif` COG file representing a particular band e.g. `ga_s2_tidal_composites_cyear_3_2018_low-nir-1.tif` onto the map.
86+
1. Drag and drop the `.tif` COG file representing a particular band e.g. `ga_s2_tidal_composites_cyear_3_2018_low-nir-1.tif` onto the map (or right-click and "Add to map").
87+
88+
<br>
89+
90+
![Cloud store to stream Cloud Optimised GeoTIFF (COG) rasters in ArcGIS Pro](/_files/dea-tidal-composites/cog_arcgispro_cloud_store.jpg)
8191

82-
1. **Important:** When adding COG files to ArcGIS Pro, select **No** when asked whether to build statistics for the layer.
92+
```{important}
93+
When adding COG files to ArcGIS Pro, select **No** when asked whether to build statistics for the layer.
94+
```
8395

84-
If you encounter difficulty with any of these instructions, or with the COG files themselves, please contact us at <[email protected]>
8596
:::
8697

8798
:::{dropdown} How to download data from individual tiles (Not recommended)
8899

89-
Downloading individual tiles is **not recommended**, but can be useful for accessing small amounts of data.
100+
```{warning}
101+
Downloading individual tiles is **not recommended**, but can be useful for accessing small amounts of data.
102+
```
90103

91104
1. Open the [DEA Intertidal](https://data.dea.ga.gov.au/?prefix=derivative/ga_s2ls_intertidal_cyear_3/) directory in DEA's Amazon S3 bucket.
92105
1. Click on `ga_summary_grid_c3_32km_coastal.geojson` to download the file to your computer. This file can be used in a GIS package to identify the product tiles that you require for a given location. (Alternatively, you can access this file via DEA Maps to identify the required tiles: **Sea, ocean and coast** &gt; **DEA Intertidal** &gt; **DEA Intertidal 32 km tile grid**.)

0 commit comments

Comments
 (0)