You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: _uw-research-computing/file-avail-largedata.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -74,11 +74,11 @@ In order to stage large data for use on CHTC's HTC system, users must:
74
74
75
75
### Request a `/staging` directory
76
76
77
-
Any one with a CHTC account whose data meets the intended use above can request space in our large data staging area by filling out a quota request form. The default quota is 100 GB / 1000 items; if a larger quota is needed, request more quota. The created directory will exist at this path: `/staging/username`
77
+
Any one with a CHTC account whose data meets the intended use above can request space in our large data staging area by filling out a quota request form. The default quota is 100 GB / 1000 items; if a larger quota is needed, request a higher quota. The created directory will exist at this path: `/staging/username`
78
78
79
79
We can also create group or shared spaces by request.
80
80
81
-
<pstyle="text-align: center; margin-bottom: 0; font-weight: bold;">Need a <code>/staging</code> directory or more quota?</p>
81
+
<pstyle="text-align: center; margin-bottom: 0; font-weight: bold;">Need a <code>/staging</code> directory or higher quota?</p>
Copy file name to clipboardExpand all lines: _uw-research-computing/htc-job-file-transfer.md
+3-3Lines changed: 3 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -110,15 +110,15 @@ When a job completes, by default, HTCondor will only return **newly created or e
110
110
<caption>The directory structure of an example job on the execution point. In this example, according to its default behavior, HTCondor will only transfer the newly created "output_file" and will not transfer the subdirectory "output/".</caption>
111
111
112
112
### Specify which output files to transfer with `transfer_output_files`
113
-
If you don't want to transfer all files but only *specific files*, in your HTCondor submit file, use
113
+
If you don't want to transfer all files but only *specific files* or subdirectories, in your HTCondor submit file, use
### Transfer files to other locations with `transfer_output_remaps`
120
120
121
-
To transfer files back to `/staging`, you will need an additional line in your HTCondor submit file, with each item separated by a semicolon (;):
121
+
To transfer files back to `/staging` or a specific directory in `/home`, you will need an additional line in your HTCondor submit file, with each item separated by a semicolon (;):
This feature is only availble for Pelican-based plugins (`osdf://`, `pelican://`) and is not available for `file://` or normal file transfers. This feature is also not recommended for compressed files larger than 30 GB.
153
153
154
-
Read more about the unpacking files in the [Pelican documentation](https://docs.pelicanplatform.org/getting-data-with-pelican/client#packing-objects-with-the-pack-query).
154
+
Read more about unpacking files in the [Pelican documentation](https://docs.pelicanplatform.org/getting-data-with-pelican/client#packing-objects-with-the-pack-query).
155
155
156
156
## Related pages
157
157
- [Manage Large Data in HTC Jobs](/uw-research-computing/file-avail-largedata)
0 commit comments