Skip to content

Commit a9f6538

Browse files
committed
More revisions from comments
1 parent 3916411 commit a9f6538

File tree

2 files changed

+12
-12
lines changed

2 files changed

+12
-12
lines changed

_uw-research-computing/htc-job-file-transfer.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -35,7 +35,7 @@ The HTC system has two primary locations where users can place their files:
3535
| | **`/home`** | **`/staging`** |
3636
| ----------- | ----------- |
3737
| Purpose | Default file system, handles most files | Stages large files/containers for file transfer into jobs |
38-
| Job submission |||
38+
| Can you run `condor_submit` here? |||
3939
| Recommended location for | Many, small files (<1 GB) | Few, large files (>1 GB) |
4040
| Default quota (disk) | 40 GB | 100 GB |
4141
| Default quota (number of items) | none | 1000 items |
@@ -81,9 +81,9 @@ requirements = (HasCHTCStaging == true)
8181
```
8282
{:.sub}
8383

84-
> ### ⚠️ File transfers referencing `/staging`
84+
> ### ⚠️ File transfers with `file:///`
8585
{:.tip-header}
86-
> If you are transferring files to or from `/staging`, ensure that you include the following requirement:
86+
> If you are transferring files with `file:///`, include the following requirement:
8787
> ```
8888
> requirements = (HasCHTCStaging == true)
8989
> ```

_uw-research-computing/htc-uwdf-researchdrive.md

Lines changed: 9 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -12,6 +12,14 @@ guide:
1212

1313
CHTC is launching a pilot program in which users can directly transfer files between ResearchDrive and their jobs. This can remove the additional step of uploading or downloading data to and from CHTC data storage locations.
1414

15+
> ### ⚗️ UWDF/ResearchDrive Pilot Program
16+
{:.tip-header}
17+
18+
> Currently the UWDF/ResearchDrive feature is in its pilot phase and is not yet widely available to CHTC users. This file transfer feature is still under testing and may have occasional issues or bugs.
19+
>
20+
> If you are interested in testing this feature, contact us at [[email protected]](mailto:[email protected]).
21+
{:.tip}
22+
1523
{% capture content %}
1624
- [Introduction](#introduction)
1725
- [Overview](#overview)
@@ -24,14 +32,6 @@ CHTC is launching a pilot program in which users can directly transfer files bet
2432
{% endcapture %}
2533
{% include /components/directory.html title="Table of Contents" %}
2634

27-
> ### ⚗️ UWDF/ResearchDrive Pilot Program
28-
{:.tip-header}
29-
30-
> Currently the UWDF/ResearchDrive feature is in its pilot phase and is not yet widely available to CHTC users. This file transfer feature is still under testing and may have occasional issues or bugs.
31-
>
32-
> If you are interested in testing this feature, contact us at [[email protected]](mailto:[email protected]).
33-
{:.tip}
34-
3535
## Overview
3636

3737
Users can transfer files directly between [ResearchDrive](https://it.wisc.edu/services/researchdrive/) and their jobs by using the UW Data Federation (UWDF) and the [Pelican Platform](https://docs.pelicanplatform.org/about-pelican) (which also powers the `osdf:///` file transfer plugin). This integration can remove the additional step of uploading or downloading data to and from CHTC data storage locations, saving time and disk space.
@@ -92,7 +92,7 @@ The example above remaps the output files such that only `outputfile1.txt` is pl
9292
If you want to remap ALL of your outputs to ResearchDrive, instead of `transfer_output_remaps`, use `output_destination`:
9393

9494
```
95-
output_destination = pelican://chtc.wisc.edu/researchdrive/<PI Netid>/CHTC/
95+
output_destination = pelican://chtc.wisc.edu/researchdrive/<PI Netid>/CHTC/<path to subdirectory>
9696
```
9797

9898
For more information about transferring output files using HTCondor, [read our guide](/uw-research-computing/htc-job-file-transfer#transfer-output-data-from-jobs).

0 commit comments

Comments
 (0)