Skip to content

Commit cb9e905

Browse files
xamberlxamberl
committed
New hpc quota page; remove broken link
1 parent 85659d5 commit cb9e905

File tree

3 files changed

+140
-2
lines changed

3 files changed

+140
-2
lines changed

‎_data/hpc-guide-menu.yml‎

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -27,6 +27,9 @@
2727
- text: "Manage data"
2828
icon: "bi bi-file-earmark-text"
2929
links:
30+
- text: "Check disk quota and usage"
31+
url: "/uw-research-computing/hpc-check-quota"
32+
icon: ""
3033
- text: "Transfer files to/from CHTC"
3134
icon: ""
3235
links:

‎_uw-research-computing/hpc-check-quota.md‎

Lines changed: 136 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,136 @@
1+
---
2+
highlighter: none
3+
layout: guide
4+
title: Check Disk Quota and Usage
5+
guide:
6+
category: Manage data
7+
tag:
8+
- hpc
9+
---
10+
11+
## Introduction
12+
13+
This guide shows you how to check the amount of disk space and number of files you are using in your `/home` and `/scratch` directories. You can also check your limit on your disk space and number of files (i.e., your "quota"). This guide will help you manage your disk space and give tips on what do when you've reached your quota.
14+
15+
{% capture content %}
16+
- [Introduction](#introduction)
17+
- [Default quotas](#default-quotas)
18+
- [Check your quota](#check-your-quota)
19+
- [Check your Message of the Day (MOTD)](#check-your-message-of-the-day-motd)
20+
- [Check the size of a directory and its contents](#check-the-size-of-a-directory-and-its-contents)
21+
- [What to do when you've reached your quota](#what-to-do-when-youve-reached-your-quota)
22+
- [Related pages](#related-pages)
23+
{% endcapture %}
24+
{% include /components/directory.html title="Table of Contents" %}
25+
26+
## Default quotas
27+
28+
| Data location | **`/home`** | **`/scratch`** |
29+
| ----------- | ----------- |
30+
| Default quota (disk) | 30 GB | 100 GB |
31+
| Default quota (number of items) | 250,000 items | 250,000 items |
32+
| Purpose | Repeatedly used files<br>(templates, source code, software, reference data) | Working data<br>(inputs, outputs, logs, stderr, stdout) |
33+
34+
<p style="text-align: center; margin-bottom: 0; font-weight: bold;">Need more quota?</p>
35+
<div class="d-flex mb-3">
36+
<div class="p-3 m-auto">
37+
<a class="btn btn-primary" style="text-align: center" href="quota-request">Fill out our quota request form</a>
38+
</div>
39+
</div>
40+
41+
## Check your quota
42+
43+
For the most up-to-date information about your quota, use the `get_quotas` command.
44+
```
45+
get_quotas
46+
```
47+
{:.term}
48+
49+
This will print a table with your `/home` and `/scratch` quotas. An example output is shown below.
50+
51+
```
52+
[user@spark-login ~]$ get_quotas
53+
Path Disk_Used(GB) Disk_Limit(GB) Files_Used File_Limit
54+
/home/user 6.08254 30 150372 250000
55+
/scratch/user 2.33743 100 22 250000
56+
```
57+
{:.term}
58+
59+
To print the quota for a path in `/home`, `/scratch`, and `/software` that you have access to, (i.e., a group directory), use the `-p` option:
60+
61+
```
62+
get_quotas -p <path to directory>
63+
```
64+
{:.term}
65+
66+
An example output of the `get_quotas` command with the `-p` option is shown below:
67+
68+
```
69+
[user@spark-login ~]$ get_quotas -p /software/groups/example_group
70+
Path Disk_Used(GB) Disk_Limit(GB) Files_Used File_Limit
71+
/software/groups/example_group 0.000433144 100 3 1000
72+
```
73+
{:.term}
74+
75+
## Check your Message of the Day (MOTD)
76+
77+
Your quota is also printed upon login. See below for an example:
78+
79+
```
80+
_____________________________________________________________________
81+
##### # # ####### ##### Issues? Email [email protected]
82+
# # # # # # # Unauthorized use prohibited by:
83+
# # # # # WI Statutes: s. 947.0125
84+
# ####### # # U.S. Code: 18 USC 1030
85+
# # # # # U.S. Code: 18 USC 2510-2522
86+
# # # # # # # U.S. Code: 18 USC 2701-2712
87+
##### # # # ##### U.S. Code: 18 USC § 1831
88+
For off campus ssh access use https://www.doit.wisc.edu/network/vpn/
89+
_____________________________________________________________________
90+
91+
Online office hours are available twice a week:
92+
Tuesdays, 10:30am - 12pm (Central time)
93+
Thursdays, 3:00 - 4:30pm (Central time)
94+
95+
== NOTICE: THIS NODE IS ON PUPPET ENVIRONMENT "puppet8" ==
96+
97+
Filesystem quota report (last updated 01:01 PM)
98+
Storage Used (GB) Limit (GB) Files (#) File Cap (#) Quota (%)
99+
-------------- ----------- ------------ ----------- -------------- -----------
100+
/home/user 6.08 30 150372 250000 20.28
101+
/scratch/user 2.34 100 22 250001 2.34
102+
```
103+
{:.term}
104+
105+
However, we recommend [using the `get_quotas` command](#check-your-quota) for the most up-to-date information.
106+
107+
## Check the size of a directory and its contents
108+
109+
If you want to check the size of specific directories and their contents, you can do this with the `ncdu` utility.
110+
111+
```
112+
[user@spark-login ~]$ ncdu /home/username
113+
[user@spark-login ~]$ ncdu /scratch/username
114+
```
115+
{:.term}
116+
117+
When `ncdu` has finished running, the output will give you a total file count and allow you to navigate between subdirectories for even more details. Type `q `when you're ready to exit the output viewer.
118+
119+
## What to do when you've reached your quota
120+
121+
When you've reached your quota, you may encounter error messages such as `Disk quota exceeded`. When you encounter the error message, we recommend the following steps:
122+
123+
1. Check your quota with `get_quotas`. At which data location did you reach your quota? Did you reach your disk quota or your items quota?
124+
1. If possible, remove any files you no longer need from the system.
125+
1. If you still need more disk space, [request more quota.](quota-request)
126+
127+
> ### ⚠️ CHTC is not a storage service
128+
{:.tip-header}
129+
130+
> CHTC data locations are intended for temporarily storing files used in **active calculations only**. Once you are done with the files, please remove them from the system to clear disk space.<br><br>
131+
> **We do not back up any of the data you place on our system. It is your responsibility to back up your own files.**
132+
{:.tip}
133+
134+
## Related pages
135+
136+
* [HPC System Overview](hpc-overview)

‎_uw-research-computing/hpc-overview.md‎

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -191,5 +191,4 @@ files and directories are contained in a given path:
191191

192192
When `ncdu` has finished running, the output will give you a total file
193193
count and allow you to navigate between subdirectories for even more
194-
details. Type `q` when you\'re ready to exit the output viewer. More
195-
info here: <https://lintut.com/ncdu-check-disk-usage/>
194+
details. Type `q` when you\'re ready to exit the output viewer.

0 commit comments

Comments
 (0)