Skip to content

Commit 154a008

Browse files
WriteMayurWriteMayur
authored
Merge pull request #22334 from newrelic/NR-488604-Data-Ingest-Budgets
Documentation for Data Ingest
2 parents 88ca1b5 + 0495744 commit 154a008

File tree

2 files changed

+223
-0
lines changed

2 files changed

+223
-0
lines changed

‎src/content/docs/data-apis/manage-data/data-ingest-budgets.mdx‎

Lines changed: 221 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,221 @@
1+
---
2+
title: Data ingest budgets
3+
tags:
4+
- Data ingest budgets
5+
- Organization level data budgets
6+
- Account level data budgets
7+
- Data management
8+
- GB ingest
9+
- Ingest budgets
10+
metaDescription: Manage your organization's data ingest budgets to monitor and alert on data ingestion usage.
11+
freshnessValidatedDate: never
12+
---
13+
14+
As organizations scale their observability practices, managing data ingestion becomes critical for cost optimization and predictable spending. Data ingest budgets help you shift from reactive to proactive cost management by tracking how much data your organization ingests, setting spending limits based on gigabytes (GB) ingested, and configuring alert thresholds to prevent unexpected charges.
15+
16+
This feature addresses common challenges:
17+
18+
- **Unpredictable costs**: Manage your monthly bills despite fluctuating data volumes
19+
- **Limited control**: Set budgets at organization and account levels
20+
- **Budget surprises**: Get proactive alerts before exceeding budget limits, not after the billing cycle
21+
- **Poor visibility**: Track real-time data ingestion against predefined limits
22+
23+
## Prerequisites
24+
25+
To use data ingest budgets, you must have:
26+
27+
- A paid data ingest subscription
28+
- A single-tenant organization (not available for multi-tenant organizations)
29+
- The organization manager role to create, edit, or delete budgets
30+
31+
## Who uses data ingest budgets
32+
33+
Different roles in your organization use data ingest budgets for specific purposes:
34+
35+
### Organization managers
36+
37+
As an organization manager, you can:
38+
39+
- **Set and allocate budgets**: Define data ingest budgets at organization and account levels
40+
- **Monitor overall usage**: Track total ingestion across the organization and ensure budget adherence
41+
- **Manage budget limits**: Adjust budgets based on actual usage patterns and organizational needs
42+
- **Configure notifications**: Set up alerts at multiple threshold levels to provide early warning of budget issues
43+
44+
### Team leads
45+
46+
As a team lead, you can:
47+
48+
- **Monitor team budgets**: Track your team's data ingestion to ensure it stays within allocated limits
49+
- **Communicate budget status**: Relay budget warnings to team members and guide them on adjusting workloads based on current budget status
50+
51+
### General users
52+
53+
As a general user, you can:
54+
55+
- **Track project usage**: Monitor data ingestion for projects you're responsible for
56+
- **Respond to warnings**: Take action when budget alerts are triggered, such as optimizing resource usage
57+
58+
## Manage organization level data budgets
59+
60+
Organization level data budgets help you track and manage your total data ingestion across your entire organization.
61+
62+
<Steps>
63+
<Step>
64+
### Access data budgets
65+
66+
Go to **[one.newrelic.com](https://one.newrelic.com/)**. In the [user menu](/docs/accounts/accounts-billing/general-account-settings/intro-account-settings), click **Administration** > **Data Management** > **Data Budgets**.
67+
68+
<Callout variant="important">
69+
When you open the **Data Budgets** page, the **Organization Budget** appears by default if you have contract commitments. This budget reflects your data ingestion commitments, updates monthly, and provides a clear overview of how much data (GB) you've ingested and how much remains available. Notifications are not set up by default—you must configure thresholds and destinations to receive budget alerts.
70+
</Callout>
71+
72+
<Callout variant="tip">
73+
If you don't have a contract commitment defined, you'll see an empty state with an option to create an organization budget.
74+
</Callout>
75+
</Step>
76+
77+
<Step>
78+
### Manage budget limits
79+
80+
In the **Organization Budget** section, click **Manage limits**. The **Edit Organization Budget** page appears.
81+
</Step>
82+
83+
<Step>
84+
### Set monthly budget limits
85+
86+
1. To update the spending thresholds for your organization, go to the **Set monthly budget limits** section and specify the amount of data (GB) you want to track in your organization budget.
87+
88+
<Callout variant="important">
89+
By default, we configure this based on your monthly contract commitments.
90+
</Callout>
91+
92+
2. You can increase or decrease the budget amount based on your expected usage. For example, if you anticipate using 250 GB in a month, update the value accordingly.
93+
3. Click **Next**.
94+
</Step>
95+
96+
<Step>
97+
### Set up notifications
98+
99+
1. To prevent overages and manage costs effectively, go to the **Set up organization budget notifications** page. Set the threshold percentage and choose the destination for notifications.
100+
2. To receive a warning when you've used a certain percentage of the GB assigned to your budget for a specific month, go to the **Thresholds** tab. Select **+ Add a threshold** and enter the percentage at which you want to receive notifications (for example, 75%, 90%, or 95%).
101+
3. To ensure notifications are sent when the budget exceeds the threshold, go to the **Destinations** tab. Add at least one destination to be notified. You can choose from the following options:
102+
- **Email**: Enter the email addresses of New Relic users to notify them about the budget.
103+
- **Webhook**: Enter the webhook URL to send notifications to a specific endpoint.
104+
105+
<Callout variant="important">
106+
You must add at least one threshold and one destination, or the system will not allow you to create the budget.
107+
</Callout>
108+
109+
4. Click **Finish**.
110+
</Step>
111+
</Steps>
112+
113+
Your organization budget is updated and will track your data ingestion usage and notify you when you reach the defined thresholds.
114+
115+
## Manage account level data budgets
116+
117+
Account level data budgets allow you to allocate portions of your organization budget to specific accounts, enabling granular control over data ingestion costs for teams, applications, or business units.
118+
119+
<Steps>
120+
<Step>
121+
### Create an account level budget
122+
123+
1. From the **Data Budgets** page, click **+ Add functional budget**.
124+
2. The **Create account level budget** page appears.
125+
</Step>
126+
127+
<Step>
128+
### Configure budget details
129+
130+
1. In the **Budget name** field, enter a descriptive name for your budget.
131+
2. In the **Select accounts** section, choose up to 5 accounts that don't already have budgets assigned.
132+
133+
<Callout variant="tip">
134+
Accounts that already have budgets will appear disabled in the selection list.
135+
</Callout>
136+
137+
3. Click **Next**.
138+
</Step>
139+
140+
<Step>
141+
### Allocate data budget
142+
143+
1. On the **Allocate budget** page, you'll see how many GB are remaining in your organization budget.
144+
2. Enter the amount of GB you want to allocate to this account level budget.
145+
146+
<Callout variant="tip">
147+
You can allocate more than your organization budget.
148+
</Callout>
149+
150+
3. Click **Next**.
151+
</Step>
152+
153+
<Step>
154+
### Set up account level notifications
155+
156+
1. In the **Thresholds** section, select **+ Add a threshold** and enter the percentage at which you want to receive notifications for this account level budget.
157+
2. In the **Destinations** section, configure where notifications should be sent:
158+
- **Email**: Enter the email addresses of users to notify.
159+
- **Webhook**: Enter the webhook URL to send notifications to a specific endpoint.
160+
161+
<Callout variant="important">
162+
You must add at least one threshold and one destination, or the system will not allow you to create the budget.
163+
</Callout>
164+
165+
3. Click **Finish**.
166+
</Step>
167+
</Steps>
168+
169+
Your account level budget is now created and will appear in the budgets list.
170+
171+
## View and manage existing budgets
172+
173+
Once you've created account level budgets, you can view and manage them from the **Data Budgets** page.
174+
175+
### Budget information displayed
176+
177+
For each account level budget, you'll see:
178+
179+
- **Budget name**: The name you assigned to the budget
180+
- **Status**: Current status of the budget
181+
- **GB allocation**: How much data (GB) has been allocated to this budget
182+
- **GB utilized**: How much of the allocated data has been used
183+
- **Utilization percentage**: Percentage of the budget that has been used
184+
185+
### Manage existing budgets
186+
187+
To manage an existing account level budget:
188+
189+
1. Locate the budget in the list and click the three-dot menu.
190+
2. Choose from the following options:
191+
- **View details**: See detailed information about the budget, including utilization graphs, thresholds, notification settings, associated accounts, and data sources.
192+
- **Edit**: Modify the budget allocation, thresholds, or notification settings.
193+
- **Delete**: Remove the budget.
194+
195+
### View budget details
196+
197+
When you click on a budget name or select **View details**, you'll see a detailed page showing:
198+
199+
- **Total allocation**: The total GB allocated to this budget
200+
- **Utilization**: How much has been utilized with a visual graph showing usage over time
201+
- **Thresholds**: The notification thresholds you've configured
202+
- **Notification destinations**: Where alerts are sent when thresholds are exceeded
203+
- **Associated accounts**: The accounts included in this budget
204+
- **Data sources**: Information about the data sources contributing to the budget usage
205+
206+
## Best practices
207+
208+
To effectively manage your data ingest budgets:
209+
210+
- **Set realistic limits**: Base your organization budget on historical usage patterns and expected growth to avoid frequent adjustments.
211+
- **Configure multiple thresholds**: Set alerts at different percentages (for example, 75%, 90%, 95%) to give yourself time to respond before hitting limits.
212+
- **Review regularly**: Monitor your budgets monthly to ensure they align with your actual usage and adjust as needed.
213+
- **Use account level budgets**: Allocate budgets to specific accounts to track costs at a granular level and identify high-usage areas or teams.
214+
- **Enable proactive notifications**: Configure email and webhook destinations to ensure the right people are notified when thresholds are exceeded.
215+
- **Analyze usage patterns**: Use the utilization graphs to identify trends, anomalies, or unexpected spikes in data ingestion.
216+
- **Update as needed**: Adjust your budgets when your data ingestion patterns change or when you add new monitoring capabilities.
217+
218+
## What's next
219+
220+
- Learn more about [managing your data](/docs/data-apis/manage-data/manage-your-data)
221+
- Explore [data ingest governance](/docs/data-apis/manage-data/manage-data-coming-new-relic)

‎src/nav/telemetry-data-platform.yml‎

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -38,6 +38,8 @@ pages:
3838
pages:
3939
- title: Get started
4040
path: /docs/data-apis/manage-data/manage-your-data
41+
- title: Data ingest budgets
42+
path: /docs/data-apis/manage-data/data-ingest-budgets
4143
- title: Manage data ingest
4244
path: /docs/data-apis/manage-data/manage-data-coming-new-relic
4345
- title: Manage data retention

0 commit comments

Comments
 (0)