Skip to content

Commit 982bd6b

Browse files
Add sizing matrices and sar deployment option
1 parent 25157b2 commit 982bd6b

File tree

1 file changed

+26
-9
lines changed
  • docs/reference/edot-cloud-forwarder

1 file changed

+26
-9
lines changed

docs/reference/edot-cloud-forwarder/aws.md

Lines changed: 26 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -17,7 +17,7 @@ products:
1717

1818
# EDOT Cloud Forwarder for AWS
1919

20-
{{edot-cf}} (CF) for AWS provides the EDOT Collector as a Lambda function that collects and forwards logs to {{product.observability}} on {{serverless-full}}.
20+
{{edot-cf}} (CF) for AWS provides the EDOT Collector as a Lambda function that collects and forwards logs to {{motlp}}.
2121

2222
{{edot-cf}} for AWS supports the following log sources:
2323

@@ -104,9 +104,7 @@ Trim the API key from `Authorization=ApiKey MYKEYVALUE...` to just `MYKEYVALUE..
104104
| --- | --- |
105105
| CloudFormation (AWS CLI) | Deploy using AWS CLI commands with CloudFormation templates. |
106106
| CloudFormation (AWS Console) | Deploy using the AWS Management Console UI. |
107-
<!-- Not Public yet
108-
| **AWS Serverless Application Repository (SAR)** | Deploy directly from the AWS Serverless Application Repository. |
109-
-->
107+
| AWS Serverless Application Repository (SAR) | Deploy directly from the AWS Serverless Application Repository. |
110108

111109
Each method achieves the same result and uses CloudFormation templates. Choose the method that best adapts to your workflow.
112110

@@ -199,6 +197,27 @@ The default values provided have been determined through extensive load testing
199197
Adjust these parameters only if you notice performance issues such as Lambda timeouts, throttling, high memory usage or dropped data. If you need assistance tuning these parameters for your specific workload, refer to [Contact support](docs-content://troubleshoot/ingest/opentelemetry/contact-support.md).
200198
:::
201199

200+
## Sizing and performance tuning
201+
202+
Use the following sizing matrices to select appropriate Lambda memory and concurrency settings for your traffic volume. Proper tuning helps maximize performance and prevent throttling in high‑volume log sources.
203+
204+
### VPC Flow Logs sizing
205+
206+
| Throughput | Log Rate | Recommended Memory | Recommended Concurrency |
207+
| :--- | :--- | :--- | :--- |
208+
| **< 5 MB/s** | < 50,000 events/s | 512 MB | 5 |
209+
| **5 - 10 MB/s** | 50,000 - 100,000 events/s | 512 MB | 10 |
210+
| **> 10 MB/s** | > 100,000 events/s | 1024 MB | 20+ |
211+
212+
### ELB Access Logs sizing
213+
214+
| Throughput | Log Rate | Recommended Memory | Recommended Concurrency |
215+
| :--- | :--- | :--- | :--- |
216+
| **< 10 MB/s** | < 25,000 events/s | 512 MB | 5 |
217+
| **10 - 40 MB/s** | 25,000 - 100,000 events/s | 1024 MB | 10 |
218+
| **> 40 MB/s** | > 100,000 events/s | 2048 MB | 20+ |
219+
220+
202221
## Deploy using CloudFormation (AWS CLI)
203222

204223
Use the AWS CLI to deploy the EDOT Cloud Forwarder with CloudFormation templates. This method is ideal for automation and infrastructure-as-code workflows.
@@ -462,7 +481,6 @@ To modify parameters of an existing stack through the AWS Console:
462481
7. Select **Submit** to apply the updates. In case of a change set, **Execute changeset** .
463482
8. Monitor the stack update progress in the console.
464483

465-
<!-- Not public yet
466484
## Deploy using AWS Serverless Application Repository
467485

468486
In addition to deploying through CloudFormation templates, you can deploy the EDOT Cloud Forwarder application directly from the AWS Serverless Application Repository (SAR).
@@ -472,9 +490,9 @@ In addition to deploying through CloudFormation templates, you can deploy the ED
472490
To deploy from SAR, follow these steps:
473491

474492
1. Navigate to **AWS Serverless Application Repository** in the AWS Management Console.
475-
2. Search for `edot-cloud-forwarder-s3-logs` and select the application.
476-
3. Select **Deploy**.
477-
4. **Configure the application settings**: You will be prompted to fill in the same parameters described in the [Configure the template](#configure-the-template) section. Refer to that section for details on each parameter.
493+
2. Select **Available applications** and check the box **Show apps that create custom IAM roles or resource policies**.
494+
3. Search for `edot-cloud-forwarder-s3-logs` and select the application.
495+
4. **Configure the application settings**: Under **Application settings**, fill in the parameters described in the [Configure the template](#configure-the-template) section. Refer to that section for details on each parameter.
478496
5. **Acknowledge IAM role creation**: At the bottom of the page, check the box to acknowledge that the application will create custom IAM roles. This is required for the forwarder to access your S3 bucket and send data to Elastic Observability.
479497
6. Select **Deploy**.
480498

@@ -483,7 +501,6 @@ The deployment process will start, and a CloudFormation stack will be created wi
483501
:::{note}
484502
The same [deployment considerations](#deployment-considerations) apply to SAR deployments, including the requirement to deploy separate serverless applications for each log type and ensure the deployment region matches your S3 bucket region.
485503
:::
486-
-->
487504

488505
## CloudFormation stack resources
489506

0 commit comments

Comments
 (0)