Skip to content

Commit 3449d28

Browse files
Add datastream info
1 parent 10d922b commit 3449d28

File tree

1 file changed

+15
-0
lines changed
  • docs/reference/edot-cloud-forwarder

1 file changed

+15
-0
lines changed

docs/reference/edot-cloud-forwarder/aws.md

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -534,6 +534,21 @@ The CloudWatch Log Subscription Filter, `CloudWatchLogSubscriptionFilter`, ensur
534534
CloudWatch Log Groups help monitor execution performance and debug issues. IAM permissions (`LambdaExecutionRole`, `LambdaPermissionCloudWatch`) control interactions between CloudWatch and Lambda, while the failure bucket, `S3FailureBucketARN`, helps prevent data loss in case of processing errors.
535535
536536
-->
537+
538+
## Datastreams
539+
540+
Logs collected by {{edot-cf}} for AWS are stored in Elasticsearch datastreams in OpenTelemetry native format. The following table shows which datastreams are used for each log type:
541+
542+
| **AWS Log Type** | **Datastream Dataset** | **Description** |
543+
|------------------|------------------------|-----------------|
544+
| VPC Flow Logs | `aws.vpcflow.otel` | VPC Flow Log records |
545+
| ELB Access Logs | `aws.elbaccess.otel` | ELB Access Log records (ALB, NLB, CLB) |
546+
547+
The logs are produced in OpenTelemetry native format. For detailed information about the field mappings and structure of each log type, refer to the following documentation:
548+
549+
- **VPC Flow Logs**: See [VPC Flow Log record fields](https://github.com/occamshub-dev/opentelemetry-collector-contrib/blob/main/extension/encoding/awslogsencodingextension/README.md#vpc-flow-log-record-fields) for the complete field mapping.
550+
- **ELB Access Logs**: See [ELB Access Log fields](https://github.com/occamshub-dev/opentelemetry-collector-contrib/blob/main/extension/encoding/awslogsencodingextension/README.md#elb-access-log-fields) for the complete field mapping.
551+
537552
## Kibana integration setup
538553

539554
After {{edot-cf}} for AWS is successfully running and forwarding logs to Elastic Observability, install the {{kib}} integrations to visualize your data with out-of-the-box dashboards and visualizations.

0 commit comments

Comments
 (0)