Skip to content

Update docs involving ES - WIP #675

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 110 commits into from
May 20, 2025
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
110 commits
Select commit Hold shift + click to select a range
47f39c1
Update output-elasticsearch.md
fulyauluturk May 5, 2025
6c3b57f
Update input-plugin-elasticsearch-http.md
fulyauluturk May 5, 2025
21acbe0
Update index-events-via-elasticsearch-api.md
fulyauluturk May 5, 2025
fd98739
Update search-through-the-elasticsearch-api.md
fulyauluturk May 5, 2025
4ed49a9
Update logs.md
fulyauluturk May 5, 2025
e07a20c
Update syslog.md
fulyauluturk May 5, 2025
c8d033a
Update searching-log-events.md
fulyauluturk May 5, 2025
f0ca5f8
Update event-api.md
fulyauluturk May 5, 2025
5b6e820
Update installation.md
fulyauluturk May 5, 2025
03fb10d
Update index.md
fulyauluturk May 5, 2025
dd35769
Update parser.md
fulyauluturk May 5, 2025
2f9a8da
Update event-api.md
fulyauluturk May 5, 2025
8a20abf
Update settings.md
fulyauluturk May 5, 2025
1f3aff6
Update cli-parameters.md
fulyauluturk May 5, 2025
7877036
Update logagent-ide-conf.md
fulyauluturk May 5, 2025
0afcfa3
Update database-operations.md
fulyauluturk May 5, 2025
8d1935d
Update installation-heroku.md
fulyauluturk May 5, 2025
cf5e7b3
Update output-plugin-influxdb.md
fulyauluturk May 5, 2025
51b3df0
Update input-plugin-cassandra.md
fulyauluturk May 5, 2025
daae50b
Update logs.md
fulyauluturk May 5, 2025
5a83c2f
Update event-api.md
fulyauluturk May 5, 2025
40842f7
Update search-through-the-elasticsearch-api.md
fulyauluturk May 5, 2025
6a90cfd
Update settings.md
fulyauluturk May 5, 2025
27be848
Update app-guide.md
fulyauluturk May 5, 2025
fbcdaf9
Update mappings-templates.md
fulyauluturk May 5, 2025
ad703c5
Update sending-log-events.md
fulyauluturk May 5, 2025
c6b49b7
Update rsyslog.md
fulyauluturk May 5, 2025
e95efb6
Update search-syntax.md
fulyauluturk May 5, 2025
d5d772d
Update output-plugin-slack.md
fulyauluturk May 5, 2025
2758911
Update faq.md
fulyauluturk May 5, 2025
f395153
Update input-github-webhook.md
fulyauluturk May 5, 2025
520c3f8
Update input-plugin-influxdb-http.md
fulyauluturk May 5, 2025
026b82d
Update output-filter-geoip.md
fulyauluturk May 5, 2025
bac0760
Update datadog-log-forwarding.md
fulyauluturk May 5, 2025
9adb573
Update index.md
fulyauluturk May 5, 2025
0fb1f23
Update json-messages-over-syslog.md
fulyauluturk May 5, 2025
57f006e
Update output-filter-kubernetes.md
fulyauluturk May 5, 2025
6556f49
Update index.md
fulyauluturk May 5, 2025
7572b5b
Update how-to-gdpr_web_logs.md
fulyauluturk May 5, 2025
0e3f069
Update output-plugin-clickhouse.md
fulyauluturk May 5, 2025
ae852b4
Update filters.md
fulyauluturk May 5, 2025
bfb4a62
Update input-plugin-journald-upload.md
fulyauluturk May 5, 2025
63d5dd2
Update output-filter-sql.md
fulyauluturk May 5, 2025
7d78a6c
Update output-plugin-gelf.md
fulyauluturk May 5, 2025
9eb6d90
Update output-plugin-rtail.md
fulyauluturk May 5, 2025
ca45637
Update output-plugin-zeromq.md
fulyauluturk May 5, 2025
d5c550a
Update input-kubernetes-audit.md
fulyauluturk May 5, 2025
9ae7e27
Update filter-output-sql.md
fulyauluturk May 5, 2025
e844eb7
Delete docs/images/logs/kibana-integration.gif
fulyauluturk May 6, 2025
111b22c
Delete docs/logs/kibana.md
fulyauluturk May 6, 2025
6b29788
Update and rename index-events-via-elasticsearch-api.md to index-even…
fulyauluturk May 6, 2025
6da07e1
Update mkdocs.yml
fulyauluturk May 6, 2025
43216f6
Update syslog.md
fulyauluturk May 6, 2025
ed42284
Update mappings-templates.md
fulyauluturk May 6, 2025
b559e4c
Update rsyslog.md
fulyauluturk May 6, 2025
d99cda8
Update faq.md
fulyauluturk May 6, 2025
c4fd93b
Update sending-log-events.md
fulyauluturk May 6, 2025
b237b26
Update search-through-the-elasticsearch-api.md
fulyauluturk May 6, 2025
afeed3c
Update json-messages-over-syslog.md
fulyauluturk May 6, 2025
41bf938
Rename search-through-the-elasticsearch-api.md to search-through-the-…
fulyauluturk May 6, 2025
083a9fb
Update mkdocs.yml
fulyauluturk May 6, 2025
66f63be
Update logs.md
fulyauluturk May 6, 2025
2123f5f
Update event-api.md
fulyauluturk May 6, 2025
fa00293
Update settings.md
fulyauluturk May 6, 2025
254aa4a
Update faq.md
fulyauluturk May 6, 2025
c9be22d
Update search-syntax.md
fulyauluturk May 6, 2025
703e2a9
Update index-events-via-sematext-api.md
fulyauluturk May 6, 2025
506f60b
Update logs.md
fulyauluturk May 15, 2025
4f767b3
Update cli-parameters.md
fulyauluturk May 15, 2025
5b9bd00
Update search-through-the-sematext-api.md
fulyauluturk May 15, 2025
4c7adff
Update opensearch-integration.md
fulyauluturk May 15, 2025
5dd4622
Update logs.md
fulyauluturk May 15, 2025
d588bd5
Update event-api.md
fulyauluturk May 15, 2025
40d0579
Update app-guide.md
fulyauluturk May 15, 2025
e164500
Update index.md
fulyauluturk May 15, 2025
feb70b6
Update cli-parameters.md
fulyauluturk May 15, 2025
901e435
Update filter-output-sql.md
fulyauluturk May 15, 2025
91401a9
Update filters.md
fulyauluturk May 15, 2025
a915f39
Update how-to-gdpr_web_logs.md
fulyauluturk May 15, 2025
f9dac52
Update index.md
fulyauluturk May 15, 2025
2375ccd
Update input-github-webhook.md
fulyauluturk May 15, 2025
908f192
Update input-kubernetes-audit.md
fulyauluturk May 15, 2025
4094fba
Update input-plugin-cassandra.md
fulyauluturk May 15, 2025
f1e22a5
Update input-plugin-influxdb-http.md
fulyauluturk May 15, 2025
b252288
Update input-plugin-journald-upload.md
fulyauluturk May 15, 2025
a3a2147
Update installation-heroku.md
fulyauluturk May 15, 2025
e531909
Update installation.md
fulyauluturk May 15, 2025
2ae96c5
Update logagent-ide-conf.md
fulyauluturk May 15, 2025
be79049
Update output-elasticsearch.md
fulyauluturk May 15, 2025
4952983
Update output-filter-geoip.md
fulyauluturk May 15, 2025
10e8c82
Update output-filter-sql.md
fulyauluturk May 15, 2025
8136a90
Update output-plugin-clickhouse.md
fulyauluturk May 15, 2025
d1687eb
Update output-plugin-gelf.md
fulyauluturk May 15, 2025
de06911
Update output-plugin-influxdb.md
fulyauluturk May 15, 2025
8ac7e74
Update output-plugin-rtail.md
fulyauluturk May 15, 2025
8f3b596
Update output-plugin-slack.md
fulyauluturk May 15, 2025
53a1104
Update output-plugin-zeromq.md
fulyauluturk May 15, 2025
56eb848
Update parser.md
fulyauluturk May 15, 2025
d9019e0
Update datadog-log-forwarding.md
fulyauluturk May 15, 2025
dd83cfa
Update faq.md
fulyauluturk May 15, 2025
561b7be
Update index-events-via-sematext-api.md
fulyauluturk May 15, 2025
c9046f7
Update mappings-templates.md
fulyauluturk May 15, 2025
2d60d17
Update search-syntax.md
fulyauluturk May 15, 2025
8d09482
Update search-through-the-sematext-api.md
fulyauluturk May 15, 2025
93222eb
Update searching-log-events.md
fulyauluturk May 15, 2025
eba3304
Update sending-log-events.md
fulyauluturk May 15, 2025
35210b4
Update settings.md
fulyauluturk May 15, 2025
0968ffb
Update database-operations.md
fulyauluturk May 15, 2025
e742f1d
Update mkdocs.yml
fulyauluturk May 15, 2025
8986cb0
Update mkdocs.yml
fulyauluturk May 20, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions docs/app/logs.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
title: Sematext App - Logs
description: Sematext App is a modern monitoring, log management, transaction tracing, and real user monitoring system that aggregates and structures your logs across various languages and platforms. It is a suite of products that combine high-quality logging experience with other monitoring and alerting devops tools helping fix production issues

[Sematext logging platform](https://sematext.com/logsene/) provides both ability to create your own queries through its [Elasticsearch API](/docs/logs/search-through-the-elasticsearch-api/) as well as rich, yet simple query syntax very much like the [query syntax](/docs/logs/search-syntax/) used by Google.
[Sematext logging platform](https://sematext.com/logsene/) provides both ability to create your own queries through its [Sematext API](/docs/logs/search-through-the-sematext-api/) which is compatible with both Elasticsearch and OpenSearch. It offers rich, yet simple query syntax very much like the [query syntax](/docs/logs/search-syntax/) used by Google.

We also have a [command line tool](https://sematext.com/blog/logsene-cli/) used for viewing, searching, filtering, and analyzing of log entries across all your logs from all your apps.

Expand All @@ -10,4 +10,4 @@ Logs are aggregated by time and shown in the logging management web application,
Also check related [Field Types](/docs/logs/field-types/), [Supported Date Formats](/docs/logs/supported-date-formats/), special fields,
and [FAQ](/docs/logs/faq/) about our log management platform features.

Upload your logs from all your servers to our centralized log management solution with Elasticsearch API, and experience the first true Hosted ELK Stack.
Upload logs from all your servers to our centralized log management solution using the Sematext API, compatible with both Elasticsearch and OpenSearch.
11 changes: 5 additions & 6 deletions docs/events/event-api.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,8 +12,7 @@ See [here](adding.md#adding-events-via-api).

### Event Search API

Sematext exposes the Events Search HTTP API - as [Elasticsearch search API](https://www.elasticsearch.org/guide/en/elasticsearch/reference/current/query-dsl.html) - so
events can be searched and retrieved programmatically via HTTP(S), using curl or any other Elasticsearch client.  The API endpoint is:
Sematext exposes the Events Search HTTP API, which is compatible with both [Elasticsearch](https://www.elasticsearch.org/guide/en/elasticsearch/reference/current/query-dsl.html) and [OpenSearch](https://docs.opensearch.org/docs/latest/query-dsl/) query DSLs. This allows you to search and retrieve events programmatically over HTTP(S), using curl or any standard Elasticsearch/OpenSearch client. The API endpoint is:

`https://event-receiver.sematext.com/APP_TOKEN`

Expand All @@ -25,7 +24,7 @@ events will be limited to the type specified in the URI:
https://event-receiver.sematext.com/APP_TOKEN/event
```

The simplest way to run a query is using [URI search](https://www.elasticsearch.org/guide/en/elasticsearch/reference/current/search-uri-request.html),
The simplest way to run a query is using [URI search](https://docs.opensearch.org/docs/latest/api-reference/search/),
like this:

```bash
Expand All @@ -34,9 +33,9 @@ https://event-receiver.sematext.com/1111111-2222-3333-4444-555555555555/_search?
-H 'Authorization: apiKey 1111111-2222-3333-4444-555555555555'
```

For more info about ```apiKey``` [see](/docs/logs/search-through-the-elasticsearch-api) .
For more info about ```apiKey``` [see](/docs/logs/search-through-the-sematext-api) .

More complex queries are available when using [request body search](https://www.elasticsearch.org/guide/en/elasticsearch/reference/current/search-request-body.html),
More complex queries are available when using [request body search](https://docs.opensearch.org/docs/latest/api-reference/search),
e.g.:

```json
Expand All @@ -52,4 +51,4 @@ curl -XGET "https://event-receiver.sematext.com/1111111-2222-3333-4444-555555555
```

This example shows how to use one of the simplest query types: `query_string`. To see which other query types are available, please
check [Elasticsearch docs](https://www.elasticsearch.org/guide/en/elasticsearch/reference/current/query-dsl.html).
check [OpenSearch docs](https://docs.opensearch.org/docs/latest/query-dsl/).
2 changes: 1 addition & 1 deletion docs/guide/app-guide.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ description: Sematext Cloud Apps Guide. Using Apps to control access to metrics,
Apps act as containers for your data. You can store performance
metrics or logs about servers, containers, software, programming
languages and databases. Our Apps have dozens of monitoring
integrations with software like Docker, AWS, Solr, Elasticsearch, [and
integrations with software like Docker, AWS, Solr, Elasticsearch, OpenSearch, [and
many more](/docs/integration/), while our log
integration works with several different [log
shippers](/docs/integration/#log-shippers). Every
Expand Down
Binary file removed docs/images/logs/kibana-integration.gif
Binary file not shown.
2 changes: 1 addition & 1 deletion docs/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -119,7 +119,7 @@ Stay informed about the most recent developments in our product and agent releas

Sematext integrations let you collect metrics, logs and events across your whole stack from frontend to backend. Our solution goes beyond collecting metrics and detects anomalies, uncovers your slowest transactions, communication between servers and applications, etc.

We expose an Elasticsearch API. Sematext works with all standard log shippers and agents you're already used to, such as syslog, Logstash, Fluentd, Filebeat, Vector, NXLog, log4j and many others, and integrates in minutes.
We expose [Sematext API](docs/logs/index-events-via-elasticsearch-api) that works with all standard log shippers and agents you're already used to, such as syslog, Logstash, Fluentd, Filebeat, Vector, NXLog, log4j and many others, and integrates in minutes.

With Experience you can monitor your frontend or website performance and receive alerts when end-user experience is affected by performance. Sematext Experience provides invaluable insights that keep your business in control of how happy your customers are when interacting with your website or webapp.

Expand Down
2 changes: 1 addition & 1 deletion docs/integration/index.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
title: Integrations
descriptions: Sematext integrations with ready to use monitoring agents and log shippers for infrastructure and container monitoring, log management and analytics, alerting, chatops, and more. Our Cloud and on-premises platform exposes the Elasticsearch API and syslog receivers with built in anomaly detection, data analysis and visualization tools and services
descriptions: Sematext integrations with ready to use monitoring agents and log shippers for infrastructure and container monitoring, log management and analytics, alerting, chatops, and more. Our Cloud exposes the Sematext API -compatible with Elasticsearch and OpenSearch- and syslog receivers with built in anomaly detection, data analysis and visualization tools and services

Sematext supports over **100 different integrations** that automatically collect thousands of metrics and logs from your systems and applications. These integrations simplify monitoring and logging processes, offering fine-tuned **pre-built reports and alert rules** that are readily available and require no additional configuration.

Expand Down
12 changes: 6 additions & 6 deletions docs/integration/opensearch-integration.md
Original file line number Diff line number Diff line change
@@ -1,16 +1,16 @@
title: Opensearch
title: OpenSearch
description: Covers critical metrics—Cluster States, Pending Tasks, shard memory, search latency, request and cache stats—with anomaly detection and diverse alerting options. Correlate events, logs, filter metrics, and visualize cluster health using standard graphs and custom dashboards. Additionally, the OpenSearch Logs integration offers insights into query distribution, error analysis, deprecations, and cluster manager logs for troubleshooting and analysis.

OpenSearch is a powerful, open-source search and analytics engine built for scalability, flexibility, and advanced data exploration capabilities. The [Sematext Agent](/docs/agents/sematext-agent/) collects Opensearch metrics and logs, transmits them to Sematext Cloud; installing the agent takes less than 5 minutes.
OpenSearch is a powerful, open-source search and analytics engine built for scalability, flexibility, and advanced data exploration capabilities. The [Sematext Agent](/docs/agents/sematext-agent/) collects OpenSearch metrics and logs, transmits them to Sematext Cloud; installing the agent takes less than 5 minutes.

## Install Sematext Agent

1. Create an Opensearch Logs or Monitoring [App](/docs/guide/app-guide/). This will let you install the agent and control access to your monitoring and logs data.
1. Create an OpenSearch Logs or Monitoring [App](/docs/guide/app-guide/). This will let you install the agent and control access to your monitoring and logs data.
3. Install the Sematext Agent according to the [https://apps.sematext.com/ui/howto/Opensearch/overview](https://apps.sematext.com/ui/howto/Opensearch/overview) displayed in the UI.
4. After installing the agent, the Discovery tab shows all the Opensearch services identified on the host and you will start receiving metrics or logs from Opensearch services.
5. If you've created an Opensearch Monitoring App and want to collect Opensearch logs as well, or vice versa, click on the **Create Logs App** button from the left menu panel. This will navigate you to the 'Create Logs App' (or Monitoring App) page, where you'll find all the discovered log sources from Opensearch services and manage log and metric shipping effortlessly.
4. After installing the agent, the Discovery tab shows all the OpenSearch services identified on the host and you will start receiving metrics or logs from OpenSearch services.
5. If you've created an OpenSearch Monitoring App and want to collect OpenSearch logs as well, or vice versa, click on the **Create Logs App** button from the left menu panel. This will navigate you to the 'Create Logs App' (or Monitoring App) page, where you'll find all the discovered log sources from OpenSearch services and manage log and metric shipping effortlessly.

Having both Opensearch Logs and Monitoring Apps lets you correlate performance metrics and logs, and accelerate troubleshooting using [Split Screen](/docs/guide/split-screen/) for faster resolution. For example, if you see logs of a node restarting, metrics let you see the impact on the rest of the cluster in terms of CPU, GC, and other metrics. Including query time metrics, even if you don't collect slowlogs from [all] queries.
Having both OpenSearch Logs and Monitoring Apps lets you correlate performance metrics and logs, and accelerate troubleshooting using [Split Screen](/docs/guide/split-screen/) for faster resolution. For example, if you see logs of a node restarting, metrics let you see the impact on the rest of the cluster in terms of CPU, GC, and other metrics. Including query time metrics, even if you don't collect slowlogs from [all] queries.


To [explore logs and services](/docs/monitoring/autodiscovery/) across multiple hosts, navigate to [Fleet & Discovery > Discovery > Services](https://apps.sematext.com/ui/fleet-and-discovery/discovery/services) (or [Sematext Cloud Europe](https://apps.eu.sematext.com/ui/fleet-and-discovery/discovery/services)). From there, you can create additional [Apps](/docs/guide/app-guide/) or stream data to existing ones without requiring any additional installations.
Expand Down
12 changes: 6 additions & 6 deletions docs/logagent/cli-parameters.md
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@
title: Logagent Command-line Parameters
description: Command Line Parameters for Logagent, light-weight log shipper with out of the box and extensible log parsing, on-disk buffering, secure transport, bulk indexing to Elasticsearch and Sematext logs management platform. Low memory footprint and low CPU overhead make it suitable for deploying on edge nodes and devices, while its ability to parse and structure logs makes it a great Logstash alternative.
description: Command Line Parameters for Logagent, light-weight log shipper with out of the box and extensible log parsing, on-disk buffering, secure transport, bulk indexing to Elasticsearch/OpenSearch and Sematext logs management platform. Low memory footprint and low CPU overhead make it suitable for deploying on edge nodes and devices, while its ability to parse and structure logs makes it a great Logstash alternative.

```bash
# Parse all logs and stream them to Sematext Logs 1-Click managed Elasticsearch
# Parse all logs and stream them to Sematext Logs
$ logagent -i LOGSENE_TOKEN /var/log/*.log

# stream logs to local Elasticsearch
Expand Down Expand Up @@ -74,9 +74,9 @@ $ logagent [options] [file list]
| `-y, --yaml` | prints parsed messages in YAML format to stdout|
| `-p, --pretty` | prints parsed messages in pretty JSON format to stdout|
| `-j, --ldjson` | print parsed messages in line-delimited JSON format to stdout |
| __Elasticsearch or Sematext Cloud__| Log storage |
| __Elasticsearch/OpenSearch or Sematext Cloud__| Log storage |
| `-e, --elasticsearchUrl <url>` | Elasticsearch URL e.g. https://localhost:9200, default `htpps://logsene-receiver.sematext.com`|
| `-i, --index <index>` | [Logs App token](https://sematext.com/logsene) to ship data to Sematext Cloud Apps or Elasticsearch index (see `--elasticsearchUrl`) |
| `-i, --index <index>` | [Logs App token](https://sematext.com/logsene) to ship data to Sematext Cloud Apps or Elasticsearch/OpenSearch index (see `--elasticsearchUrl`) |
| `--httpProxy <url>` | HTTP proxy url |
| `--httpsProxy <url>` | HTTPS proxy url |

Expand All @@ -91,9 +91,9 @@ The default output is line-delimited JSON for parsed log lines, as long as no fo
|LOGS_TMP_DIR | Directory to store failed bulk requests for later retransmission.|
|LOG_INTERVAL | Time to batch logs before a bulk request is done. Default is 10000 ms (10 seconds)|
|LOGS_BULK_SIZE | Maximum size of a bulk request. Default is 1000.|
|LOGS_RECEIVER_URL | URL for the Logsene receiver. For a local Elasticsearch server or for Sematext Enterprise version of Logsene. Defaults to Sematext Logsene SaaS receiver https://logsene-receiver.sematext.com/_bulk. Example for Elasticsearch: ```LOGSENE_URL=https://localhost:9200/_bulk```|
|LOGS_RECEIVER_URL | URL for the Logsene receiver. For a local Elasticsearch/OpenSearch server. Defaults to Sematext Logs receiver https://logsene-receiver.sematext.com/_bulk. Example for Elasticsearch: ```LOGSENE_URL=https://localhost:9200/_bulk```|
|HTTPS_PROXY| Proxy URL for HTTPS endpoints, like Logsene receiver. ```export HTTPS_PROXY=https://my-proxy.example```|
|HTTP_PROXY| Proxy URL for HTTP endpoints (e.g. On-Premises or local Elasticsearch). ```export HTTP_PROXY=https://my-proxy.example```|
|HTTP_PROXY| Proxy URL for HTTP endpoints (e.g. On-Premises or local Elasticsearch/OpenSearch). ```export HTTP_PROXY=https://my-proxy.example```|
|LOGAGENT_CONFIG | Filename to read Logagent CLI parameters from a file, defaults to ```/etc/sematext/logagent.conf`` |
|PATTERN_MATCHING_ENABLED | Default is 'true'. The value 'false' disables parsing of logs. |
|SCAN_ALL_PATTERNS | Default is 'false'. For performance reasons, patterns are matched by source name. Setting the value to 'true' enables pattern search regardless of source name |
Expand Down
4 changes: 2 additions & 2 deletions docs/logagent/filter-output-sql.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ Filter and aggregate parsed logs with SQL.

This filter function applies SQL queries on parsed log events. The result of the query is emitted as new event, while the original events are omitted.

Using SQL it is very easy to aggregate values, e.g. group HTTP requests by status codes. The SQL WHERE statement is used to filter events before they get shipped to Elasticsearch or [Logsene](https://sematext.com/logsene).
Using SQL it is very easy to aggregate values, e.g. group HTTP requests by status codes. The SQL WHERE statement is used to filter events before they get shipped to Elasticsearch/OpenSearch or [Sematext Logs](https://sematext.com/logsene).

The supported SQL syntax for SELECT statements is described in the [alasql documentation](https://github.com/agershun/alasql/wiki/Select).

Expand Down Expand Up @@ -43,4 +43,4 @@ output:
Run logagent with your config:
```
logagent --config logagent-example-config.yml
```
```
2 changes: 1 addition & 1 deletion docs/logagent/filters.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@ Example:
2. Input Filter: Grep URLs of interest 'login|register|upgrade'
3. Parser: Parse Log and generate fields like URL, status code, size, referrer, country etc.
4. Output Filter: Drop irelevant log events like redirects (status=302)
5. Output Plugin: Store filtered log-events in Elasticsearch
5. Output Plugin: Store filtered log-events in Elasticsearch/OpenSearch
```

Filters can be declared inline as JavaScript in function or as a reference to npm modules in a Logagent config file.
Expand Down
2 changes: 1 addition & 1 deletion docs/logagent/how-to-gdpr_web_logs.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
Title: GDPR and personal data in web server logs
Description: Log anonymizer, logs and data fields masking needed for GDPR data protection regulation with Logagent, light-weight log shipper, filebeat, fluentd or rsyslog alternative with out of the box and extensible log parsing, on-disk buffering, secure transport, bulk indexing to Elasticsearch and Sematext logs management platform
Description: Log anonymizer, logs and data fields masking needed for GDPR data protection regulation with Logagent, light-weight log shipper, filebeat, fluentd or rsyslog alternative with out of the box and extensible log parsing, on-disk buffering, secure transport, bulk indexing to Elasticsearch/OpenSearch and Sematext logs management platform


Masking data in logs got really important due to meet the requirements of GDPR a European data protection regulation. In the GDPR role "data controller" for your logs, you should minimize the risk of exposing sensitive data to 3rd parties. In some cases, even IP-Addresses are considered as personal data, but your logs might more sensitive data like username, phone numbers etc.
Expand Down
8 changes: 4 additions & 4 deletions docs/logagent/index.md
Original file line number Diff line number Diff line change
@@ -1,10 +1,10 @@
Title: Sematext Logagent Log Shipper
Description: Logagent is lightweight log shipper, filebeat, fluentd or rsyslog alternative with out of the box and extensible log parsing, on-disk buffering, secure transport, bulk indexing to Elasticsearch, Kafka, and Sematext
Description: Logagent is lightweight log shipper, filebeat, fluentd or rsyslog alternative with out of the box and extensible log parsing, on-disk buffering, secure transport, bulk indexing to Elasticsearch, OpenSearch, Kafka, and Sematext

## What is Logagent?
[Logagent](https://sematext.com/logagent) is a modern, open-source, lightweight **log shipper** with a low memory footprint and low CPU overhead!

It comes with out of the box and extensible **log parsing**, **on-disk buffering**, **secure transport**, and **log shipping** with **bulk indexing** to any **Elasticsearch endpoint**, including [Sematext Logs](https://sematext.com/logsene), Kafka, etc.
It comes with out of the box and extensible **log parsing**, **on-disk buffering**, **secure transport**, and **log shipping** with **bulk indexing** to any **Elasticsearch/OpenSearch endpoint**, including [Sematext Logs](https://sematext.com/logsene), Kafka, etc.

If you're eager to get started, here's how you start shipping logs.

Expand Down Expand Up @@ -38,7 +38,7 @@ Logagent contains an installer when you want to use it as a [log shipper](/docs/
- Plugins:
- Inputs (files, streams, sockets, databases)
- Input filters (grep/grok filters)
- Outputs (Elasticsearch, Sematext Cloud, Kafka, etc.)
- Outputs (Elasticsearch, OpenSearch, Sematext Cloud, Kafka, etc.)
- Output filters (SQL aggregation of parsed data, enrichment of data)
- Node.js API

Expand Down Expand Up @@ -72,7 +72,7 @@ input:
- '/var/log/**/*.log'

output:
# index logs in Elasticsearch or Sematext Logs
# index logs in Sematext Logs
sematext: # output a name, e.g., elasticsearch, sematext, etc.
module: elasticsearch
url: https://logsene-receiver.sematext.com
Expand Down
Loading