lambda-ff6fdfa5

Moving lambda execution to the leaf.

lambda-506751fb

blop

v0.8.2

Fixed

• Reduce dead node grace period in order to reduce gossip state size (00b22bf)

aws-lambda-beta-04

Fix the metastore refresh on searchers.

aws-lambda-beta-03

• improved merge execution #4741
• automatic pruning of metastore checkpoints #4777
• exposes all native and ES compatible read endpoints (e.g field capabilities) #4805

v0.8.1

Added

• Add support for OTLP logs in Kafka source (#4807)

Fixed

• Bug in the chitchat digest message serialization (chitchat#144)
• Fix parsing of date times without year (#4811)

Full Changelog: v0.8.0...v0.8.1

v0.8.0

Added

• Remove some noisy logs (#4447)
• Add /{index}/_stats and /_stats ES API (#4442)
• Use search_after in ES scroll API (#4280)
• Add support for wildcard exclusion in index patterns (#4458)
• Add . support in DSL indentifiers (#3989)
• Add cat indices ES API (#4465)
• Limit concurrent merges (#4473)
• Add Index Template API and auto create index (#4456) (only available with ingest V2)
• Add support for compressed ES _bulk requests (#4506)
• Add support for slash / character in field names (#4510)
• Handle SIGTERM shutdown signal (#4539)
• Add start_timestamp and end_timestamp filter to ES _field_caps API (#4547)
• Limit the number of merge pipelines that can be spawned concurrently (#4574)
• Add support for _source_excludes and _source_includes query parameters in ES API (#4572)
• Add gRPC metrics layer to clients and servers (#4591)
• Add additional cluster metrics (#4597)
• Add index patterns query param on GET /indexes endpoint (#4600)
• Add support for GCS file backed metastore (#4604)
• Add default search fields for OTEL traces index (#4602)
• Add support for delete index in ES API (#4606)
• Add a handler to dynamically change the log level (#4662)
• Add REST endpoint to parse a query into a query AST (#4652)
• Add postgresql index and use IN instead of many OR (#4670)
• Add support for _source_excludes, _source_includes, extra_filters in _msearch ES API (#4696)
• Handle track_total_size on request ES body (#4710)
• Add a metric for the number number of indexes (#4711)
• Add various performance optimizations in Quickwit and Tantivy

More details in tantivy's changelog.

Fixed

• Fix aggregation result on empty index (#4449)
• Fix Gzip file source (#4457)
• Rate limit noisy logs (#4483)
• Prevent the exponential backoff from overflowing after 64 attempts (#4501)
• Remove field presence in ES _field_caps API (#4492)
• Remove source in ES parameter, remove unsupported field fields in response (#4590)
• Fix aggregation split_size parameter, add docs and test (#4627)
• Various fixes in chitchat (gossip): more details in chitchat commit history
• Various fixes in mrecordlog (WAL): more details in mrecordlog commit history

Changed

• (Breaking) Add ZSTD compression to chitchat's Deltas

Removed

aws-lambda-beta-02

Fixed

• bug in gzip file source

v0.7.1

Added

• Add es _count API (#4410)
• Add _elastic/_field_caps API (#4350)
• Make gRPC message size configurable (#4388)
• Add API endpoint to get some control-plan internal info (#4339)
• Add Google Cloud Storage Implementation available for storage paths starting with gs:// (#4344)

Changed

• Return 404 on index not found in ES Bulk API (#4425)
• Allow $ and @ characters in field names (#4413)

Fixed

• Assign all sources/shards, even if this requires exceeding the indexer #4363
• Fix traces doc mapping (service name set as fast) and update default otel logs index ID to otel-logs-v0_7 (#4401)
• Fix parsing multi-line queries (#4409)
• Fix range query for optional fast field panics with Index out of bounds (#4362)

Migration from 0.70 to 0.7.1

Quickwit 0.7.1 will create the new index otel-logs-v0_7 which is now used by default when ingesting data with the OTEL gRPC and HTTP API.

In the traces index otel-traces-v0_7, the service_name field is now fast. No migration is done if otel-traces-v0_7 already exists. If you want service_name field to be fast, you have to delete first the existing otel-traces-v0_7 index or you need to create your own index.

aws-lambda-beta-01

Beta release of Quicwkit Lambdas.