Quickwit

Quickwit 0.5.0 introduces significant enhancements, particularly in distributed tracing, by integrating with Jaeger and OpenTelemetry. This version allows Quickwit to serve as a backend for Jaeger, enabling data storage on affordable object storage services like Amazon S3. This setup supports extensive data retention, which is beneficial for long-term issue tracking. Quickwit 0.5 features an OpenTelemetry GRPC endpoint, simplifying the process of shipping traces either through the OpenTelemetry Collector or directly from the application.

Additionally, Quickwit 0.5 includes a control plane, streamlining index management by assigning indexing tasks to nodes within the cluster. The CLI now communicates with the control plane via a REST API, enhancing operational efficiency.

Another notable feature is the support for VRL (Vector Remap Language) transforms, allowing users to script modifications to documents before indexing. This is particularly useful for reformatting datasets, such as parsing syslog data from Kafka sources into structured documents.

Quickwit 0.5 also extends its messaging support by adding Apache Pulsar to its existing Kafka integration, facilitating high-throughput document ingestion and automatic rebalancing in case of node failures.

These updates, along with other improvements, position Quickwit 0.5 as a robust solution for log management and distributed tracing, with upcoming enhancements in Quickwit 0.6 promising even more capabilities for schemaless and OLAP use cases.