Skip to main content

Announcing Lucenia v0.9: Index State Management and Enhanced Observability

· 3 min read
Maria Carrero
Maria Carrero
Lucenia Team

Lucenia 0.9 delivers enterprise-grade index lifecycle automation and enhanced observability for production search deployments. This release introduces Index State Management (ISM) for policy-driven index operations, native OpenTelemetry configuration for seamless monitoring, and AWS Marketplace integration for streamlined billing—making Lucenia more operational, observable, and enterprise-ready than ever.

Whether you're managing petabyte-scale log analytics, running AI-powered retrieval pipelines, or deploying search across hybrid infrastructure, Lucenia 0.9 gives you the automation and visibility needed to operate with confidence.

Key Highlights​

1. Index State Management: Automate Your Index Lifecycle​

Managing index lifecycle at scale is one of the most operationally demanding aspects of running search infrastructure. With Index State Management (ISM), Lucenia 0.9 enables fully automated, policy-driven index operations.

ISM allows you to:

  • Automate rollover based on index age, size, or document count
  • Schedule index deletion to manage storage costs
  • Adjust replica counts dynamically based on workload
  • Define custom policies that match your retention and compliance requirements

For teams running observability pipelines, SIEM workloads, or time-series analytics, ISM eliminates manual index maintenance and ensures your cluster stays healthy without constant intervention.

2. OpenTelemetry Integration: Native Observability​

Monitoring distributed search infrastructure requires deep visibility into performance and behavior. Lucenia 0.9 introduces native OpenTelemetry configuration directly in the otel plugin.

This enables:

  • Direct endpoint configuration without external tooling
  • Seamless integration with existing observability stacks (Jaeger, Prometheus, Grafana)
  • Standardized telemetry collection across your entire infrastructure
  • Better debugging of query performance and cluster health

With OpenTelemetry built in, Lucenia becomes a first-class citizen in modern observability pipelines—giving you the metrics, traces, and logs you need to operate search at scale.

3. AWS Marketplace Metering: Simplified Enterprise Billing​

For organizations running Lucenia in AWS environments, the new AWS Marketplace Metering Plugin enables usage-based billing integration directly from your deployment.

This provides:

  • Streamlined procurement through AWS Marketplace
  • Usage-based billing that scales with your workload
  • Simplified compliance with enterprise purchasing requirements
  • Consolidated billing through existing AWS accounts

4. Notifications Module: Proactive Alerting​

Lucenia 0.9 adds a Notifications module with alerting and monitoring workflow infrastructure, enabling:

  • Proactive alerts when cluster health changes
  • Custom notification workflows for operational events
  • Integration with external systems for incident management
  • Automated responses to critical conditions

Additional Improvements​

This release also includes several performance and integration enhancements:

  • KnnVectorsFormat reload support for dynamic knn plugin updates without restart
  • Parent filter support for nested search in knn queries, enabling complex document structures
  • Notification and replication libraries integrated into core for tighter coordination
  • MetadataClient improvements with direct response object returns for cleaner APIs
  • ContextIndexSearcher optimization to prevent duplicate query execution
  • JKS keystore and truststore support in SecureRestClientBuilder for enhanced SSL configuration

Bug Fixes​

Lucenia 0.9 addresses several stability issues:

  • Fixed ML model controller deployment failures under Java SecurityManager
  • Resolved static SIS Provider security context issues with doPrivileged
  • Fixed job-scheduler and notifications integration tests for external clusters
  • Addressed ML-commons integration test failures
  • Resolved race condition in continuous transform integration tests

What This Release Unlocks​

Lucenia 0.9 represents a significant step toward enterprise operational maturity:

  • Automated index lifecycle management
  • Native observability integration
  • Streamlined enterprise billing
  • Proactive monitoring and alerting
  • Improved stability and performance

These capabilities make Lucenia not just a powerful search engine, but a production-ready platform that fits naturally into enterprise infrastructure and operational workflows.

Get Started Today​

Lucenia 0.9 is available now. Download it here and bring enterprise-grade automation and observability to your search infrastructure.