Drop document processor

The Drop document processor prevents documents from being indexed when they meet a specific condition, without raising an error.

To configure a condition for dropping documents:

Select Create → Create processor.
Select Drop document from the Processor menu.
Set the Condition for when you want to drop a document.

Warning

The default is the always condition. Not setting a specific condition results in every document that matches the drop condition getting dropped from indexing.

This functionality uses the Elasticsearch Drop processor internally, but you configure it in Streamlang. Streamlang doesn't always have 1:1 parity with the ingest processor options and behavior. Refer to Processor limitations and inconsistencies.

YAML reference

In YAML mode, configure the drop document processor using the following parameters. For the complete Streamlang syntax, refer to the Streamlang reference.

The drop_document processor has no additional parameters beyond the common options. Use a where condition to specify when documents should be dropped.

- action: drop_document
  where:
    field: attributes.path
    eq: "/health"