Airflow module

This module collects metrics from Airflow metrics. It runs a statsd server where airflow will send metrics to. The default metricset is statsd.

The Airflow module is tested with Airflow 2.1.0. It should work with version 2.0.0 and later.

The Airflow module requires Statsd to receive statsd metrics. Refer to the link for instructions about how to use statsd.

Add the following lines to your Airflow configuration file e.g. airflow.cfg ensuring statsd_prefix is left empty and replace %METRICBEAT_HOST% with the address where metricbeat is running:

[metrics]
statsd_on = True
statsd_host = %METRICBEAT_HOST%
statsd_port = 8126
statsd_prefix =

The Airflow module supports the standard configuration options that are described in Modules. Here is an example configuration:

metricbeat.modules:
- module: airflow
  host: "localhost"
  port: "8126"
  #ttl: "30s"
  metricsets: [ 'statsd' ]

The following metricsets are available:

• statsd Stack Beta The Elastic Stack includes Elastic's core products such as Elasticsearch, Kibana, Logstash, and Beats. Availability Beta This functionality is in beta and is not ready for production usage. For beta features, the design and code is less mature than official GA features and is being provided as-is with no warranties. Beta features are not subject to the support SLA of official GA features. Specific Support terms apply. Unless stated otherwise on the page, this functionality is available when your Elastic Stack is deployed on Elastic Cloud Hosted, Elastic Cloud Enterprise, Elastic Cloud on Kubernetes, and self-managed environments. This documentation corresponds to the latest patch available for each minor version. If you're not using the latest patch, check the release notes for changes.