Azure billing metricset

Warning

This functionality is in beta and is subject to change. The design and code is less mature than official GA features and is being provided as-is with no warranties. Beta features are not subject to the support SLA of official GA features.

This is the billing metricset of the module azure.

This metricset allows users to retrieve usage details and forecast information of the subscription configured.

Metricset-specific configuration notes

refresh_list_interval: Resources will be retrieved at each fetch call (period interval), this means a number of Azure REST calls will be executed each time. This will be helpful if the azure users will be adding/removing resources that could match the configuration options so they will not added/removed to the list. To reduce on the number of API calls we are executing to retrieve the resources each time, users can configure this setting and make sure the list or resources will not be refreshed as often. This is also beneficial for performance and rate/ cost reasons (https://docs.microsoft.com/en-us/azure/azure-resource-manager/resource-manager-request-limits).
resources: This will contain all options for identifying resources and configuring the desired metrics

Config options to identify resources

billing_scope_department: (string) Retrieve usage details based on the department scope.
billing_scope_account_id: (string) Retrieve usage details based on the billing account ID scope.

If none of the 2 options are entered then the subscription ID will be used as scope.

billing_usage_lookback The Elastic Stack includes Elastic's core products such as Elasticsearch, Kibana, Logstash, and Beats. Availability Generally available since 9.4 This functionality is generally available and ready for production usage. Unless stated otherwise on the page, this functionality is available when your Elastic Stack is deployed on Elastic Cloud Hosted, Elastic Cloud Enterprise, Elastic Cloud on Kubernetes, and self-managed environments. This documentation corresponds to the latest patch available for each minor version. If you're not using the latest patch, check the release notes for changes.: (duration, positive multiple of 24h, default: 24h) How far back to query usage data on each fetch. Azure Cost Management data is documented to be updated for up to 72 hours after a billing period closes, so increasing this to 72h ensures that late cost corrections from Azure are re-queried and ingested.
billing_forecast_window The Elastic Stack includes Elastic's core products such as Elasticsearch, Kibana, Logstash, and Beats. Availability Generally available since 9.4 This functionality is generally available and ready for production usage. Unless stated otherwise on the page, this functionality is available when your Elastic Stack is deployed on Elastic Cloud Hosted, Elastic Cloud Enterprise, Elastic Cloud on Kubernetes, and self-managed environments. This documentation corresponds to the latest patch available for each minor version. If you're not using the latest patch, check the release notes for changes.: (duration, positive multiple of 24h, default: 720h) The length of the forecast period, counted forward from the forecast start date (reference time minus 2 days). Defaults to 30 days (720h).

Fields

For a description of each field in the metricset, see the exported fields section.

Here is an example document generated by this metricset:

{
    "@timestamp": "2020-07-08T08:05:34.853Z",
    "azure": {
        "billing" : {
            "product" : "Tables - LRS Data Stored",
            "usage_start" : "2020-07-08T00:00:00.000Z",
            "usage_end" : "2020-07-08T23:59:59.000Z",
            "currency" : "USD",
            "billing_period_id" : "/subscriptions/fd675b6f-b5e5-426e-ac45-d1f876d0ffa6/providers/Microsoft.Billing/billingPeriods/20200701",
            "account_name" : "Eng1",
            "pretax_cost" : "0.000004175936293",
            "department_name" : "Eng"
        },
        "resource": {
            "group": "obs-infrastructure"
        },
        "subscription_id": "fd675b6f-b5e5-426e-ac45-d1f876d0ffa6"
    },
    "cloud": {
        "instance": {
            "id": "/subscriptions/fd675b6f-b5e5-426e-ac45-d1f876d0ffa6/resourceGroups/obs-infrastructure/providers/Microsoft.DocumentDb/databaseAccounts/obsaccount",
            "name": "obsaccount"
        },
        "provider": "azure",
        "region": "westeurope"
    },
    "event": {
        "dataset": "azure.monitor",
        "duration": 115000,
        "module": "azure"
    },
    "metricset": {
        "name": "monitor",
        "period": 10000
    },
    "service": {
        "type": "azure"
    }
}