--- title: Compute description: The compute dataset is designed to fetch metrics for Compute Engine Virtual Machines in Google Cloud Platform. It contains all metrics exported from the... url: https://www.elastic.co/docs/reference/integrations/gcp/compute products: - Elastic integrations applies_to: - Serverless Observability projects: Generally available - Serverless Security projects: Generally available - Elastic Stack: Generally available since 9.0 --- # Compute | | | |----------------------------------------------------------------------------|---------------------------------| | **Version** | 2.52.0 ([View all](#changelog)) | | **Subscription level**[What's this?](https://www.elastic.co/subscriptions) | Basic | | **Ingestion method(s)** | API, GCP Pub/Sub | | **Minimum Kibana version(s)** | 9.0.08.18.0 | ## Metrics The `compute` dataset is designed to fetch metrics for [Compute Engine](https://cloud.google.com/compute/) Virtual Machines in Google Cloud Platform. It contains all metrics exported from the [GCP Cloud Monitoring API](https://cloud.google.com/monitoring/api/metrics_gcp#gcp-compute). Extra labels and metadata are also extracted using the [Compute API](https://cloud.google.com/compute/docs/reference/rest/v1/instances/get). This is enough to get most of the info associated with a metric like Compute labels and metadata and metric specific Labels. ## Sample Event ```json { "@timestamp": "2017-10-12T08:05:34.853Z", "cloud": { "account": { "id": "elastic-obs-integrations-dev", "name": "elastic-obs-integrations-dev" }, "instance": { "id": "4751091017865185079", "name": "gke-cluster-1-default-pool-6617a8aa-5clh" }, "machine": { "type": "e2-medium" }, "provider": "gcp", "availability_zone": "us-central1-c", "region": "us-central1" }, "event": { "dataset": "gcp.compute", "duration": 115000, "module": "gcp" }, "gcp": { "compute": { "firewall": { "dropped": { "bytes": 421 }, "dropped_packets_count": { "value": 4 } }, "instance": { "cpu": { "reserved_cores": { "value": 1 }, "usage": { "pct": 0.07259952346383708 }, "usage_time": { "sec": 4.355971407830225 } }, "memory": { "balloon": { "ram_size": { "value": 4128378880 }, "ram_used": { "value": 2190848000 }, "swap_in": { "bytes": 0 }, "swap_out": { "bytes": 0 } } }, "uptime": { "sec": 60.00000000000091 } } }, "labels": { "user": { "goog-gke-node": "" } } }, "host": { "id": "4751091017865185079", "name": "gke-cluster-1-default-pool-6617a8aa-5clh" }, "metricset": { "name": "compute", "period": 10000 }, "service": { "type": "gcp" } } ``` ## Exported fields **ECS Field Reference** Please refer to the following [document](https://www.elastic.co/guide/en/ecs/current/ecs-field-reference.html) for detailed information on ECS fields. | Field | Description | Type | Metric Type | |----------------------------------------------------|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|------------------|-------------| | @timestamp | Event timestamp. | date | | | agent.id | Unique identifier of this agent (if one exists). Example: For Beats this would be beat.id. | keyword | | | cloud.account.id | The cloud account or organization id used to identify different entities in a multi-tenant environment. Examples: AWS account id, Google Cloud ORG Id, or other unique identifier. | keyword | | | cloud.availability_zone | Availability zone in which this host, resource, or service is located. | keyword | | | cloud.image.id | Image ID for the cloud instance. | keyword | | | cloud.instance.id | Instance ID of the host machine. | keyword | | | cloud.machine.type | Machine type of the host machine. | keyword | | | cloud.region | Region in which this host, resource, or service is located. | keyword | | | data_stream.dataset | Data stream dataset. | constant_keyword | | | data_stream.namespace | Data stream namespace. | constant_keyword | | | data_stream.type | Data stream type. | constant_keyword | | | event.dataset | Event dataset | constant_keyword | | | event.module | Event module | constant_keyword | | | gcp.compute.firewall.dropped.bytes | Delta of incoming bytes dropped by the firewall | long | gauge | | gcp.compute.firewall.dropped_packets_count.value | Delta of incoming packets dropped by the firewall | long | gauge | | gcp.compute.instance.cpu.reserved_cores.value | Number of cores reserved on the host of the instance | double | gauge | | gcp.compute.instance.cpu.usage.pct | The fraction of the allocated CPU that is currently in use on the instance | double | gauge | | gcp.compute.instance.cpu.usage_time.sec | Delta of usage for all cores in seconds | double | gauge | | gcp.compute.instance.disk.read.bytes | Delta of count of bytes read from disk | long | gauge | | gcp.compute.instance.disk.read_ops_count.value | Delta of count of disk read IO operations | long | gauge | | gcp.compute.instance.disk.write.bytes | Delta of count of bytes written to disk | long | gauge | | gcp.compute.instance.disk.write_ops_count.value | Delta of count of disk write IO operations | long | gauge | | gcp.compute.instance.memory.balloon.ram_size.value | The total amount of memory in the VM. This metric is only available for VMs that belong to the e2 family. | long | gauge | | gcp.compute.instance.memory.balloon.ram_used.value | Memory currently used in the VM. This metric is only available for VMs that belong to the e2 family. | long | gauge | | gcp.compute.instance.memory.balloon.swap_in.bytes | Delta of the amount of memory read into the guest from its own swap space. This metric is only available for VMs that belong to the e2 family. | long | gauge | | gcp.compute.instance.memory.balloon.swap_out.bytes | Delta of the amount of memory written from the guest to its own swap space. This metric is only available for VMs that belong to the e2 family. | long | gauge | | gcp.compute.instance.network.egress.bytes | Delta of count of bytes sent over the network | long | gauge | | gcp.compute.instance.network.egress.packets.count | Delta of count of packets sent over the network | long | gauge | | gcp.compute.instance.network.ingress.bytes | Delta of count of bytes received from the network | long | gauge | | gcp.compute.instance.network.ingress.packets.count | Delta of count of packets received from the network | long | gauge | | gcp.compute.instance.uptime.sec | Delta of number of seconds the VM has been running. | long | gauge | | gcp.compute.instance.uptime_total.sec | Elapsed time since the VM was started, in seconds. Sampled every 60 seconds. After sampling, data is not visible for up to 120 seconds. | long | gauge | | gcp.labels.metadata.* | | object | | | gcp.labels.metrics.* | | object | | | gcp.labels.resource.* | | object | | | gcp.labels.system.* | | object | | | gcp.labels.user.* | | object | | | gcp.labels_fingerprint | Hashed value of the labels field. | keyword | | | gcp.metrics.*.*.*.* | Metrics that returned from Google Cloud API query. | object | | | host.containerized | If the host is a container. | boolean | | | host.os.build | OS build information. | keyword | | | host.os.codename | OS codename, if any. | keyword | | ## Screenshots This integration includes one or more Kibana dashboards that visualizes the data collected by the integration. The screenshots below illustrate how the ingested data is displayed. ![GCP Compute Metrics Dashboard](https://epr.elastic.co/package/gcp/2.52.0/img/gcp-compute.png) ## Changelog | Version | Details | Minimum Kibana version | |--------------------|---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|------------------------| | **2.52.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/21999))Add `host.target.id` and full resource names in `entity.target.id` to the audit data stream, so targets resolve to Cloud Asset Inventory entities. | 9.0.08.18.0 | | **2.51.1** | **Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/21605))Mark the `audit` data stream orchestrator resource-path grok as `ignore_failure` so audit events whose `protoPayload.resourceName` is not a standard Kubernetes resource path (for example non-resource API server requests) no longer abort the ingest pipeline. | 9.0.08.18.0 | | **2.51.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/20573))Add tags to ingest pipeline processors and add `preserve_original_event` to pipeline-level `on_failure` handlers.**Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/20573))Remove a redundant no-op `script` processor populating `related.entity` in the `audit` data stream.**Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/20573))Append to `error.message` in the `billing` and `cloudsql_*` pipeline-level `on_failure` handlers instead of overwriting, so multiple failures are retained. `error.message` is now an array on failed documents. | 9.0.08.18.0 | | **2.50.2** | **Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/19911))Add security category to the Load Balancing and VPC Flow data streams to match their policy template categories. | 9.0.08.18.0 | | **2.50.1** | **Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/18819))Fix JSON credentials escaping. | 9.0.08.18.0 | | **2.50.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/18645))Enable secrets for sensitive fields. For more details, refer [https://www.elastic.co/guide/en/fleet/current/agent-policy.html#agent-policy-secret-values](https://www.elastic.co/guide/en/fleet/current/agent-policy.html#agent-policy-secret-values) | 9.0.08.18.0 | | **2.49.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/17980))Keep ServiceData with binding deltas fields for Cloud Resource Manager events. | 9.0.08.18.0 | | **2.48.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/17830))Add support of parsing cluster notifications in audit data stream. | 9.0.08.18.0 | | **2.47.2** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/17592))Set user.email and user.id from client.user in GCP Audit pipeline. | 9.0.08.13.0 | | **2.47.1** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/16898))Fix gke network metrics fields and dashboard. | 9.0.08.13.0 | | **2.47.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/15828))Enhance GCP billing data stream with additional fields. | 9.0.08.13.0 | | **2.46.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/15930))Add type-specific entity fields to data stream.This enables better entity classification while maintaining backward compatibility with existing `actor.entity.id` and `target.entity.id` fields. | 9.0.08.13.0 | | **2.45.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/15279))Prefer set with copy_from. | 9.0.08.13.0 | | **2.44.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/15619))Add support for parsing sensitive action notifications event in the audit dataset. | 9.0.08.13.0 | | **2.43.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/14745))Add tags and processors to GCP Billing, Cloudrun, CloudSQL, Dataproc, GKE, Loadbalancing, Pubsub and Redis. | 9.0.08.13.0 | | **2.42.2** | **Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/14765))Fixed GCP project ID handling to prevent numeric parsing issues by enforcing string type casting in YAML configuration templates. | 9.0.08.13.0 | | **2.42.1** | **Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/13777))Remove redundant audit violation field renames. | 9.0.08.13.0 | | **2.42.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/13521))Allow @custom pipeline access to event.original without setting preserve_original_event. | 9.0.08.13.0 | | **2.41.1** | **Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/13633))Preserve original value of resource name. | 9.0.08.13.0 | | **2.41.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/12251))Add support for Kibana `9.0.0`. | 9.0.08.13.0 | | **2.40.1** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/12223))Add missing category. | 8.13.0 | | **2.40.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/11983))Add `actor.entity.id` and `target.entity.id` fields to audit logs. | 8.13.0 | | **2.39.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/11762))Add `related.entity` field to audit logs. | 8.13.0 | | **2.38.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/10886))Add `policy_violation_info`, `metadata` and `related` fields to audit logs.**Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/10886))Update GCP audit log dashboard to use correct `email` field. | 8.13.0 | | **2.37.2** | **Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/11016))Fix definition of subfields of nested objects | 8.13.0 | | **2.37.1** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/9931))Improve GCP Billing documentation. | 8.13.0 | | **2.37.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/10701))Retain `authenticationInfo.serviceAccountKeyName` data. | 8.13.0 | | **2.36.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/10398))Add global dataset filter for dashboards to improve performance. | 8.13.0 | | **2.35.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/10225))ECS version updated to 8.11.0. Update the kibana constraint to ^8.13.0. Modified the field definitions to remove ECS fields made redundant by the ecs@mappings component template. | 8.13.0 | | **2.34.1** | **Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/10159))Fix Redis metric type for 'persistence.rdb.bgsave_in_progress'. Metric type should be boolean instead of long. | 8.12.0 | | **2.34.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/9508))Add tags and processors to GCP Compute, Firestore, PostgreSQL. | 8.12.0 | | **2.33.2** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/9252))Add tags and processors to GCP Storage | 8.12.0 | | **2.33.1** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/8404))Update Legacy metric visualization to new metric in GCP Billing overview dashboard. | 8.12.0 | | **2.33.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/8662))Enable time series data for metrics data streams. This dramatically reduces storage for metrics and is expected to progressively improve query [performance](https://www.elastic.co/blog/70-percent-storage-savings-for-metrics-with-elastic-observability). For more details, see [https://www.elastic.co/guide/en/elasticsearch/reference/current/tsds.html](https://www.elastic.co/guide/en/elasticsearch/reference/current/tsds.html). | 8.12.0 | | **2.32.1** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/8314))Add dimensions mappings and the metrics_fingerprint field across all metrics data streams. | 8.12.0 | | **2.32.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/8343))Add new billing data stream fields. | 8.12.0 | | **2.31.2** | **Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/8447))Fix pipeline error parsing DNS logs with empty rdata field. | 8.7.1 | | **2.31.1** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/8096))Add Cloud Run docs and fix policy template name to allow adding Cloud Run logs to the policy. | 8.7.1 | | **2.31.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/8299))Allow users to retain otherwised discarded fields. | 8.7.1 | | **2.30.1** | **Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/8115))Fix mappings of group fields | 8.7.1 | | **2.30.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/7957))Add tags.yml file so that integration's dashboards and saved searches are tagged with "Security Solution" and displayed in the Security Solution UI.**Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/7957))Upgrade package spec to 3.0.0.**Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/7957))Fix orphan dashboard references.**Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/7957))Add missing dashboard filters. | 8.7.1 | | **2.29.1** | **Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/7934))Add null checks and ignore_missing checks to the rename processor | 8.7.1 | | **2.29.0** | **Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/7367))Remove GCP CloudSQL deprecated, alpha or beta metrics and fix field types. | 8.7.1 | | **2.28.5** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/7569))Set metric type for GKE, Load Balancing, PubSub, Redis and Storage data streams. | 8.7.1 | | **2.28.4** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/7458))Migrate GCP Load Balancing HTTPS Overview dashboard to lens. | 8.7.1 | | **2.28.3** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/7560))Set metric type for Cloud Run, Compute, Dataproc and Firestore data streams. | 8.7.1 | | **2.28.2** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/7459))Migrate GCP Load Balancing TCP SSL Proxy Overview dashboard to lens. | 8.7.1 | | **2.28.1** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/7556))Set metric type for CloudSQL data streams. | 8.7.1 | | **2.28.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/7461))Migrate GCP Load Balancing L3 Overview dashboard to lens. | 8.7.1 | | **2.27.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/7368))Add GCP CloudSQL MySQL, SQL Server and PostgreSQL dashboards. | 8.7.1 | | **2.26.0** | **Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/7287))Fix GCP loadbalancing_metrics fields prefix. | 8.7.1 | | **2.25.1** | **Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/7308))Fix check on gcp.audit.authorization_info[].granted. | 8.7.1 | | **2.25.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/7249))Migrate GCP Billing input control to new control panel. | 8.7.1 | | **2.24.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/4126))Add GCP CloudSQL MySQL, Postgres, SQLServer data streams | 8.7.1 | | **2.23.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/7014))Convert security dashboards to lens. | 8.7.1 | | **2.22.1** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/6614))Change ownership in manifest. | 8.6.0 | | **2.22.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/6614))Ensure event.kind is correctly set for pipeline errors. | 8.6.0 | | **2.21.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/6326))Update package to ECS 8.8.0. | 8.6.0 | | **2.20.1** | **Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/6128))Fix invalid TSDS metric type for persistence.rdb.bgsave_in_progress field | 8.6.0 | | **2.20.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/5765))Update package to ECS 8.7.0. | 8.6.0 | | **2.19.1** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/5038))Migrate compute dashboard to lens and add datastream filter. | 8.6.0 | | **2.19.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/5097))Add Cloud Run metrics datastream. | 8.6.0 | | **2.18.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/5630))Support `subscription_num_goroutines` and `subscription_max_outstanding_messages` for GCP PubSub input | 8.6.0 | | **2.17.2** | **Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/5597))Fix IP Convert processor in Audit ingest pipeline. | 8.6.0 | | **2.17.1** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/5123))Added categories and/or subcategories. | 8.6.0 | | **2.17.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/5025))Add Audit Log Overview dashboard**Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/5025))Add GKE Overview dashboard**Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/5025))Add PubSub Overview dashboard**Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/5025))Add Storage Overview dashboard | 8.6.0 | | **2.16.2** | **Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/5231))Add logic to handle scalar request.policy values on audit | 8.5.0 | | **2.16.1** | **Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/5032))Replace missing input control panel with new-style control. | 8.5.0 | | **2.16.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/4576))Update package to ECS 8.6.0. | 8.5.0 | | **2.15.2** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/4729))Update documentation. | 8.5.0 | | **2.15.1** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/4639))Add GCP Compute pipeline test. | 8.5.0 | | **2.15.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/4197))Remove support for Kibana 7.17.x**Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/4197))Support multiple regions for metrics data streams | 8.5.0 | | **2.14.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/4285))Update package to ECS 8.5.0. | 8.3.0 | | **2.13.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/4214))Migrate dashboard by values | 8.3.0 | | **2.12.1** | **Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/4397))Remove duplicate fields. | 8.3.07.17.6 | | **2.12.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/4325))Add GCP Redis | 8.3.07.17.6 | | **2.11.12** | **Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/4357))Add GKE ingest pipeline. | 8.3.07.17.6 | | **2.11.11** | **Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/4371))Fix type of dns.answers.ttl. | 8.3.07.17.6 | | **2.11.10** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/4344))Add ingest pipeline for dataproc.**Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/4350))Add GCP loadbalancing ingest pipeline**Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/4349))Add GCP PubSub ingest pipeline**Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/4348))Add GCP Storage ingest pipeline**Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/4347))Add GCP Firestore ingest pipeline**Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/4343))Add GCP Compute ingest pipeline | 8.3.07.17.6 | | **2.11.10-beta.6** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/4344))Add ingest pipeline for dataproc. | | | **2.11.10-beta.5** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/4350))Add GCP loadbalancing ingest pipeline | | | **2.11.10-beta.4** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/4349))Add GCP PubSub ingest pipeline | | | **2.11.10-beta.3** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/4348))Add GCP Storage ingest pipeline | | | **2.11.10-beta.2** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/4347))Add GCP Firestore ingest pipeline | | | **2.11.10-beta.1** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/4343))Add GCP Compute ingest pipeline | | | **2.11.9** | **Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/4355))Fix GKE kubernetes.io indentation. | 8.3.07.17.6 | | **2.11.8** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/4339))Remove duplicate fields. | 8.3.07.17.6 | | **2.11.7** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/4270))Move Dataproc lightweight module config into integration | 8.3.07.17.6 | | **2.11.6** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/4269))Move LoadBalancing lightweight module config into integration | 8.3.07.17.6 | | **2.11.5** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/4268))Move Storage lightweight module config into integration | 8.3.07.17.6 | | **2.11.4** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/4267))Move PubSub lightweight module config into integration | 8.3.07.17.6 | | **2.11.3** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/3797))Move GKE lightweight module config into integration | 8.3.07.17.6 | | **2.11.2** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/3798))Move Firestore lightweight module config into integration | 8.3.07.17.6 | | **2.11.1** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/issues/4227))Use ECS geo.location definition. | 8.3.07.17.6 | | **2.11.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/3797))Move Compute lightweight module config into integration | 8.3.07.17.6 | | **2.10.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/3788))Add GCP PubSub Data stream | 8.3.07.17.6 | | **2.9.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/3789))Add GCP Dataproc Data stream | 8.3.07.17.6 | | **2.8.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/4098))Add GCP GKE Data Stream | 8.3.07.17.6 | | **2.7.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/3785))Add GCP Storage Data Stream | 8.3.07.17.6 | | **2.6.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/3493))Add Load Balancing logs datastream | 8.3.07.17.6 | | **2.5.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/2308))Add GCP Load Balancing Metricset**Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/3986))Fix credentials_json escaping in loadbalancing_metrics**Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/3986))Update loadbalancing_metrics default period to 60s**Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/3986))Fix event.dataset for loadbalancing_metrics**Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/4004))Add loadbalancing_metrics distribution fields | 8.3.07.17.6 | | **2.4.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/3865))Update package to ECS 8.4.0 | 8.3.07.17.6 | | **2.3.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/2340))Add additional parsing for DNS Public Zone Query Logs | 8.3.07.17.6 | | **2.2.1** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/3821))Fix Billing policy template title and default period for gcp.compute | 8.3.07.17.6 | | **2.2.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/3609))Remove fields duplicated in ECS fields | 8.3.07.17.6 | | **2.1.0** | **Enhancement**restore compatibility with 7.17 release track | 8.3.07.17.6 | | **2.0.0** | **Breaking change** ([View pull request](https://github.com/elastic/integrations/pull/2707))Move configurations to support metrics. This change is breaking, as it movessome configuration from the top level variables to data stream variables.This change involves `project_id`, `credentials_file` and `credentials_json`variables that are moved from input level configuration to package levelconfiguration (as those variables are reused across all inputs/data streams).Users with GCP integration enabled will need to input values for thesevariables again when upgrading the policies to this version.**Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/2141))Add GCP Billing Data Stream**Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/2301))Add GCP Compute Data Stream**Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/2704))Add GCP Firestore Data stream | 8.3.0 | | **1.10.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/3353))Update package to ECS 8.3.0. | 8.0.07.17.0 | | **1.9.2** | **Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/3583))Fix GCP auditlog parsing issue on response status | 8.0.07.17.0 | | **1.9.1** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/3103))Update readme | 8.0.07.17.0 | | **1.9.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/3390))Preserve request and response in flattened fields. | 8.0.07.17.0 | | **1.8.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/3274))Add missing `cloud.provider` field. | 8.0.07.17.0 | | **1.7.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/3280))Add dashboards for firewall and vpc flow logs.**Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/3280))Add missing mappings for several `event.*` fields. | | | **1.6.1** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/3206))Clarify the GCP privileges required by the Pub/Sub input. | 8.0.07.16.3 | | **1.6.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/2779))Update to ECS 8.2 | | | **1.5.1** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/2916))Add documentation for multi-fields | 8.0.07.16.3 | | **1.5.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/2842))Improve Google Cloud Platform docs. | 8.0.07.16.3 | | **1.4.2** | **Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/2747))Remove emtpy values, names with only dots, and invalid client IPs. | 8.0.07.16.3 | | **1.4.1** | **Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/2712))Fix quoting of the credentials_json value in policy templates. | 8.0.07.16.3 | | **1.4.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/2624))Add gcp.dns integration | | | **1.3.1** | **Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/2470))Add Ingest Pipeline script to map IANA Protocol Numbers | 8.0.07.15.0 | | **1.3.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/2406))Update to ECS 8.0 | 8.0.07.15.0 | | **1.2.2** | **Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/2339))Regenerate test files using the new GeoIP database | 8.0.07.15.0 | | **1.2.1** | **Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/2327))Change test public IPs to the supported subset | | | **1.2.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/2251))Add 8.0.0 version constraint | 8.0.07.15.0 | | **1.1.2** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/1965))Update Title and Description. | 7.15.0 | | **1.1.1** | **Bug fix** ([View pull request](https://github.com/elastic/integrations/pull/1818))Fix logic that checks for the 'forwarded' tag | | | **1.1.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/1661))Update to ECS 1.12.0 | 7.15.0 | | **1.0.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/1568))Move from experimental to GA**Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/1717))remove experimental from data_sets | | | **0.3.3** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/1478))Convert to generated ECS fields | | | **0.3.2** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/1385))update to ECS 1.11.0 | | | **0.3.1** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/1405))Escape special characters in docs | | | **0.3.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/1364))Update integration description | | | **0.2.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/1240))Set "event.module" and "event.dataset" | | | **0.1.0** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/1045))update to ECS 1.10.0 and adding event.original options | | | **0.0.2** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/846))update to ECS 1.9.0 | | | **0.0.1** | **Enhancement** ([View pull request](https://github.com/elastic/integrations/pull/459))initial release | |