Type to search.

Unbalanced shard counts

ECH

Elastic Cloud Hosted lets you manage and configure one or more deployments of the versioned Elastic Stack, hosted on Elastic Cloud.

Availability

  • Generally available

    This functionality is generally available and ready for production usage.

ECK

Elastic Cloud on Kubernetes extends Kubernetes orchestration capabilities to allow you to deploy and manage components of the Elastic Stack.

Availability

  • Generally available

    This functionality is generally available and ready for production usage.

This documentation corresponds to the latest patch available for each minor version. If you're not using the latest patch, check the release notes for changes.

ECE

Elastic Cloud Enterprise is a self-managed orchestration platform for deploying and managing the Elastic Stack at scale.

Availability

  • Generally available

    This functionality is generally available and ready for production usage.

This documentation corresponds to the latest patch available for each minor version. If you're not using the latest patch, check the release notes for changes.

Self-managed

Self-managed deployments are Elastic Stack deployments managed without the assistance of an orchestrator.

Availability

  • Generally available

    This functionality is generally available and ready for production usage.

This documentation corresponds to the latest patch available for each minor version. If you're not using the latest patch, check the release notes for changes.

Shard counts across data nodes are skewed enough that some nodes carry far fewer shards than peers in the same tier. Uneven placement wastes capacity on light nodes and can overload heavier ones for indexing and search.

Note

For a complete list of insights, refer to AutoOps insights.

Field Value
Component Elasticsearch
Severity Medium
Scope Node
Domains performance, shard-allocation

You can customize these settings to adjust when AutoOps detects this event and presents the insight. Refer to AutoOps event settings for details.

The default customization settings are:

Setting Type Default
Unbalanced shard percent above the average Percentage 50

The following is an example of what you might see when this insight is triggered. Real insights use live data and links from your deployment or cluster.

Affected data tier: hot, warm.

Average number of shards per node: 12

Nodes with the lowest number of shards: - es-data-03: 8

Nodes with the highest number of shards: - es-data-01: 42

Note

AutoOps shows different recommendations depending on how their conditions match your deployment or cluster.

Enable shard rebalance

Condition: Always shown for this insight.

Reset cluster.routing.rebalance.enable so primary and replica shards can rebalance across nodes.

JSON
PUT _cluster/settings
{
  "transient": {
    "cluster.routing.rebalance.enable": null
  },
  "persistent": {
    "cluster.routing.rebalance.enable": null
  }
}
Note

Requires the manage cluster privilege. Requires Elasticsearch 8.0.0 or later. This action changes cluster or index configuration.

Elasticsearch normally spreads shards across active data nodes in a tier through allocation (placing unassigned shards) and rebalancing (moving shards between nodes).

When those processes cannot even out placement, some nodes sit underused while others hold most of the work. Common blockers include turned off rebalancing, allocation filters or awareness settings, disk watermarks, and node attributes that limit where shards can live.

Uneven shard counts often show up as uneven CPU, heap, and disk pressure, which slows indexing and search on the busier nodes.

Cluster-level shard allocation and routing settings