Self-managed custom LLMs

You can connect self-managed LLMs to maintain more control of your data, operate in an air-gapped environment, or use specific open-source models of your choosing.

For model performance on Elastic Security and Observability AI tasks, refer to the LLM performance matrix for Observability and the LLM performance matrix for Elastic Security.

Warning

Self-managed LLMs work well for Elastic Security's AI Assistant. For Attack Discovery, we recommend using one of the models in the LLM performance matrix for Elastic Security.

The following guides describe how to set up self-managed LLMs for Elastic Security and Observability.

Self-managed LLMs for Elastic Security:

For production environments or air-gapped environments, you can connect to vLLM.
For test environments, you can connect to LM Studio.

Self-managed LLMs for Observability:

The Elastic Stack includes Elastic's core products such as Elasticsearch, Kibana, Logstash, and Beats. Availability Generally available since 9.2 This functionality is generally available and ready for production usage. Unless stated otherwise on the page, this functionality is available when your Elastic Stack is deployed on Elastic Cloud Hosted, Elastic Cloud Enterprise, Elastic Cloud on Kubernetes, and self-managed environments. This documentation corresponds to the latest patch available for each minor version. If you're not using the latest patch, check the release notes for changes. For production, test, or air-gapped environments, you can connect to LM Studio.