AuthThe Elastic Stack includes Elastic's core products such as Elasticsearch, Kibana, Logstash, and Beats.AvailabilityGenerally available since 8.16This functionality is generally available and ready for production usage.Unless stated otherwise on the page, this functionality is available when your Elastic Stack is deployed on Elastic Cloud Hosted, Elastic Cloud Enterprise, Elastic Cloud on Kubernetes, and self-managed environments.This documentation corresponds to the latest patch available for each minor version. If you're not using the latest patch, check the release notes for changes.
Create an inference endpoint to perform an inference task with the alibabacloud-ai-search service.
The maximum size of a chunk in words.
This value cannot be higher than 300 or lower than 20 (for sentence strategy) or 10 (for word strategy).
overlapnumber · default: 100
The number of overlapping words for chunks.
It is applicable only to a word chunking strategy.
This value cannot be higher than half the max_chunk_size value.
sentence_overlapnumber · default: 1
The number of overlapping sentences for chunks.
It is applicable only for a sentence chunking strategy.
It can be either 1 or 0.
strategystring · default: sentence
The chunking strategy: sentence or word.
serviceenumrequired
The type of service supported for the specified task type. In this case, alibabacloud-ai-search.
Values:alibabacloud-ai-search
service_settingsobjectrequired
Settings used to install the inference model. These settings are specific to the alibabacloud-ai-search service.
api_keystringrequired
A valid API key for the AlibabaCloud AI Search API.
hoststringrequired
The name of the host address used for the inference task.
You can find the host address in the API keys section of the documentation.
This setting helps to minimize the number of rate limit errors returned from AlibabaCloud AI Search.
By default, the alibabacloud-ai-search service sets the number of requests allowed per minute to 1000.
requests_per_minutenumber
The number of requests allowed per minute.
service_idstringrequired
The name of the model service to use for the inference task.
The following service IDs are available for the completion task:
ops-qwen-turbo
qwen-turbo
qwen-plus
qwen-max ÷ qwen-max-longcontext
The following service ID is available for the rerank task:
ops-bge-reranker-larger
The following service ID is available for the sparse_embedding task:
ops-text-sparse-embedding-001
The following service IDs are available for the text_embedding task:
The name of the workspace used for the inference task.
task_settingsobject
Settings to configure the inference task.
These settings are specific to the task type you specified.
input_typestring
For a sparse_embedding or text_embedding task, specify the type of input passed to the model.
Valid values are:
ingest for storing document embeddings in a vector database.
search for storing embeddings of search queries run against a vector database to find relevant documents.
return_tokenboolean
For a sparse_embedding task, it affects whether the token name will be returned in the response.
It defaults to false, which means only the token ID will be returned in the response.
The maximum size of a chunk in words.
This value cannot be higher than 300 or lower than 20 (for sentence strategy) or 10 (for word strategy).
overlapnumber · default: 100
The number of overlapping words for chunks.
It is applicable only to a word chunking strategy.
This value cannot be higher than half the max_chunk_size value.
sentence_overlapnumber · default: 1
The number of overlapping sentences for chunks.
It is applicable only for a sentence chunking strategy.
It can be either 1 or 0.
strategystring · default: sentence
The chunking strategy: sentence or word.
servicestringrequired
The service type
service_settingsobjectrequired
Settings specific to the service
task_settingsobject
Task settings specific to the service and task type