Neither endpoint routes. A vector index is only comparable to vectors from the model that built it, and a relevance score means something only against other scores from the same model, so nothing here chooses a model on evidence.
What a request may name is the routing policy's pool, the same pool chat models live in. Name a model the pool holds, or send auto and get the first model of that type in the pool's order. The model that served is in the response.
Embeddings
| Method and path | POST /embeddings |
| Purpose | Embeddings from the served embedding catalog, OpenAI shape. |
| Authentication | API key or session |
| Limits | input is a string or a list of up to 512 strings. Billed on input tokens. |
Request
| Field | Meaning |
|---|---|
model | An embedding model the policy's pool holds, or auto for the first one in it. Required. |
input | A string or a list of strings. |
encoding_format | float or base64. |
dimensions, user | Forwarded when set. |
input_type, task, task_type, title, output_dimension, embedding_types, normalized, truncate | Provider-specific parameters that are part of an embedding's identity, forwarded untouched for the provider to accept or reject. |
A misspelled field is a 422, as on chat completions.
Example
curl https://api.inferbase.ai/api/v1/inference/embeddings \
-H "Authorization: Bearer inf_your_api_key" \
-H "Content-Type: application/json" \
-d '{
"model": "Qwen/Qwen3-Embedding-4B",
"input": ["first text to embed", "second text to embed"]
}'Response
The OpenAI shape: data carries one embedding per input, in input order, and usage carries input tokens. The response adds served_by: the provider, the route, and whether the policy pinned the provider or the call fell back to another. Tag an index with it, because the same model on another host is not the same embedding space.
Policy
The pool decides. A model outside it is refused with 403, and auto on a pool holding no embedding model is refused the same way, naming the pool. When a model is served by more than one host, the cheapest route wins and a substitute has to be the same model and the same variant; a different quantisation is a different embedding space.
Rerank
| Method and path | POST /rerank |
| Purpose | Score documents against a query, best first, from the served rerank catalog. Cohere shape. |
| Authentication | API key or session |
| Limits | Up to 1,000 documents per call. Billed on input tokens. |
The request and response follow Cohere's shape, because OpenAI defines no rerank endpoint and Cohere's is what the hosts that serve this surface mirror. Errors stay in the Inferbase envelope.
Request
| Field | Meaning |
|---|---|
model | A rerank model id from GET /models. Required. |
query | The query string. |
documents | Up to 1,000 strings. |
top_n | Keep only the best N. |
return_documents | Echo each document's text beside its score. |
Example
curl https://api.inferbase.ai/api/v1/inference/rerank \
-H "Authorization: Bearer inf_your_api_key" \
-H "Content-Type: application/json" \
-d '{
"model": "Qwen/Qwen3-Reranker-4B",
"query": "What is the capital of France?",
"documents": [
"Paris is the capital of France.",
"Bananas are yellow.",
"Berlin is the capital of Germany."
],
"top_n": 2
}'Response
results comes back ranked. Each row carries index, into the documents you sent, and relevance_score. served_by says which provider and route scored them.
Two things to know before comparing scores. Hosts disagree about the scale even when they agree about the order, so a threshold tuned on one host is not portable to another. And not every host meters this surface; where the provider reports no token count, Inferbase bills its own estimate of what the model read, the query once per document plus the documents.
Policy
The pool decides, exactly as it does for embeddings: a model outside it is refused, and auto takes the first rerank model in it. Scores differ between hosts of one model even when the ordering agrees, so a caller comparing scores across calls should name the model rather than reorder the pool.
Errors
A chat model on either endpoint, or an embedding model on the other, is a 404. A pinned provider that is down with fallback refused is a 503. See Errors.
Last updated September 10, 2026.