All posts

mxbai-rerank-v3.1-listwise

MB
4 min read
mxbai-rerank-v3.1-listwise

mxbai-rerank-v3.1-listwise is now available as the default reranker.

It delivers gpt-5.6-sol-level ranking quality with substantially improved latency over mxbai-rerank-v3-listwise. It is excellent at complex tasks like recency-aware ranking, source-priority resolution, and multi-step composite instructions, compared with leading LLMs and pointwise rerankers.

Quality versus latency on ViDoRe v3: mxbai-rerank-v3.1-listwise reaches gpt-5.6-sol quality at roughly 61 times lower latency, while Cohere and the GPT-5.6 rerankers are slower.

Sampled queries per ViDoRe subset with Mixedbread base search (Wholembed v3) as first stage.

Excellent and fasterLink to section

Unlike pointwise rerankers measuring the relevance of individual documents, our listwise v3 reads the whole candidate set for better reasoning at the cost of higher ranking latency.

Now, by rewriting its underlying inference engine, v3.1 reranks faster across every input size, matching pointwise rerankers. In production, the speedup ranges from ~25% on typical queries to ~54% on long-tail inputs (64–128k tokens).

Median reranking latency by input size: mxbai-rerank-v3.1-listwise is faster than v3 at every input size.

For better threshold cutoffs, we also changed v3.1 to return content-dependent relevance scores instead of a fixed rank-based ladder in v3.

Try it nowLink to section

mxbai-rerank-v3.1-listwise is available today through Mixedbread Search:

from mixedbread import Mixedbread

client = Mixedbread()

results = client.stores.search(
    store_identifiers=["my-store"],
    query="when is my flight to London? The most recent valid booking wins",
    search_options={
      "rerank": {
          "model": "mixedbread-ai/mxbai-rerank-v3.1-listwise",
      }
    },
)