Capability in benchmark · Version 1

Retrieval

The passage that answers the question comes back from the documents when it exists, and a missing answer is discoverable when it does not.

4 scenarios · 14 current published Results · 6 tools with published Results

How the tools performed

Explore current published Results across this capability’s scenarios. Open a scenario to compare its tools, or a Result to inspect the evidence.

Each cell reports its own published test set. There is no combined capability score or claim that different Results used identical tests.

Scenarios in this capability
Tools with published Results appear first, alphabetically. Remaining participants stay visible below.
Participating toolAnswer is available in the knowledge base →Answer is not available in the knowledge base →The request uses different wording than the source →Retrieval is scoped to part of the documents →
Denser AIAnswer is available in the knowledge base →
1 Pass
1/1 assessed1/1 gradableView Result →
Answer is not available in the knowledge base →No published resultThe request uses different wording than the source →
1 Pass
1/1 assessed1/1 gradableView Result →
Retrieval is scoped to part of the documents →No published result
DifyAnswer is available in the knowledge base →
1 Pass
1/1 assessed1/1 gradableView Result →
Answer is not available in the knowledge base →No published resultThe request uses different wording than the source →
1 Pass
1/1 assessed1/1 gradableView Result →
Retrieval is scoped to part of the documents →No published result
FutureSmart Document IntelligenceAnswer is available in the knowledge base →
1 Pass
1/1 assessed1/1 gradableView Result →
Answer is not available in the knowledge base →
1 Fail
1/1 assessed1/1 gradableView Result →
The request uses different wording than the source →
1 Pass
1/1 assessed1/1 gradableView Result →
Retrieval is scoped to part of the documents →
1 Fail
1/1 assessed1/1 gradableView Result →
RAGFlowAnswer is available in the knowledge base →
1 Pass
1/1 assessed1/1 gradableView Result →
Answer is not available in the knowledge base →
1 Pass
1/1 assessed1/1 gradableView Result →
The request uses different wording than the source →
1 Pass
1/1 assessed1/1 gradableView Result →
Retrieval is scoped to part of the documents →No published result
VectaraAnswer is available in the knowledge base →
1 Pass
1/1 assessed1/1 gradableView Result →
Answer is not available in the knowledge base →No published resultThe request uses different wording than the source →
1 Pass
1/1 assessed1/1 gradableView Result →
Retrieval is scoped to part of the documents →No published result
Vectorize.ioAnswer is available in the knowledge base →
1 Pass
1/1 assessed1/1 gradableView Result →
Answer is not available in the knowledge base →No published resultThe request uses different wording than the source →No published resultRetrieval is scoped to part of the documents →No published result
Llama CloudNo published result across these scenarios
OnyxNo published result across these scenarios

Reading the comparison

Publication availability and test coverage describe different things.

Published evidence

Publication is not testing progress

“No published result” says only that there is no current public Result. It does not indicate whether a tool has been tested, passed, failed or is applicable.

Test coverage

Read each Result’s test set

Assessed includes Pass, Fail and Not gradable. Gradable includes Pass and Fail. Each fraction uses the pinned tests in that same published Result.

Go deeper

Choose the view you need

A scenario compares tools on one situation. A tool page follows one tool across this benchmark. A Result explains the outcome and shows the evidence.

Retrieval in Managed RAG | AI Demos