Tool in benchmark · Version 1

Landing AI in Structured Document Extraction

Scenario-level performance from current published Results.

11Passed
3Failed
6No published Result yet

14 of 20 scenarios published

CapabilityScenariosResult
Field Extraction4 pass · 0 fail · 4 of 5 published
Nested & Repeated Fields4 pass · 0 fail · 4 of 4 published
OCR1 pass · 1 fail · 2 of 2 published
Querying1 pass · 2 fail · 3 of 3 published
Source Grounding1 pass · 0 fail · 1 of 2 published
Review and Correction0 of 3 published
Training0 of 1 published
PassedFailedPublished, different test setNo published Result yet

Where Landing AI failed

3 of 14 graded scenarios. Open a Result to see the conversation and the evidence.

OCR

A document mixing digital and scanned pages

Landing AI failed this mixed digital-and-scanned PDF case. All four fields came back, and the scanned-page values were exact, but the total due returned as "#1,246.80" even though the page text and rendering show "£1,246.80"; the run also carried both parse and extract ids.

View Result →
Querying

Aggregate across documents

Landing AI fails to total across uploaded documents. Chat answered with one file’s own amount or refused, and Extract returned each invoice’s own total in the cross-document field instead of one combined sum.

View Result →
Querying

Filter records across documents

Landing AI failed to filter records across extracted documents. Chat refused the request, and the interface only showed one document at a time with no filter or query control; the receipts themselves were extracted correctly, including two above 150 and one below.

View Result →

How Landing AI performed

Open a capability to explore its scenarios. Each row reports the test set in its published Result.

Field Extraction4 pass1 no Result yet
ScenarioPublished outcomesTest coverageResult
The field is absent
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

Landing AI passed this scenario by returning an honest null for the absent field. The metadata showed no source range for that field. The receipt number was returned as RHS-70234, with a source range shown in the metadata.

1/1 assessed1/1 gradablePublished test setView Result →
The same field across layouts
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

Landing AI passed this scenario. It returned the correct owed amount from three documents with different layouts: $90.10 from the receipt, $227.33 from the invoice, and USD 157.50 from the other receipt. The screenshots show each value highlighted in the viewer and the same single String field in the schema.

1/1 assessed1/1 gradablePublished test setView Result →
The value is directly available
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

Landing AI passed this plain-field extraction case. It returned the receipt number as a string, and the source span was highlighted on the page; the input showed one receipt number and no competing same-type value nearby.

1/1 assessed1/1 gradablePublished test setView Result →
The value must be derived
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

Landing AI derived the requested value in this scenario. The invoice shows DISTANCE 450 miles and FUEL RATE £0.18 per mile; the JSON returns fuel_cost as GBP 81.00, and the document text does not contain 81.00. The playground screen shows the same result beside a one-field schema.

1/1 assessed1/1 gradablePublished test setView Result →
The value needs a supplied definitionNo published result
Nested & Repeated Fields4 pass
ScenarioPublished outcomesTest coverageResult
A repeated set of records
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

Landing AI extracted the repeated set of records in this run. The invoice table on page 3 returned three line items with the correct values and pairing; the delivery note says there were three lines and six units, and the schema asked for description and amount only.

1/1 assessed1/1 gradablePublished test setView Result →
The set contains a non-record
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

Landing AI left the non-record out of the extracted set in the tested invoice. The output contained five members, matching the five numbered rows, and it did not include the separate Total row or its 1,982.00 amount. The schema description shown in the capture was neutral.

1/1 assessed1/1 gradablePublished test setView Result →
The set continues across a page break
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

Landing AI kept the repeated set in one array when the data crossed a page break. In the checked case, ten line items appeared in document order with no duplicate at the boundary, and the results panel showed the array opening once and closing once. No other case is reported here.

1/1 assessed1/1 gradablePublished test setView Result →
The set is legitimately empty
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

Landing AI returned an empty set when the document said there were none this period. In the checked PDF page, the source text said no damage or exceptions were reported, and the export showed an empty array. The schema pane showed the field as a required array, and the output did not turn the marker text into a member.

1/1 assessed1/1 gradablePublished test setView Result →
OCR1 pass1 fail
ScenarioPublished outcomesTest coverageResult
A cleanly scanned document
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

Landing AI extracted the same values from a scanned invoice as from its digital original. Eight of nine fields were identical, including three line items; the currency was expressed differently but meant pounds sterling in both.

1/1 assessed1/1 gradablePublished test setView Result →
A document mixing digital and scanned pages
0 Pass1 Fail0 Not gradable
1 of 1 test case failed
What happened

Landing AI failed this mixed digital-and-scanned PDF case. All four fields came back, and the scanned-page values were exact, but the total due returned as "#1,246.80" even though the page text and rendering show "£1,246.80"; the run also carried both parse and extract ids.

1/1 assessed1/1 gradablePublished test setView Result →
Querying1 pass2 fail
ScenarioPublished outcomesTest coverageResult
Aggregate across documents
0 Pass1 Fail0 Not gradable
1 of 1 test case failed
What happened

Landing AI fails to total across uploaded documents. Chat answered with one file’s own amount or refused, and Extract returned each invoice’s own total in the cross-document field instead of one combined sum.

1/1 assessed1/1 gradablePublished test setView Result →
Filter records across documents
0 Pass1 Fail0 Not gradable
1 of 1 test case failed
What happened

Landing AI failed to filter records across extracted documents. Chat refused the request, and the interface only showed one document at a time with no filter or query control; the receipts themselves were extracted correctly, including two above 150 and one below.

1/1 assessed1/1 gradablePublished test setView Result →
The answer was never in the schema
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

Landing AI passed this scenario. It answered the technician question with Renata Kowalski and showed clickable references to the receipt’s page text, while the receipt itself prints that name. Chat is experimental, works on one file at a time, and has no API, so the result is scoped to the web app.

1/1 assessed1/1 gradablePublished test setView Result →
Source Grounding1 pass1 no Result yet
ScenarioPublished outcomesTest coverageResult
The field is absent
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

Landing AI passed this scenario by returning an honest null for the absent field. The metadata showed no source range for that field. The receipt number was returned as RHS-70234, with a source range shown in the metadata.

1/1 assessed1/1 gradablePublished test setView Result →
Trace a value to its locationNo published result
Review and Correction3 no Result yet
ScenarioPublished outcomesTest coverageResult
Correct a field valueNo published result
Corrected data goes downstreamNo published result
Repair a recordNo published result
Training1 no Result yet
ScenarioPublished outcomesTest coverageResult
A field the tool can only get right from examplesNo published result

Reading these Results

Published evidence and test coverage answer different questions.

Publication availability

Which scenarios have a Result?

A published Result is public evidence for this tool on one scenario. “No published result” does not say whether testing has taken place.

Test coverage

What does each Result cover?

Assessed includes Pass, Fail and Not gradable. Gradable includes Pass and Fail. Both use the pinned test count in that published Result.

Scenario scope

Out of 19 scenarios

The summary counts each of the 19 scenarios once. A scenario fails when any of its published test cases failed. “No published Result yet” means nothing is public for that scenario; it does not say whether Landing AI was tested on it.

Landing AI in Structured Document Extraction | AI Demos