Tool in benchmark · Version 1

Reducto in Converting a complex PDF into clean Markdown with a hosted API

Scenario-level performance from current published Results.

3Passed
3Failed
6No published Result yet

6 of 12 scenarios published

CapabilityScenariosResult
Code Extraction0 pass · 1 fail · 1 of 1 published
Equations & Mathematical Notation0 pass · 1 fail · 1 of 1 published
Heading & Section Structure0 pass · 1 fail · 1 of 2 published
Scanned Document OCR2 pass · 0 fail · 2 of 2 published
Table Extraction1 pass · 0 fail · 1 of 2 published
Figures & Charts0 of 2 published
Reading Order & Layout0 of 1 published
Text Fidelity0 of 1 published
PassedFailedPublished, different test setNo published Result yet

Where Reducto failed

3 of 6 graded scenarios. Open a Result to see the conversation and the evidence.

Code Extraction

A document containing a code block

Reducto did not preserve the code block as fenced or preformatted Markdown. The returned file had no fences or indented code lines, while the source block’s line breaks remained and the output also altered code tokens, including `window = reload_window(reset_at, margin_minutes=45)` becoming `window reload_window (reset_at, margin_minutes=45)`.

View Result →
Equations & Mathematical Notation

A document containing mathematical equations

Reducto failed a document with mathematical equations: the returned Markdown contained no math markup and no fallback, and the equations were flattened into prose with missing symbols and substituted characters. This is the case: the source page shows set mathematics, while the output preserves only garbled lines instead of LaTeX, MathML, or an explicit fallback.

View Result →
Heading & Section Structure

A document with styled headings and subheadings

Reducto flattened the heading structure in the Markdown output. The file contains one "#", 26 "##" headings, and no deeper levels; the document title is plain paragraph text. The two visible parent/child pairs were emitted as peers, so the nesting expected for styled headings and subheadings was not preserved.

View Result →

How Reducto performed

Open a capability to explore its scenarios. Each row reports the test set in its published Result.

Code Extraction1 fail
ScenarioPublished outcomesTest coverageResult
A document containing a code block
0 Pass1 Fail0 Not gradable
1 of 1 test case failed
What happened

Reducto did not preserve the code block as fenced or preformatted Markdown. The returned file had no fences or indented code lines, while the source block’s line breaks remained and the output also altered code tokens, including `window = reload_window(reset_at, margin_minutes=45)` becoming `window reload_window (reset_at, margin_minutes=45)`.

1/1 assessed1/1 gradablePublished test setView Result →
Equations & Mathematical Notation1 fail
ScenarioPublished outcomesTest coverageResult
A document containing mathematical equations
0 Pass1 Fail0 Not gradable
1 of 1 test case failed
What happened

Reducto failed a document with mathematical equations: the returned Markdown contained no math markup and no fallback, and the equations were flattened into prose with missing symbols and substituted characters. This is the case: the source page shows set mathematics, while the output preserves only garbled lines instead of LaTeX, MathML, or an explicit fallback.

1/1 assessed1/1 gradablePublished test setView Result →
Heading & Section Structure1 fail1 no Result yet
ScenarioPublished outcomesTest coverageResult
A document with styled headings and subheadings
0 Pass1 Fail0 Not gradable
1 of 1 test case failed
What happened

Reducto flattened the heading structure in the Markdown output. The file contains one "#", 26 "##" headings, and no deeper levels; the document title is plain paragraph text. The two visible parent/child pairs were emitted as peers, so the nesting expected for styled headings and subheadings was not preserved.

1/1 assessed1/1 gradablePublished test setView Result →
Footnotes at the bottom of the pageNo published result
Scanned Document OCR2 pass
ScenarioPublished outcomesTest coverageResult
A cleanly scanned document
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

Reducto accurately recovered the visible text from a cleanly scanned document. The scan’s text matched the output field by field, with the handwritten signature left as a <signature> placeholder and only two middle-dot separators dropped from the letterhead and footer lines.

1/1 assessed1/1 gradablePublished test setView Result →
A document mixing digital and scanned pages
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

The mixed PDF’s scanned page was processed rather than skipped. Reducto’s Markdown includes the image-only page 2 with its headers, table, certificate section, and recipient details, matching the digital pages’ presentation in the checked evidence.

1/1 assessed1/1 gradablePublished test setView Result →
Table Extraction1 pass1 no Result yet
ScenarioPublished outcomesTest coverageResult
A simple, clearly formatted table
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

Reducto kept the simple table as a table in Markdown, with the same headers, rows, columns, and values. In the checked run, the table stayed in the right place on page 1, and pages 2 and 3 had no table. The table used HTML table markup rather than pipe syntax.

1/1 assessed1/1 gradablePublished test setView Result →
A table that continues across a page breakNo published result
Figures & Charts2 no Result yet
ScenarioPublished outcomesTest coverageResult
A document with a data chartNo published result
A document with figures and captionsNo published result
Reading Order & Layout1 no Result yet
ScenarioPublished outcomesTest coverageResult
A page laid out in multiple columnsNo published result
Text Fidelity1 no Result yet
ScenarioPublished outcomesTest coverageResult
An ordinary digital text documentNo published result

Reading these Results

Published evidence and test coverage answer different questions.

Publication availability

Which scenarios have a Result?

A published Result is public evidence for this tool on one scenario. “No published result” does not say whether testing has taken place.

Test coverage

What does each Result cover?

Assessed includes Pass, Fail and Not gradable. Gradable includes Pass and Fail. Both use the pinned test count in that published Result.

Scenario scope

Out of 12 scenarios

The summary counts each of the 12 scenarios once. A scenario fails when any of its published test cases failed. “No published Result yet” means nothing is public for that scenario; it does not say whether Reducto was tested on it.

Reducto in Converting a complex PDF into clean Markdown with a hosted API | AI Demos