AI Demos Research — the structured-intelligence platform. Every verdict on these pages opens to the execution behind it.
Graded 10 October 2026

Does LiteParse read a multi-column page down each column in turn?

LiteParse failed to keep the page’s text in natural column order. The output kept all source text, but three sentence continuations appeared before the text they completed, with unrelated material between them.

1 of 1 test case failed

Every test case in this scenario has a result.

Pass rate0%0 of 1 gradable
Coverage1 of 1test case with a result
0PassNo test case passed.
1FailMissed at least one thing it was expected to do; the reason and proof are with each test case below.
0Not gradableEvery result here could be graded.
0UntestedEvery test case in this scenario has a result.
The pass rate is a summary. The evidence is the test case below: what we sent, what we checked, what the tool returned, and the proof.

The test case

Each test case is judged on its own: Pass, Fail, Not gradable, or Untested. The scenario result above is based on this test case.

Two-column page — natural reading orderFailEvidence
What we sent

We ran the conversion command on the bulletin PDF in the terminal.

InputDocument (PDF)
Input PDF: three-page two-column bulletin
Open the PDF ↗
What the tool returned
Markdown
Founded 1898

Rooms at half past nine and is back by six. The cost, including the coach and the entry to the harbour office, is fourteen pounds, and members should book with the excursion secretary before 1 June.

## New members and gifts

The Society welcomes seven new members since the autumn bulletin: three from Vardenne, two from Braithe, one from Kellow and one, to the committee's particular pleasure, from Winnipeg. The library has received the bound volumes of the Braithe Advertiser for 1928 to 1934 from the estate of the late Mr E. Lissamer, and an album of photographs of the 1947 regatta from Mrs Prosser of Thrimby. Both have been accessioned and may be consulted on the usual notice.

## The Harrowby field books

The eleven field books kept by Thomas Harrowby between 1871 and 1904 came to the Society in October, the gift of his great-granddaughter, and are now with the county record office for conservation. They are working notebooks rather than journals: tide times, wind, the state of the banks at Thrimby, the names of the men who worked each reach, and here and there a sketch of a channel that has since moved half a mile. The eighth book, which covers the winter of 1889, is the one most often asked for, because it records the breach at Kellow in some detail and gives the height of the water against the wall of the old lifeboat house. The Society hopes to publish a transcript of the eighth book, and would welcome help with it. What is wanted is not palaeography - the hand is a clear one - but local knowledge: field names, the older names for the reaches, and the identification of men named only by a surname and an initial. Members who could give an evening a month to this should write to the archivist.

## The summer excursion

The summer excursion will be to Marnhead on Saturday 20 June, to see the salt pans and what is left of the tramway on the north side of the harbour. Mr Tarbert has agreed to lead the walk, which is about three miles over rough ground and is not suitable for anyone who cannot manage a stile. The coach leaves the Assembly

Markdown output: three out-of-order continuations

Copied from Output file (Markdown), lines 13–27

Open the Markdown file ↗
Markdown
the argument are worth reading. The board's engineer wanted a channel of fourteen feet and got eleven; the fishermen wanted the bar left alone and were not consulted until the decision had been taken; and the compromise was arrived at in a meeting of which no minutes were kept at all. The channel silted again within four years. The Society holds copies of the engineer's two reports and of the petition against them, which carries a hundred and ninety-one signatures and is the best list we have of the men working out of Vardenne in that year. Members are welcome to consult it, and a transcript of the signatures is being prepared.

## Mr E. Lissamer

Members will be sorry to learn of the death in November of Mr Edward Lissamer, who joined the Society in 1974 and served on the committee for eleven years, five of them as honorary treasurer. He was a patient and exact man who kept the accounts in a hand nobody could misread, and he had a memory for the estuary's boats that the Society will not replace. His library has come to us under his will and will be listed in the next bulletin.

## Visits and walks

Four walks are arranged for the summer, each of about two hours and none of them strenuous. On 6 June, the Vardenne quays with Mr Tarbert; on 4 July, the training wall and the east bank, tide permitting, with Miss Sandiman; on 1 August, the Kellow marshes, led jointly with the county wildlife trust; and on 5 September, the town's chapels. All start at half past ten from the Assembly Rooms unless the programme card says otherwise. Members are asked to book for the marshes walk, which is limited to twenty and needs boots. The others need no booking and no charge is made, though the collection at the end goes to the room fund.

Copies can be supplied to members for a charge covering the print and the postage. The Society does not hold the copyright in every image and will say so where that is the case; where the photographer is unknown, prints are supplied on the usual undertaking.

## The estuary in 1926

A hundred years ago this spring the harbour board was deciding whether to dredge the bar, and the papers of

Copied from Output file (Markdown), lines 55–69

Markdown
## Wanted: the Vardenne ferry

The Society is trying to establish when the Vardenne ferry stopped running. The date usually given is 1961, which is the year the ferry office was pulled down, but the office may well have stood empty for some time before that. A member recalls being taken across as a child in the summer of 1958 and is sure the boat was still working then; another remembers it ending just after the war. A timetable, a ticket, or a photograph with a date on the back would settle it. The same member has given the Society a copy of the 1957 timetable for the Marnhead bus, which connected with the ferry and may therefore date its last summer more exactly than anything else we hold. It is on the notice board at the Assembly Rooms for anyone who wants to look at it.

asked to check their entries before then. The Society is grateful to the trustees of two of the chapels for access to their records, and to the county archivist for the loan of a plan that had been catalogued under the wrong parish for sixty years.

## Membership

Membership stood at two hundred and six at the end of January, four more than a year ago and the first increase since 2019. Twenty-two members live outside the county and six outside the country; the Society posts the bulletin to all of them and would rather do that than lose them. Anyone who would prefer it by e-mail should tell the secretary, who keeps a list and is happy for it to grow.

## Notices

The Society's thanks go to the members who helped at the December sale, which raised a hundred and twelve pounds for the room fund, and to Mrs Tarbert for the loan of the tables. The room fund stood at three hundred and eighty pounds at the end of January. The committee thanks the members who have given to it, and reminds everyone that the fund exists to keep the Assembly Rooms available to the Society rather than to accumulate. Copy for the summer bulletin should reach the editor by 15 May. Short notes are as welcome as articles, and a query that has been in the back of a member's mind for years is often the most useful thing in an issue.

## The chapels survey

The survey of the town's chapels, begun in 2019 and interrupted twice, is now complete for the four buildings still standing and for two of the three that are not. What remains is the Bethel on Kellow Lane, of which no plan and only one photograph have been found. The survey will be printed as an occasional paper in the autumn, and the members who took part are

Copied from Output file (Markdown), lines 87–103

Expected vs. Found
✗Expected: Text follows the page’s natural reading order without mixing the columns.Found: Three spanning sentences were emitted out of order: each continuation appeared earlier than the text it continued, with unrelated material between.
Supporting proof
Proof 1Screenshot
Terminal capture: conversion command and summary
Open original ↗
Why this result

The page was supposed to come out in natural reading order. In the Markdown, each of the three column-spanning sentences had its continuation placed earlier than the fragment it completed, with other text in between, so the output did not preserve reading order.

Also observed in this test case

Text retained. The output kept the source text; the problem was the order of the column-spanning passages.

Tested by Vamshidhar Rao Thumula · evidence dated 9 September 2026

Configuration and setup

How this tool was set up for the run and what the test needed in place. Each row is a fact from the run's records; a fact the records do not hold is left out, not guessed.

Software that produced the output
LiteParse
Build or version
LiteParse 2.14.4
Surface
SDK / library
Set up before the run
A short PDF with two clear text columns had to be converted to Markdown in one default-pipeline pass, using the full PDF rather than a cropped page.
Output format
markdown
Tesseract data path
/usr/share/tesseract-ocr/5/tessdata
Tested
9 September 2026 · Vamshidhar Rao Thumula

How this scenario is graded

How we decide Pass, Fail and Not gradable. The same rules apply to every tool tested on this scenario.

How results are decided

Each test case gets one result per tool: Pass, Fail or Not gradable. A test case we haven't run yet shows Untested. There are no partial results.

The rules
  • Pass: the tool did everything the test expected, and nothing it said contradicts the correct answer.
  • Fail: at least one expected behaviour clearly didn't happen; the test case's result says which one and quotes the tool.
  • Not gradable: our evidence couldn't settle the outcome (for example a record we needed is missing). It is never counted as a fail, and the test case's result says what's missing.

Where this sits in the benchmark

This page is one cell of a larger study: one tool, one scenario. Only this benchmark's frame appears here.

History of this result

What has happened to this result since it was first published. Runs and grades are never overwritten: a retest or a re-grade publishes a new result and keeps the earlier one readable.

from the publication record
5 November 2026First publishedConverting a complex PDF into clean Markdown with an open-source library v1

Act on this result

Nothing filed here edits the run or the grade. A challenge opens a review, and a review can produce a new run or a re-grade — which becomes the current result and leaves this one in the history.

This matches what I see

You run the same kind of test against your own setup and get the same behaviour.

Agree →
This does not match

Yours behaves differently. Tell us what you got, with a screenshot if you have one.

Disagree →
Point out an issue

Something here is wrong — a reference value, a transcription, a grade.

Report an issue →
Request a retest

On a newer build, a larger dataset, or your own setup.

Request a retest →
We have fixed this

Tell us what changed and we schedule a rerun of the failing test case. The old result stays as history.

Vendor notice →
Filed against this evidenceNothing yet. Challenges, counter-evidence and fix notices appear here with their outcome, and stay on the page after they are resolved.
Cite this result
aidemos.com/benchmarks/pdf-to-markdown-open-source/results/liteparse/a-page-laid-out-in-multiple-columns · 0 pass · 1 fail · coverage 1/1 · graded 2026-10-10

The same record is available as structured data through the AI Demos MCP server, with the counts, the coverage and every per-test-case reason carried as fields.

Verify the proof files

These files support this result. Open a file to inspect the original evidence.

Input · Document (PDF) ↗application/pdf · 143 KB
Output file (Markdown) ↗text/markdown · 12 KB
Proof 1 · Screenshot ↗image/png · 25 KB
File fingerprints (SHA-256)

A fingerprint identifies the exact file used for this result.

Input · Document (PDF)4c7e1f83e8fd4525a7a1c935526668f603a51bacf08202074cfa68c76f4afa69
Output file (Markdown)390fa4d335fc3f532f443703d64f78c96fe3cbbd8161649413c4b2edcd8f0243
Proof 1 · Screenshot39ce43655b239d841f3179bec6d8d0faec5ad2ecdf074dfc2805b295b030883a