Tool in benchmark · Version 1

Reducto in Converting a complex PDF into clean Markdown with a hosted API

Scenario-level performance from current published Results.

4Passed
6Failed
2No published Result yet

10 of 12 scenarios published

CapabilityScenariosResult
Code Extraction0 pass · 1 fail · 1 of 1 published
Equations & Mathematical Notation0 pass · 1 fail · 1 of 1 published
Figures & Charts0 pass · 2 fail · 2 of 2 published
Heading & Section Structure1 pass · 1 fail · 2 of 2 published
Scanned Document OCR2 pass · 0 fail · 2 of 2 published
Table Extraction1 pass · 0 fail · 1 of 2 published
Text Fidelity0 pass · 1 fail · 1 of 1 published
Reading Order & Layout0 of 1 published
PassedFailedPublished, different test setNo published Result yet

Where Reducto failed

6 of 10 graded scenarios. Open a Result to see the conversation and the evidence.

Code Extraction

A document containing a code block

Reducto did not preserve the code block as fenced or preformatted Markdown. The returned file had no fences or indented code lines, while the source block’s line breaks remained and the output also altered code tokens, including `window = reload_window(reset_at, margin_minutes=45)` becoming `window reload_window (reset_at, margin_minutes=45)`.

View Result →
Equations & Mathematical Notation

A document containing mathematical equations

Reducto failed a document with mathematical equations: the returned Markdown contained no math markup and no fallback, and the equations were flattened into prose with missing symbols and substituted characters. This is the case: the source page shows set mathematics, while the output preserves only garbled lines instead of LaTeX, MathML, or an explicit fallback.

View Result →
Figures & Charts

A document with a data chart

Reducto omitted the data chart’s image and title from the Markdown. A prose description appeared where the chart had been.

View Result →
Figures & Charts

A document with figures and captions

Reducto did not preserve the figure as an image in Markdown. It kept the caption in place but returned neither an embedded image nor an image link.

View Result →
Heading & Section Structure

A document with styled headings and subheadings

Reducto flattened the heading structure in the Markdown output. The file contains one "#", 26 "##" headings, and no deeper levels; the document title is plain paragraph text. The two visible parent/child pairs were emitted as peers, so the nesting expected for styled headings and subheadings was not preserved.

View Result →
Text Fidelity

An ordinary digital text document

Reducto failed this ordinary text document test: the output kept the body text, but it joined the page-1 running header to the next line and created a sentence the source does not contain. The other six page breaks kept furniture in separate blocks, and the complete seven-page PDF was sent on the default parse pipeline.

View Result →

How Reducto performed

Open a capability to explore its scenarios. Each row reports the test set in its published Result.

Code Extraction1 fail
ScenarioPublished outcomesTest coverageResult
A document containing a code block
0 Pass1 Fail0 Not gradable
1 of 1 test case failed
What happened

Reducto did not preserve the code block as fenced or preformatted Markdown. The returned file had no fences or indented code lines, while the source block’s line breaks remained and the output also altered code tokens, including `window = reload_window(reset_at, margin_minutes=45)` becoming `window reload_window (reset_at, margin_minutes=45)`.

1/1 assessed1/1 gradablePublished test setView Result →
Equations & Mathematical Notation1 fail
ScenarioPublished outcomesTest coverageResult
A document containing mathematical equations
0 Pass1 Fail0 Not gradable
1 of 1 test case failed
What happened

Reducto failed a document with mathematical equations: the returned Markdown contained no math markup and no fallback, and the equations were flattened into prose with missing symbols and substituted characters. This is the case: the source page shows set mathematics, while the output preserves only garbled lines instead of LaTeX, MathML, or an explicit fallback.

1/1 assessed1/1 gradablePublished test setView Result →
Figures & Charts2 fail
ScenarioPublished outcomesTest coverageResult
A document with a data chart
0 Pass1 Fail0 Not gradable
1 of 1 test case failed
What happened

Reducto omitted the data chart’s image and title from the Markdown. A prose description appeared where the chart had been.

1/1 assessed1/1 gradablePublished test setView Result →
A document with figures and captions
0 Pass1 Fail0 Not gradable
1 of 1 test case failed
What happened

Reducto did not preserve the figure as an image in Markdown. It kept the caption in place but returned neither an embedded image nor an image link.

1/1 assessed1/1 gradablePublished test setView Result →
Heading & Section Structure1 pass1 fail
ScenarioPublished outcomesTest coverageResult
A document with styled headings and subheadings
0 Pass1 Fail0 Not gradable
1 of 1 test case failed
What happened

Reducto flattened the heading structure in the Markdown output. The file contains one "#", 26 "##" headings, and no deeper levels; the document title is plain paragraph text. The two visible parent/child pairs were emitted as peers, so the nesting expected for styled headings and subheadings was not preserved.

1/1 assessed1/1 gradablePublished test setView Result →
Footnotes at the bottom of the page
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

Reducto passed this footnote-layout case: it kept all thirteen footnotes out of the body flow and attached each to its marker. The returned Markdown matches the API response, and the four page comparison cards show the same result page by page.

1/1 assessed1/1 gradablePublished test setView Result →
Scanned Document OCR2 pass
ScenarioPublished outcomesTest coverageResult
A cleanly scanned document
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

Reducto accurately recovered the visible text from a cleanly scanned document. The scan’s text matched the output field by field, with the handwritten signature left as a <signature> placeholder and only two middle-dot separators dropped from the letterhead and footer lines.

1/1 assessed1/1 gradablePublished test setView Result →
A document mixing digital and scanned pages
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

The mixed PDF’s scanned page was processed rather than skipped. Reducto’s Markdown includes the image-only page 2 with its headers, table, certificate section, and recipient details, matching the digital pages’ presentation in the checked evidence.

1/1 assessed1/1 gradablePublished test setView Result →
Table Extraction1 pass1 no Result yet
ScenarioPublished outcomesTest coverageResult
A simple, clearly formatted table
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

Reducto kept the simple table as a table in Markdown, with the same headers, rows, columns, and values. In the checked run, the table stayed in the right place on page 1, and pages 2 and 3 had no table. The table used HTML table markup rather than pipe syntax.

1/1 assessed1/1 gradablePublished test setView Result →
A table that continues across a page breakNo published result
Text Fidelity1 fail
ScenarioPublished outcomesTest coverageResult
An ordinary digital text document
0 Pass1 Fail0 Not gradable
1 of 1 test case failed
What happened

Reducto failed this ordinary text document test: the output kept the body text, but it joined the page-1 running header to the next line and created a sentence the source does not contain. The other six page breaks kept furniture in separate blocks, and the complete seven-page PDF was sent on the default parse pipeline.

1/1 assessed1/1 gradablePublished test setView Result →
Reading Order & Layout1 no Result yet
ScenarioPublished outcomesTest coverageResult
A page laid out in multiple columnsNo published result

Reading these Results

Published evidence and test coverage answer different questions.

Publication availability

Which scenarios have a Result?

A published Result is public evidence for this tool on one scenario. “No published result” does not say whether testing has taken place.

Test coverage

What does each Result cover?

Assessed includes Pass, Fail and Not gradable. Gradable includes Pass and Fail. Both use the pinned test count in that published Result.

Scenario scope

Out of 12 scenarios

The summary counts each of the 12 scenarios once. A scenario fails when any of its published test cases failed. “No published Result yet” means nothing is public for that scenario; it does not say whether Reducto was tested on it.

Reducto in Converting a complex PDF into clean Markdown with a hosted API | AI Demos