Tool in benchmark · Version 1

doc2mark in Converting a complex PDF into clean Markdown with an open-source library

Scenario-level performance from current published Results.

3Passed
2Failed
7No published Result yet

5 of 12 scenarios published

CapabilityScenariosResult
Code Extraction0 pass · 1 fail · 1 of 1 published
Equations & Mathematical Notation0 pass · 1 fail · 1 of 1 published
Heading & Section Structure1 pass · 0 fail · 1 of 2 published
Reading Order & Layout1 pass · 0 fail · 1 of 1 published
Table Extraction1 pass · 0 fail · 1 of 2 published
Figures & Charts0 of 2 published
Scanned Document OCR0 of 2 published
Text Fidelity0 of 1 published
PassedFailedPublished, different test setNo published Result yet

Where doc2mark failed

2 of 5 graded scenarios. Open a Result to see the conversation and the evidence.

Code Extraction

A document containing a code block

doc2mark did not preserve the code block’s formatting in Markdown. The function’s lines stayed in order, but their indentation disappeared and no code fence was added.

View Result →
Equations & Mathematical Notation

A document containing mathematical equations

doc2mark broke every display equation in the technical note into scrambled fragments, several emitted as headings, with stray markers and terms out of order. In their place it produced no LaTeX or MathML and no image or marker saying the math was not converted.

View Result →

How doc2mark performed

Open a capability to explore its scenarios. Each row reports the test set in its published Result.

Code Extraction1 fail
ScenarioPublished outcomesTest coverageResult
A document containing a code block
0 Pass1 Fail0 Not gradable
1 of 1 test case failed
What happened

doc2mark did not preserve the code block’s formatting in Markdown. The function’s lines stayed in order, but their indentation disappeared and no code fence was added.

1/1 assessed1/1 gradablePublished test setView Result →
Equations & Mathematical Notation1 fail
ScenarioPublished outcomesTest coverageResult
A document containing mathematical equations
0 Pass1 Fail0 Not gradable
1 of 1 test case failed
What happened

doc2mark broke every display equation in the technical note into scrambled fragments, several emitted as headings, with stray markers and terms out of order. In their place it produced no LaTeX or MathML and no image or marker saying the math was not converted.

1/1 assessed1/1 gradablePublished test setView Result →
Heading & Section Structure1 pass1 no Result yet
ScenarioPublished outcomesTest coverageResult
A document with styled headings and subheadings
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

doc2mark converted all 26 styled headings into Markdown headings while preserving their hierarchy. Three source heading sizes became three distinct, consistent heading levels.

1/1 assessed1/1 gradablePublished test setView Result →
Footnotes at the bottom of the pageNo published result
Reading Order & Layout1 pass
ScenarioPublished outcomesTest coverageResult
A page laid out in multiple columns
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

doc2mark converted the two-column PDF to Markdown without mixing text from different columns. On all three pages, it read the left column before the right, keeping sentences that crossed the column break in sequence.

1/1 assessed1/1 gradablePublished test setView Result →
Table Extraction1 pass1 no Result yet
ScenarioPublished outcomesTest coverageResult
A simple, clearly formatted table
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

doc2mark preserved the simple table in Markdown, keeping every value under the right header. The output retained the source’s four headers and eight data rows.

1/1 assessed1/1 gradablePublished test setView Result →
A table that continues across a page breakNo published result
Figures & Charts2 no Result yet
ScenarioPublished outcomesTest coverageResult
A document with a data chartNo published result
A document with figures and captionsNo published result
Scanned Document OCR2 no Result yet
ScenarioPublished outcomesTest coverageResult
A cleanly scanned documentNo published result
A document mixing digital and scanned pagesNo published result
Text Fidelity1 no Result yet
ScenarioPublished outcomesTest coverageResult
An ordinary digital text documentNo published result

Reading these Results

Published evidence and test coverage answer different questions.

Publication availability

Which scenarios have a Result?

A published Result is public evidence for this tool on one scenario. “No published result” does not say whether testing has taken place.

Test coverage

What does each Result cover?

Assessed includes Pass, Fail and Not gradable. Gradable includes Pass and Fail. Both use the pinned test count in that published Result.

Scenario scope

Out of 12 scenarios

The summary counts each of the 12 scenarios once. A scenario fails when any of its published test cases failed. “No published Result yet” means nothing is public for that scenario; it does not say whether doc2mark was tested on it.

doc2mark in Converting a complex PDF into clean Markdown with an open-source library | AI Demos