Datalab in Structured Document Extraction
Scenario-level performance from current published Results.
6 of 20 scenarios published
Datalab passed every graded scenario it has a published Result for.
How Datalab performed
Open a capability to explore its scenarios. Each row reports the test set in its published Result.
Field Extraction2 pass3 no Result yet
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| The same field across layouts | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedDatalab returned the correct identifier, subtotal, tax and total due from all three differently laid-out receipts, with the same four-field schema. That included a receipt whose number was relabelled as a work order number and moved to a top-left box, returned as GLR-98213 with $227.33 due, and a single-column receipt with USD amounts, returned as SPD-2026-0714 with USD 157.50 due, each equal to the printed value. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| The value must be derived | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedDatalab calculated a fuel cost that was not printed in the invoice. It returned £81.00 from 450 miles at £0.18 per mile, the exact result of multiplying the two values. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| The field is absent | No published result | ||
| The value is directly available | No published result | ||
| The value needs a supplied definition | No published result | ||
Nested & Repeated Fields2 pass2 no Result yet
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| A repeated set of records | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedDatalab extracted the repeated set without mixing values between items. All three invoice items were returned, with nothing dropped or duplicated. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| The set continues across a page break | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedDatalab returned the invoice's ten line items as one list, six from the first page and four from the second, with every description, quantity, unit price and amount as printed and no item repeated at the page break. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| The set contains a non-record | No published result | ||
| The set is legitimately empty | No published result | ||
OCR2 pass
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| A cleanly scanned document | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedDatalab extracted accurate invoice values from the image-only scan. The scan and digital original both returned the source invoice's £1,754.40 total due and the same three line items. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| A document mixing digital and scanned pages | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedDatalab returned all five requested values from the three-page invoice, including the vehicle registration and the recipient's name that appear only on its scanned page. Each value matched the document and was cited to the page it sits on, and the total due kept its pound sign. | 1/1 assessed1/1 gradablePublished test set | View Result → |
Querying3 no Result yet
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| Aggregate across documents | No published result | ||
| Filter records across documents | No published result | ||
| The answer was never in the schema | No published result | ||
Review and Correction3 no Result yet
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| Correct a field value | No published result | ||
| Corrected data goes downstream | No published result | ||
| Repair a record | No published result | ||
Source Grounding2 no Result yet
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| The field is absent | No published result | ||
| Trace a value to its location | No published result | ||
Training1 no Result yet
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| A field the tool can only get right from examples | No published result | ||
Reading these Results
Published evidence and test coverage answer different questions.
Which scenarios have a Result?
A published Result is public evidence for this tool on one scenario. “No published result” does not say whether testing has taken place.
What does each Result cover?
Assessed includes Pass, Fail and Not gradable. Gradable includes Pass and Fail. Both use the pinned test count in that published Result.
Out of 19 scenarios
The summary counts each of the 19 scenarios once. A scenario fails when any of its published test cases failed. “No published Result yet” means nothing is public for that scenario; it does not say whether Datalab was tested on it.