Skip to content
Artificial intelligence. Clearly. RSS feed
AI NEWS AI

News. Evidence. Perspective.

ResearchAnalysis

MIRROR tested source-linked AI data capture in 113 breast-cancer trial records

A retrospective study at one Spanish hospital compared AI extraction with manually completed trial forms for 113 patients across 11 trials. The report describes strong performance in most data domains, with unstructured records still needing improvement.

The MIRROR study compared automated extraction from hospital records with manually completed clinical-trial forms for 113 breast-cancer patients across 11 trials at one hospital in Seville. Each extracted variable retained a link to its source text. The authors report strong performance across most data domains and identify unstructured extraction as an area for improvement.[1]

The facts

MIRROR study design

MIRROR study design
MeasureValueContext
Patients113Breast-cancer patients participating in clinical trials.Source 1
Trials represented11Multiple protocols but one hospital site.Source 1
Clinical settingVirgen del Rocío University HospitalSeville, Spain.Source 1
ComparisonAutomated EHR extraction versus manual eCRF captureThe manual trial record served as the comparison dataset.Source 1
Evidence linkOriginal source text attached to each variableDesigned to make verification faster and more direct.Source 1

The result is field-specific, not one universal accuracy score

The accessible article abstract reports accuracy, precision, recall and F1 qualitatively but does not give the domain-by-domain figures needed to compare fields. This account therefore does not assign MIRROR a single accuracy percentage. The sample size and traceability design are clear; the size of the performance differences between variables is not established here.[1]

Why the source passage matters

Consider this invented note: “Previous anaemia; haemoglobin 10.2 g/dL on 12 June; repeat test pending.” A useful extraction preserves the result, unit and date, and lets a reviewer see the original wording. Recording only “anaemia” loses whether the note concerns a past condition, a current measurement or an unresolved follow-up.

At a glance

Illustrative extraction from that note

Illustrative extraction from that note
FieldProposed valueEvidence retained
Haemoglobin10.2 g/dLNumeric result and unit in the note
Measurement date12 June; year not statedDo not supply a year without another source
Repeat testPendingNo new test result inferred

The paper identifies eCRF standardisation across sites as a future priority. If every sponsor or hospital asks for the same concept in a different format, the extraction system must repeatedly translate definitions. Standard fields and controlled terminology would reduce mapping work and make performance comparable between institutions.[1]

This was a retrospective data-capture comparison, not a prospective test of patient treatment or autonomous trial management. The next operational question is how much reviewer time source-linked extraction saves after corrections are included, and whether that benefit survives different hospitals and trial forms.

Follow the evidence

Sources & further reading