Skip to content
Artificial intelligence. Clearly. RSS feed
AI NEWS AI

News. Evidence. Perspective.

ResearchExplainer

A language model turned health records into narratives and predicted mortality across 770,439 adults

LLM-MMS converted harmonised diagnoses, measurements and behaviours into standardised health narratives without fine-tuning. Across nine international cohorts it outperformed recalibrated comorbidity indices, but the result is prognostic risk stratification—not a diagnosis or a ready-made clinical deployment.

A fixed comorbidity index works like a scorecard: count selected diseases, apply predetermined weights and add the result. That is useful when the population resembles the one used to build the index. It can fail when age, disease patterns and available measurements change. Researchers have tested a different approach across 770,439 adults in nine international cohorts: convert harmonised health data into standardised narratives, then ask a language model to derive a multidimensional multimorbidity phenotype.[1][2]

The system, called LLM-MMS, was evaluated for all-cause mortality. It was not fine-tuned on each cohort. Across eight external cohorts, its C-index ranged from 0.67 to 0.86 and exceeded recalibrated conventional comorbidity indices by 0.12 to 0.21. Observed-to-expected ratios remained close to 1, indicating that predicted average risk was broadly aligned with observed outcomes in the reported tests.[1][2]

The narrative is a representation layer

The input begins as structured information: demographics, lifestyle, examinations, biomarkers and medical history. A controlled mapping converts those fields into standardised English clinical reports, with safeguards intended to prevent the model from inventing facts. The language model then produces features such as overall biological age, organ-system ages, frailty age and health gradings. Those outputs feed the final survival model.[1][3]

In detail

Three different ways to turn multimorbidity into risk

Three different ways to turn multimorbidity into risk
ApproachWhat it representsMain weakness
Traditional comorbidity indexA fixed list of diagnoses with fixed weightsWeights and disease lists can travel poorly across populations.Source 1
Conventional machine learning on raw fieldsPatterns in the original structured variablesCan capture nonlinearity but may not create an interpretable cross-domain phenotype.Source 1
LLM-MMSA standardised narrative transformed into biological-age and health-domain featuresDepends on prompt, model version, language mapping and governance of generated representations.Source 1Source 3

How to read the performance numbers

By the numbers

Reported validation results

Reported validation results
MeasureValueContext
Participants770,439 adultsNine longitudinal cohorts spanning several countries and age profiles.Source 1Source 2
External discriminationC-index 0.67–0.86A higher value means better ordering of people who experience the outcome earlier versus later.Source 1Source 2
Gain over conventional indices0.12–0.21 C-index pointsReported after conventional comparators were recalibrated in each cohort.Source 1
CalibrationObserved-to-expected ratios near 1.00Average predicted and observed mortality were close in the reported validation.Source 1Source 2
Fine-tuningNone for the cohort narrativesThe method used prompt-based inference rather than model retraining for each population.Source 1Source 3

A C-index is a ranking measure. If two people can be ordered by who experiences death earlier during follow-up, the model receives credit when its risk ordering agrees. A value of 0.81 does not mean an individual has an 81% chance of receiving a correct forecast. Calibration answers another question: whether predicted probabilities match the event rate. A useful risk model needs both ranking and calibration, then prospective evidence that acting on it improves care.[1]

The model is broader than a diagnosis count

LLM-MMS incorporates behaviour, physiology, laboratory values and functional information alongside diagnoses. That breadth may explain why it predicts mortality better than a fixed disease count. It also changes what the score is. It is closer to a general prognostic health phenotype than a pure measure of multimorbidity, so it may not be suitable for every task that currently uses a comorbidity index, such as administrative risk adjustment.[1]

The scale and cross-cohort performance make the study important. The deployment question is harder. The work is anchored in standardised English narratives and a particular model pipeline; real health systems contain missing data, changing coding practices, multilingual records and decisions with unequal consequences. LLM-MMS shows that language models can be used as representation engines for population risk. It does not yet show that a hospital should use the score to make an individual treatment decision.[1][2]

Follow the evidence

Sources & further reading