Cardiovascular

Development and internal validation of a parsimonious model for neurological deterioration at 48 h after endovascular thrombectomy.

TL;DR

A five-predictor model using routine admission measurements (NIHSS, age, glucose, white blood cell count, ln triglyceride) to predict neurological deterioration at 48 h after thrombectomy showed limited discrimination, marginal gains in probability accuracy, and uncertain incremental value over an NIHSS-only model, so it should be regarded as exploratory rather than clinically implementable.

Key Findings

About one in four patients in the primary cohort had neurological deterioration at 48 h (END48) after endovascular thrombectomy.

  • The registry from 2020-2022 contained 253 records representing 251 unique patients.
  • 214 adults entered the conservative primary cohort, which excluded an unresolved longitudinal data segment.
  • 51 patients (23.8%) had END48, defined as an NIHSS increase of at least 4 points from admission to the fixed 48-h postoperative assessment.

The five-predictor model had limited discrimination after correction for optimism.

  • The model included admission NIHSS, age, glucose, white blood cell count, and ln triglyceride value.
  • Apparent AUC was 0.651; optimism-corrected AUC was 0.601 (0.511 to 0.723).
  • Internal validation used 1,000 bootstrap samples.

The incremental discrimination of the five-predictor model over an NIHSS-only model was uncertain.

  • The corrected AUC difference versus the NIHSS-only model was 0.038 (-0.025 to 0.171).
  • The confidence interval includes zero.
  • Paired nested intervals used 1,000 outer × 100 inner samples.

Improvement in probability accuracy over a prevalence-only reference was marginal.

  • The corrected Brier score was 0.180 versus 0.182 for the prevalence-only reference.
  • This gave a Brier skill score of 0.9%.

The model showed overfitting in calibration, with a corrected slope below 1.

  • The corrected primary calibration slope was 0.731 (0.519 to 0.892).
  • A slope below 1 indicates predictions that are too extreme, as expected in a small development sample.

Incremental net benefit over the NIHSS-only model was not distinguishable from zero at the tested decision thresholds.

  • Incremental net benefit was -0.015, 0.036, and 0.013 at 10%, 20%, and 30% thresholds, respectively.
  • All corresponding 95% confidence intervals crossed zero.

The cohort was smaller than desirable for developing a prediction model.

  • Post-hoc Riley sample size assessments across plausible model-fit assumptions indicated the available cohort was below the desirable size.
  • With 51 events, the cohort was limited for a five-predictor model.

A sensitivity analysis using a reconstructed cohort did not change the overall interpretation.

  • The primary analysis excluded an unresolved longitudinal data segment; the reconstructed cohort analysis tested this decision.
  • The overall conclusion of limited and uncertain performance was unchanged.

The authors conclude the model is exploratory and requires independent validation and better outcome ascertainment.

  • The study was a retrospective, single-center reanalysis of registry data.
  • The model used a revision-stage locked predictor set with the NIHSS-only model as comparator.
  • Internal validation only was performed.

What This Means

This study asked whether simple measurements taken when a stroke patient is admitted, such as stroke severity score, age, blood sugar, white blood cell count, and triglycerides, could help predict who will get worse neurologically within 48 hours after clot-removal surgery (thrombectomy). The researchers looked back at records from 214 patients at one hospital; about 24% of them (51 patients) worsened by at least 4 points on a standard stroke scale. The model they built did only modestly better than chance at telling which patients would worsen, and after statistical correction for overfitting its performance dropped further. It improved the accuracy of predicted probabilities by less than 1% over simply using the overall rate of worsening for everyone. Adding the extra measurements to stroke severity alone did not clearly improve prediction or clinical usefulness, as the uncertainty ranges included no benefit. This research suggests that these routine admission measurements, in this small single-hospital dataset, are not enough to reliably predict early worsening after thrombectomy. The authors describe the model as exploratory, not ready for clinical use, and note that larger studies, independent validation in other hospitals, and better outcome data are needed.

Have a question about this study?

Citation

Ren G, Zhao C, Sun Y. (2026). Development and internal validation of a parsimonious model for neurological deterioration at 48 h after endovascular thrombectomy.. Frontiers in neurology. https://doi.org/10.3389/fneur.2026.1888204