Cardiovascular

A machine learning model for predicting cognitive improvement after scalp cluster needling therapy in patients with post-stroke mild cognitive impairment.

TL;DR

A LightGBM model built on seven pretreatment clinical predictors showed acceptable performance (AUC 0.759) for predicting cognitive improvement after 1 month of scalp cluster needling therapy with prolonged needle retention in PSCI-MCI patients, but external validation is required before clinical implementation.

Key Findings

A retrospective cohort of 750 hospitalized PSCI-MCI patients was split into training and validation sets to develop a model predicting cognitive improvement after SCNT-PR.

  • Patients were hospitalized with PSCI-MCI between January 1, 2010, and January 1, 2023.
  • Random assignment gave a training set of n = 526 and a validation set of n = 224.
  • The outcome was an increase of at least 2 points in corrected MoCA score after 1 month of treatment compared with baseline.

Seven key predictors were identified from the intersection of LASSO regression and the Boruta algorithm.

  • Baseline data covered demographics, vascular risk factors, stroke severity, imaging features, cognitive and functional assessments, emotional and sleep indicators, treatment-related variables, and laboratory findings.
  • Seven supervised machine learning algorithms were applied to develop pretreatment prediction models using these predictors.

LightGBM showed the best, acceptable performance among the evaluated models, with an AUC of 0.759.

  • Seven supervised machine learning algorithms were compared.
  • Performance was assessed in terms of discrimination, calibration, and clinical utility.
  • The authors describe the discrimination as 'acceptable', not high.

Calibration curves and decision curve analysis indicated acceptable calibration and favorable clinical utility for the LightGBM model.

  • Calibration and clinical utility were evaluated alongside discrimination.
  • The authors suggest the model may provide preliminary support for patient stratification and individualized clinical assessment.

SHAP analysis identified seven major contributors to model predictions: baseline corrected MoCA score, years of education, NIHSS total score, Barthel Index, age, frontal lobe lesion, and diabetes.

  • These seven variables correspond to the predictors selected by LASSO and Boruta.
  • SHAP was used for model interpretation, ranking the contribution of each feature to predictions.

Sensitivity analyses showed consistent predictor patterns under alternative outcome definitions and predictor configurations.

  • Alternative definitions of cognitive improvement were tested.
  • Alternative predictor configurations were also tested, and the predictor patterns remained consistent.

The model was only internally validated, and the authors state external validation in independent cohorts is required before clinical implementation.

  • The study was retrospective and used data from hospitalized patients.
  • Validation used a random split of the same cohort.

What This Means

This study looked at patients with mild cognitive problems after a stroke who were treated with a form of acupuncture called scalp cluster needling, in which needles stay in place for a long time. Cognitive recovery varies a lot between patients, so the researchers tried to predict, before treatment, who would improve. They used records from 750 hospitalized patients and defined improvement as a gain of at least 2 points on a standard cognitive test (MoCA) after one month. The best machine learning model (LightGBM) used seven pieces of information available before treatment: baseline cognitive score, years of education, stroke severity, daily-living ability, age, whether the frontal lobe was damaged, and diabetes. It predicted improvement with acceptable accuracy (AUC 0.759), which is moderate and not highly precise. Checks of calibration and usefulness were also acceptable, and the key predictors were similar when the definition of improvement was changed. This research suggests such a tool could eventually help doctors think about which patients are more likely to benefit from this treatment. However, the study was retrospective, drew on a single data source, and was tested only on a random portion of the same patients. The authors say it needs testing in independent groups before it could be used in clinical practice.

Have a question about this study?

Citation

Hao Y, Wei X, Zhao P, Qin H. (2026). A machine learning model for predicting cognitive improvement after scalp cluster needling therapy in patients with post-stroke mild cognitive impairment.. Frontiers in neurology. https://doi.org/10.3389/fneur.2026.1884682