Cardiovascular

Machine learning versus traditional regression models for predicting diabetic retinopathy screening adherence among community-dwelling older adults with diabetes.

TL;DR

Machine learning models demonstrated comparable discriminative performance to traditional logistic regression for predicting DR screening adherence, while offering distinct profiles in calibration and clinical net benefit, with random forest achieving the highest AUC (0.774) and net benefit across most threshold probabilities.

Key Findings

The random forest model achieved the highest AUC but showed no statistically significant difference from logistic regression or decision tree models.

  • Random forest AUC = 0.774 (95% CI: 0.678–0.869)
  • Logistic regression AUC = 0.751 (95% CI: 0.678–0.824)
  • Decision tree AUC = 0.709 (95% CI: 0.596–0.821)
  • DeLong's tests indicated no statistically significant differences between models (all p > 0.05)
  • All models were evaluated using 10-fold cross-validation

The decision tree model exhibited the best calibration among the three models.

  • Decision tree achieved the lowest Brier score = 0.1142
  • Brier score measures calibration quality, with lower values indicating better agreement between predicted probabilities and observed outcomes
  • All three models were built using identical predictors for fair comparison

Decision curve analysis indicated that the random forest model provided the highest net benefit across most threshold probabilities.

  • Decision curve analysis (DCA) was used to assess clinical utility of all three models
  • Random forest provided superior net benefit compared to logistic regression and decision tree across most threshold probability ranges
  • DCA evaluates clinical utility beyond discrimination and calibration alone

History of ocular disease was identified as the strongest positive predictor of DR screening adherence.

  • OR = 3.529 (95% CI: 2.430–5.139) for history of ocular disease
  • This was the largest odds ratio among all predictors in multivariable analysis
  • Identified through multivariable logistic regression analysis

Higher HbA1c, lower self-efficacy, higher perceived severity, absence of exercise therapy, and smoking were associated with poorer DR screening adherence.

  • These five factors were identified through multivariable analysis as negative predictors of adherence
  • Self-efficacy and perceived severity are Protection Motivation Theory (PMT)-based psychological constructs
  • Both clinical indicators (HbA1c) and behavioral factors (smoking, exercise therapy) contributed independently to prediction

DR screening adherence was suboptimal in the study sample, with the majority of participants classified as poor adherers.

  • Total sample: 1,021 community-dwelling older adults with diabetes recruited from four community health centers in Nantong, China (March–October 2025)
  • Cluster random sampling design was used
  • 159 participants (15.6%) were classified as good adherence; 862 (84.4%) as poor adherence
  • SMOTE and class weighting were applied to address class imbalance

Integration of PMT-based psychological constructs with clinical and behavioral factors provided a multidimensional framework for predicting DR screening behavior.

  • PMT constructs included self-efficacy and perceived severity, both of which were significant predictors
  • A validated PMT-based questionnaire was used as a key psychological predictor
  • Data incorporated sociodemographic characteristics, clinical indicators, health behaviors, and PMT-based constructs
  • The authors describe this integration as supporting 'risk stratification for precision diabetes care'

What This Means

This research suggests that among older adults with diabetes living in the community, predicting who will regularly attend diabetic retinopathy (eye) screening is possible using both traditional statistical methods and newer machine learning approaches—and that neither type of model is clearly superior. The study recruited over 1,000 adults from community health centers in China and found that only about 16% had good screening adherence. When researchers compared a traditional logistic regression model against two machine learning models (decision tree and random forest), all three performed similarly in their ability to distinguish good from poor adherers, with no statistically significant differences in accuracy. However, the random forest model appeared most useful in clinical decision-making scenarios, while the decision tree had the best calibration (its predicted probabilities matched real-world outcomes most closely). The study also identified key factors linked to poorer screening attendance: having higher blood sugar levels (HbA1c), not exercising, smoking, lower confidence in managing one's health (self-efficacy), and paradoxically, a stronger belief that diabetic retinopathy is a serious condition (perceived severity). The single strongest predictor of better adherence was having a prior history of eye disease, which tripled the likelihood of attending screening. Notably, this study went beyond typical clinical or demographic factors by including psychological measures drawn from Protection Motivation Theory, such as self-efficacy and perceived severity, highlighting that mental and motivational factors play a meaningful role in whether patients follow through with screening. This research suggests that combining psychological, behavioral, and clinical information together—rather than relying on any single type of factor—offers a more complete picture of who is at risk for missing eye screenings. This could help healthcare providers in community settings identify patients who need additional support or targeted outreach to improve early detection of diabetic retinopathy, which is a leading but preventable cause of blindness.

Have a question about this study?

Citation

Wang Y, Xia L, Geng G, Ge C, Qian X, Shen H. (2026). Machine learning versus traditional regression models for predicting diabetic retinopathy screening adherence among community-dwelling older adults with diabetes.. Frontiers in endocrinology. https://doi.org/10.3389/fendo.2026.1909594