Cardiovascular

Enhanced diabetic retinopathy detection via multimodal fusion of fundus imaging features and clinical demographic information using verifiable convolutional neural network.

TL;DR

The proposed DD-FIF-CDI-VCNN framework, combining fundus imaging features with clinical demographic information via a Verifiable Convolutional Neural Network optimized by the Warthog Optimization Algorithm, achieves enhanced diabetic retinopathy detection performance compared to existing unimodal approaches.

Key Findings

The DD-FIF-CDI-VCNN method achieved superior performance across multiple evaluation metrics compared to existing models for diabetic retinopathy detection.

  • Performance was evaluated using accuracy, precision, recall, F1-Score, Area under Curve (AUC), and Error rate
  • The framework classified fundus images into normal and diabetic categories
  • The multimodal approach was compared against existing unimodal approaches
  • The dataset used was the Ocular Disease Recognition (ODIR) dataset

Robust Consensus Tobit Kalman Filtering (RCTKF) was used as a preprocessing method to address image quality issues including low contrast, noise, and pixel intensity normalization.

  • RCTKF was applied to resize fundus images and normalize pixel intensities
  • The preprocessing stage reduces noise to improve image quality for subsequent feature extraction
  • This approach addressed limitations of traditional systems that use raw, unprocessed fundus data
  • The preprocessing was designed to improve feature extraction quality in downstream stages

A ResNet-fused External Attention Network (ResfEANet) was used to extract rich visual and texture features from retinal fundus images.

  • ResfEANet served as the visual feature extraction module for pre-processed fundus images
  • The network extracts both visual and texture features from retinal images
  • This module operated in parallel with TabNet-based demographic feature extraction
  • The extracted visual features were subsequently fused with demographic attributes

TabNet was used to extract meaningful feature vectors from structured demographic and clinical attributes of patients.

  • TabNet converted structured patient demographic data into meaningful function vectors
  • The module encoded relevant patient-specific patterns for integration with visual features
  • Demographic attributes were processed in parallel with fundus image feature extraction
  • This approach aimed to capture patient-specific styles not available from imaging alone

Hierarchical Multi-Scale Feature Fusion (HMSFF) was employed to integrate visual, texture, and demographic features into a unified representation.

  • HMSFF combined visible and texture capabilities from fundus photos with demographic attributes
  • The fusion created a comprehensive representation leveraging both imaging and structured patient data
  • The fused feature set served as input to the VCNN-based classifier
  • This multimodal fusion addressed the limitation of single-modality approaches

The Verifiable Convolutional Neural Network (VCNN) classifier parameters were optimized using the Warthog Optimization Algorithm (WOA) to improve convergence and detection performance.

  • WOA was used for fine-tuning VCNN parameters
  • The optimization aimed at improved convergence and better detection performance
  • The VCNN received the fused multimodal feature vector as input
  • The VCNN-based approach enhanced predictability and robustness compared with the unimodal approach

The proposed framework incorporated bilateral eye correlation by analyzing fundus images from both eyes, addressing a limitation of traditional single-eye analysis systems.

  • Traditional systems and many deep learning-based systems are limited to analyzing fundus images from a single eye
  • The proposed system sourced fundus images of both eyes along with corresponding demographic information
  • Failure to include bilateral eye correlation was identified as a critical gap in existing approaches
  • The ODIR (Ocular Disease Recognition) dataset served as the main data source for the framework

The proposed framework addressed multiple known limitations of existing diabetic retinopathy detection systems including class imbalance, low image contrast, and single-disease focus.

  • Existing systems were noted to have issues with low image contrast, noise, and class imbalance
  • Traditional approaches generally concentrated on detection of no more than a single disease
  • The proposed DD-FIF-CDI-VCNN framework was designed to bridge these identified gaps
  • The framework integrated both fundus imaging features and clinical demographic information to improve robustness

What This Means

This research suggests that combining eye scan images with patient health information (such as demographics and clinical data) in a single AI system can improve the detection of diabetic retinopathy, a leading cause of blindness in people with diabetes. The proposed system, called DD-FIF-CDI-VCNN, processes fundus photographs (images of the back of the eye) from both eyes simultaneously — rather than one eye at a time as most existing systems do — and merges this visual information with patient-specific data using a series of specialized AI components. The system also applies image enhancement techniques before analysis to reduce noise and improve image quality, addressing common problems in real-world medical image datasets. The framework uses several layered AI techniques: a neural network called ResfEANet to extract visual patterns from the eye images, a tool called TabNet to process structured patient data, a fusion method called HMSFF to combine all information sources, and a final classifier called VCNN whose settings are automatically tuned using an optimization algorithm inspired by warthog behavior. Together, these components work to classify patients as having normal eyes or diabetic retinopathy. The researchers compared this approach against existing models using standard performance measures including accuracy, precision, recall, F1-score, AUC, and error rate. This research suggests that incorporating patient demographic and clinical information alongside eye imaging — rather than relying on images alone — can make AI-based diabetic retinopathy screening more accurate and robust. If validated more broadly, such multimodal approaches could help clinicians catch diabetic eye disease earlier and more reliably, potentially reducing the risk of vision loss in people with diabetes. However, as this study relies on a single publicly available dataset, further validation across diverse real-world clinical settings would be important before widespread adoption.

Have a question about this study?

Citation

Mohammad A, Ramakrishnaiah N. (2026). Enhanced diabetic retinopathy detection via multimodal fusion of fundus imaging features and clinical demographic information using verifiable convolutional neural network.. Computers in biology and medicine. https://doi.org/10.1016/j.compbiomed.2026.111892