Sleep

Development of a Validation and Inspection Tool for Armband-based Lifelog data (VITAL) to facilitate the clinical use of wearable health data: A prototype and usability evaluation.

TL;DR

VITAL demonstrated the feasibility of harmonizing, visualizing, and evaluating wearable health data for clinical use, with findings suggesting the tool is practical and valuable for supporting clinical workflows.

Key Findings

VITAL successfully integrated wearable health data from four major consumer device brands into a standardized format.

  • Data were collected from Samsung, Apple, Fitbit, and Xiaomi devices.
  • Data were integrated into a standardized dataframe at 10-minute intervals.
  • The system covered three core domains: physical activity, biometrics, and sleep.
  • System requirements were identified through interviews with four clinicians prior to development.

Data quality in VITAL was operationalized using three quantifiable metrics: completeness, recency, and plausibility.

  • These metrics were designed to enable systematic evaluation of wearable health data quality.
  • The quality management framework was identified as a core function of the pipeline alongside data integration and visualization.
  • This approach addressed concerns regarding data quality that hinder practical clinical use of wearable data.

All seven clinician participants successfully completed assigned tasks during usability testing with minimal errors.

  • Usability testing was conducted through individual interviews with seven clinicians.
  • Participants completed task-based evaluations as part of the usability assessment.
  • Participants also completed a Unified Theory of Acceptance and Use of Technology (UTAUT) survey.
  • No participants failed to complete the assigned tasks.

UTAUT survey results indicated favorable user acceptance of VITAL among clinician participants.

  • Mean score for performance expectancy was 4.20 (on an unspecified scale, contextually likely 1–5).
  • Mean score for effort expectancy was 3.96.
  • Mean score for intention to use was 4.14.
  • All three UTAUT dimensions scored above the midpoint, reflecting positive acceptance.

Clinician interviews identified both strengths and areas for improvement in the VITAL prototype.

  • Strengths highlighted by participants included visualization quality and overall usability.
  • Suggested improvements included interface simplification.
  • Clinicians recommended inclusion of additional clinical data types such as electrocardiograms and dietary information.
  • These findings were gathered through qualitative individual interviews following task-based evaluations.

The development process for VITAL followed a structured three-phase approach.

  • The three phases comprised requirement gathering, system implementation, and usability evaluation.
  • Requirement gathering involved interviews with four clinicians.
  • The structured approach was intended to ensure the system addressed real clinical needs and workflows.

What This Means

This research describes the development and early testing of a software tool called VITAL (Validation and Inspection Tool for Armband-based Lifelog data), designed to help clinicians make practical use of health data collected from consumer wearable devices like Apple Watches, Fitbits, Samsung wearables, and Xiaomi bands. A key challenge in clinical settings is that wearable devices produce large amounts of data in different formats, and there are concerns about data quality and the difficulty of reviewing it efficiently. VITAL addresses this by pulling data from multiple devices into a single standardized format, visualizing it interactively, and automatically assessing data quality based on whether the data is complete, recent, and plausible. To test whether the tool was usable, seven clinicians were asked to perform specific tasks using the prototype and then complete a standardized survey about their experience. All seven successfully completed the tasks with minimal errors, and their survey responses reflected positive attitudes toward the tool's usefulness, ease of use, and likelihood of adoption. Clinicians appreciated the visualization features but also suggested simplifying the interface and adding data types like heart rhythm (ECG) and dietary information. This research suggests that it is feasible to bring together wearable health data from different consumer devices into a single, clinician-friendly tool that also monitors data quality. The positive early usability results indicate the concept is practical and worth pursuing further, though the authors note that larger studies in real clinical environments will be needed to confirm whether VITAL effectively supports clinical decision-making in practice.

Have a question about this study?

Citation

Im E, Kang S, Kim H. (2026). Development of a Validation and Inspection Tool for Armband-based Lifelog data (VITAL) to facilitate the clinical use of wearable health data: A prototype and usability evaluation.. International journal of medical informatics. https://doi.org/10.1016/j.ijmedinf.2026.106322