Exercise & Training

Temporal Stability of Repeated Self-Reported vs Device-Measured Behavior: Observational Study Using Ecological Momentary Assessment.

TL;DR

Reporting reactivity in EMA appears protocol-dependent: coverage-based (120-min recall) EMA of physical activity and sedentary behavior diverged modestly from concurrent accelerometry over 7 days, whereas near-momentary (5-min) EMA showed no such divergence.

Key Findings

In the coverage-based (120-min recall) EMA protocol, self-reported sedentary behavior diverged linearly from accelerometry over the 7-day monitoring period.

  • SB linear divergence: b=1.40, 95% CI 0.20-2.61, P=.02.
  • Divergence was tested as a method × study day interaction in multilevel models with random intercepts and slopes.
  • Accelerometry was continuous thigh-worn activPAL4 and served as the temporal anchor.

In the coverage-based protocol, self-reported physical activity showed both linear and quadratic temporal divergence from accelerometry.

  • PA linear divergence: b=-1.91, 95% CI -2.93 to -0.90, P<.001.
  • PA quadratic divergence: b=0.28, 95% CI 0.12-0.44, P<.001.
  • Reporting reactivity was defined as divergence in the temporal trajectories of EMA-reported behavior relative to accelerometry.

No evidence of divergence between self-reported and device-measured behavior was found in the near-momentary (5-min reporting period) protocol.

  • Temporal trajectories of EMA-reported PA and SB did not diverge significantly from accelerometry in this protocol.
  • Participants completed 5 daily smartphone EMA prompts over 7 days.

The divergence in reporting trajectories differed significantly between the coverage-based and near-momentary protocols.

  • SB linear 3-way interaction (method × protocol × study day): b=-2.58, P=.02.
  • PA linear 3-way interaction: b=1.86, P=.04.
  • Protocol differences were tested with multivariable method × protocol × study day interactions.

The study was a secondary analysis of a US adult panel sample using concurrent accelerometry and EMA in natural environments.

  • 315 adults from the Understanding America Study panel, recruited January to July 2023.
  • Monitored for 7 days with continuous thigh-worn activPAL4 accelerometry and 5 daily smartphone EMA prompts assessing PA and SB.
  • Models tested linear and quadratic study day effects across the 2 methods.

The authors conclude that reporting reactivity in EMA is protocol-dependent and that coverage-based protocols show modest reactivity, challenging the assumption of reporting invariance.

  • Longitudinal stability of reporting is commonly assumed in EMA but rarely tested.
  • The findings underscore the importance of considering protocol design when interpreting within-person change.

What This Means

Researchers often ask people to answer short smartphone surveys several times a day about what they are doing, a method called ecological momentary assessment. A worry is that answering the same questions repeatedly might change how people report, for example by making them less careful or more aware of their behavior. This study tested that concern by comparing people's survey answers about physical activity and sitting to measurements from a thigh-worn activity monitor over 7 days in 315 US adults. When surveys asked people to recall the previous 120 minutes, their reports gradually drifted away from what the monitor recorded across the week, for both sitting and physical activity. When surveys asked only about the last 5 minutes, no such drift was found, and the difference between the two survey designs was statistically significant. The drift in the longer-recall design was described as modest. This research suggests that how a survey is designed can affect whether repeated reporting stays consistent over time. It may matter for researchers who track change within a person over days or weeks, since apparent changes in self-reports could partly reflect shifts in reporting rather than real changes in behavior. The study does not say which design is better overall.

Check Your Own Numbers

Upload your bloodwork. We'll cross-reference your results against this study and 4,700 others.

Upload Your Labs

Have a question about this study?

Citation

Toledo M, Schneider S, Smyth J, Junghaenel D, Stone A. (2026). Temporal Stability of Repeated Self-Reported vs Device-Measured Behavior: Observational Study Using Ecological Momentary Assessment.. Journal of medical Internet research. https://doi.org/10.2196/99953