Comparative analysis of 2 approaches to monitor countries' progress towards full and equal access to sexual and reproductive health care, information, and education in 75 countries: An observational validation study.
The proposed revision to SDG Indicator 5.6.2's calculation produces systematically different results from the current formula, with differences in total indicator values ranging from -7.18 to +26.21 percentage points across 75 countries, and the alternative formulation better captures important distinctions in countries' legal landscapes governing sexual and reproductive health.
Key Findings
Results
Differences in total indicator values comparing the alternative versus current formulation ranged from -7.18 percentage points in Mali to 26.21 percentage points in South Sudan.
The study used secondary data from the 2022 UNFPA Sexual and Reproductive Health and Rights Country Profiles from 75 countries.
The majority of countries (n = 47) had an increase in total indicator score under the alternative formula.
27 countries had a decrease in score under the alternative formula.
Only 1 country, Sweden, saw no change in score, as it scored 100% of the possible indicator value under both rubrics.
Results
The mean difference between scores produced by the two measures was 2.28 percentage points, suggesting the two methods may produce systematically different results.
Convergent validity was assessed using the Bland-Altman approach.
The mean difference of 2.28 indicates a systematic rather than random difference between the two scoring approaches.
The current formula uses a mean of 13 individual component scores, while the proposed formula uses a weighted additive approach assigning equal weight to substantive domains.
Results
The current indicator calculation assigns a score of zero for Component 3 (Abortion) to 16 countries, masking important differences in the number of legal barriers present and whether women can be criminally charged for illegal abortion.
Under the alternative formulation, which re-expresses barriers on a positive scale, only 4 countries have a score of zero for Component 3.
The most substantial changes under the alternative formulation were observed in scores for 'Component 3: Abortion.'
The current formula's treatment of abortion-related barriers results in loss of discriminatory information across countries.
Methods
The proposed revision involved two specific changes to the indicator's calculation: re-expressing all barriers and enablers as positive values, and using a weighted additive approach rather than a mean of 13 individual component scores.
The weighted additive approach assigns equal weight to substantive domains rather than to individual components.
The study used data from 75 countries drawn from the 2022 UNFPA Sexual and Reproductive Health and Rights Country Profiles.
These proposed changes were designed to address global recommendations and concerns noted about the current SDG Indicator 5.6.2 calculation.
Discussion
The authors acknowledged that the absence of a gold standard for measuring the phenomenon under study means it is not possible to specify with total certainty which indicator formulation performs better.
This was identified as the main limitation of the methodology.
Despite this limitation, the authors concluded that the current indicator formulation has underlying challenges that impact its interpretability.
The proposed changes could alter understanding of the current legal landscape governing sexual and reproductive health, thereby pointing to different programmatic and policy priorities.
What This Means
This research examines a global measure used to track countries' progress on sexual and reproductive health laws — specifically United Nations Sustainable Development Goal (SDG) Indicator 5.6.2, which counts how many countries have laws guaranteeing equal access to sexual and reproductive health care, information, and education. The researchers identified problems with how this indicator is currently calculated and proposed two fixes: changing how legal barriers are scored so they are expressed in a consistent direction, and adjusting how the different legal components are weighted when calculating a country's overall score. Using data from 75 countries, they compared results from the current formula to their proposed alternative.
The researchers found that their proposed formula produced noticeably different scores for most countries — 47 countries scored higher and 27 scored lower under the new approach, with differences as large as 26 percentage points. The biggest differences appeared in the abortion-related component, where the current formula assigns zero scores to 16 countries in a way that hides meaningful differences between them — for example, whether a country simply restricts abortion versus whether it also criminally penalizes women who seek one. Under the proposed formula, only 4 countries scored zero on this component, better distinguishing between varying degrees of restriction.
This research suggests that the way this global indicator is currently calculated may obscure important differences between countries' legal environments for sexual and reproductive health, potentially misdirecting international attention and resources. Changing the formula could lead to a more accurate picture of where legal gaps exist and what policy changes are most needed to help countries achieve equitable access to reproductive health services. The authors note that since there is no perfect benchmark to compare against, they cannot definitively prove one formula is superior, but their findings highlight real interpretability problems with the current approach.
Gausman J, Adanu R, Bandoh D, Kapoor N, Kenu E, Langer A, et al.. (2024). Comparative analysis of 2 approaches to monitor countries' progress towards full and equal access to sexual and reproductive health care, information, and education in 75 countries: An observational validation study.. PLoS medicine. https://doi.org/10.1371/journal.pmed.1004476