Sexual Health

Cognitive testing in 19 countries to refine WHO's Sexual Health Assessment of Practices and Experiences.

TL;DR

A questionnaire exploring sexual practices, experiences and health-related outcomes can be comprehensible and acceptable by the general population in diverse global contexts, and rigorous processes for translation and cognitive testing of such a questionnaire are critically important.

Key Findings

Participants across 19 countries were generally willing to respond to even the most sensitive questionnaire items on sexual biography and practices.

  • 645 cognitive interviews were conducted across 19 countries between March 2022 and March 2023
  • Data collection occurred in three iterative waves
  • Participants were of diverse sex, gender, age, and geography
  • Willingness to respond was observed even for the most sensitive items on sexual biography and practices

The original draft questionnaire contained problems that affected participants' willingness (acceptability) and ability (knowledge barriers) to respond fully.

  • Issues with acceptability included items that participants were unwilling to answer due to cultural or personal sensitivities
  • Knowledge barriers prevented some participants from being able to answer fully
  • These issues were identified through analysis frameworks completed by local study teams
  • Joint analysis meetings were held between data collection waves to identify question failures

The original questionnaire contained problems that prevented participants from interpreting questions as intended, including poor wording (source question error), cultural portability issues, and very rarely translation error.

  • Source question error (poor wording in the original language) was a primary identified problem
  • Cultural portability was a distinct category of failure where questions could not be meaningfully applied across cultural contexts
  • Translation errors were identified but described as occurring 'very rarely'
  • These interpretation issues were identified across diverse geographic and cultural environments

Revisions to the questionnaire included adjusting item order and wording, adding preambles and implementation guidance, and removing items with limited cultural portability.

  • Item order was adjusted to improve acceptability and comprehension
  • Wording of individual items was revised to address source question errors
  • Preambles were added to improve context and acceptability for sensitive topics
  • Items deemed to have limited cultural portability were removed from the questionnaire
  • Implementation guidance was added to support consistent administration across contexts

The study used a three-wave iterative cognitive interview methodology with a semi-structured field guide across 19 countries to test and refine the WHO sexual health questionnaire.

  • n = 645 cognitive interviews were conducted in total
  • Data collection spanned March 2022 to March 2023
  • Interviewers used a semi-structured field guide to elicit narratives about questionnaire item interpretation and response processes
  • Local study teams completed data analysis frameworks after each wave
  • Joint analysis meetings between waves were used to identify question failures and inform iterative revisions

The study demonstrated that a standard questionnaire on sexual health practices and experiences can be made comprehensible and acceptable across diverse global contexts through rigorous cognitive testing and translation processes.

  • Testing spanned 19 countries with participants of diverse sex, gender, age, and geography
  • The iterative process successfully identified and addressed cross-cultural interpretation problems
  • The study highlighted the importance of rigorous processes for translation and cognitive testing of such questionnaires
  • The refined questionnaire is intended for use in measuring sexual health-related outcomes at population level

What This Means

This research describes the process of testing and refining a World Health Organization (WHO) questionnaire designed to measure sexual health practices, experiences, and outcomes across many different countries and cultures. Researchers conducted 645 in-depth cognitive interviews — conversations where participants explain how they understand and answer survey questions — across 19 countries over one year, with people of diverse genders, ages, and backgrounds. The study used three rounds of testing, making improvements to the questionnaire between each round based on what they learned. The study found that people were generally willing to answer even the most sensitive questions about their sexual history and behaviors. However, the original questionnaire had several types of problems: some questions were worded poorly in the original language, some concepts did not translate meaningfully across different cultures (called 'cultural portability' issues), and a small number had translation errors. These problems sometimes made people unwilling or unable to answer, or caused them to interpret questions differently than intended. To fix these issues, the research team reordered questions, improved wording, added introductory text to sensitive sections, and removed questions that could not be adapted across cultures. This research suggests that it is possible to create a global survey about sexual health that is both understandable and acceptable to general populations in widely different cultural settings, but only if it goes through careful, iterative testing and translation. The findings have practical implications for public health researchers and organizations seeking to collect comparable data on sexual health across countries, as they demonstrate the specific types of problems that arise and the kinds of revisions needed to address them.

Have a question about this study?

Citation

Hunter E, Fine E, Black K, Henriks J, Tofail F, Morroni C, et al.. (2024). Cognitive testing in 19 countries to refine WHO's Sexual Health Assessment of Practices and Experiences.. Bulletin of the World Health Organization. https://doi.org/10.2471/BLT.23.291162