Background & Aims
Ecological Momentary Assessment (EMA, also Experience Sampling Method) is increasingly used in research. In contrast to the traditional measurement of constructs/variables via questionnaires, EMA involves the collection of data at multiple points in time in the natural environment of the participants, which offers several advantages beyond traditional questionnaires. One challenge that is not often addressed in EMA studies is the content validity of the instruments used. Content validity is an often neglected, but a quintessential property of self-report measurement of experiences (Crombez et al., 2023). The objective was to review how authors developed psychosocial items for use in EMA studies.
Methods
Inclusion criteria were (1) EMA study (at least 7 measurement moments with a minimum of one per day, (2) adults experiencing chronic pain (no headache, or cancer-related pain), (3) at least one additional psychosocial domain beyond those captured as core outcomes (anxiety, depression, social functioning,…). We developed a coding scheme to assess content validity for each construct based upon the COSMIN guidelines for content validity. We also assessed how items were identified and selected, and whether/how patient partners were involved.
Results
The search resulted in 10.837 hits, which resulted in 42 studies that fulfilled the criteria (dd 31/12/2023). The precise content and development process of the items was poorly reported. Authors were contacted for further information. This resulted in information on item development of 11 studies. Most often studies did not provide a definition of the construct measured, did not involve patient partners in creating items, and did not report on the relevance, comprehensiveness and comprehensibility of each item for assessing the construct (either in professionals or in patients). Most often feasibility of the overall project was investigated. Often authors selected EMA items from available questionnaires.
Conclusions
Notwithstanding the advantages of EMA studies, the design of such studies is a complex enterprise, involving many decisions. We found that decisions and information on the development of psychosocial EMA items are often not well reported in publications. Furthermore, items were often not developed and tested according to state of the art guidelines for content validity. We recommend a more systematic approach in the development and testing of EMA items. Guidelines for future studies are proposed.
References
Crombez G, Veirman E, Van Ryckeghem D, Scott W, De Paepe A. The effect of psychological factors on pain outcomes: lessons learned for the next generation of research. PAIN Reports. 2023 Dec;8(6):e1112. doi: 10.1097/PR9.0000000000001112.
Presenting Author
Geert Crombez
Poster Authors
Topics
- Assessment and Diagnosis