Outcome assessment in psychotherapy
validity evidence of the Outcome Questionnaire Short Form
Keywords:
Outcome assessment, Psychotherapy, Validation studyAbstract
Objective
The aim of this study was to investigate validity evidence of content, of internal structure, and associations with external variables for the measure Outcome Questionnaire Short Form adapting the form to a Brazilian-Portuguese language version.
Method
The study involved 235 adults, 45 males (19.1%) and 189 females (80.4%), aged between 18 and 63 years old (M = 28.82; SD = 9.25). A sociodemographic questionnaire, the Outcome Questionnaire Short Form, the Depression Anxiety and Stress Scale Short Form, the Rosenberg Self-esteem Scale and the Satisfaction with Life Scale were applied.
Results
The scale showed good internal consistency with 0.88 Cronbach’s alpha; correlations with external variables were significant and exhibited the expected direction.
Conclusion
The investigated scale is adequate in its Brazilian-Portuguese language version and constitutes a valued tool to be used by health professionals aiming to evidence the progress and outcome of a psychotherapy.
Downloads
References
Bolsoni-Silva, A. T., & Josua, D. (2019). Instrumentos de avaliação na pesquisa e na prática clínica: questões relevantes para a produção de evidências na TAC. Perspectivas em Análise do Comportamento, 10(1), 42-63. https://doi.org/10.18761/PAC.TAC.2019.008
Braga, C., Ribeiro, A., Sousa, I., & Gonçalves, M. (2019). Ambivalence predicts symptomatology in cognitivebehavioral and narrative therapies: an exploratory study. Frontiers in Psychology, 10, e1244. https://doi.org/10.3389/fpsyg.2019.01244
Breakwell, G., Hammond, S., Fife-Schaw, C., & Smith, J. A. (2010). Método de pesquisa em psicologia (3rd ed.). Artmed.
Burnette, J. L., Knouse, L. E., Vavra, D. T., O’Boyle, E., & Brooks, M. A. (2020). Growth Mindsets and psychological distress: a meta-analysis. Clinical Psychology Review, 77, e101816. https://doi.org/10.1016/j.cpr.2020.101816
Cooper, L. D., Murphy, H. G., Delk, L. A., Fraire, M. G., Van Kirk, N., Sullivan, C. P., Waldron, J. C., Halliburton, A. E., Schiefelbein, F., & Gatto, A. (2021). Implementing routine outcome monitoring in a psychology training clinic: a case study of a process model. Training and Education in Professional Psychology, 15(2), 87-96. https://doi.org/10.1037/tep0000298
Cuijpers, P., Reijnders, M., & Huibers, M. J. H. (2019). The role of common factors in psychotherapy outcomes. Annual Review of Clinical Psychology, 15(1). https://doi.org/10.1146/annurev-clinpsy-050718-095424
Epskamp, S., & Fried, E. I. (2018). A tutorial on regularized partial correlation networks. Psychological Methods, 23(4), 617-634. https://doi.org/10.1037/met0000167
Gelkopf, G., Mazor, Y., & Roe, D. (2022). A systematic review of patient-reported outcome measurement (PROM) and provider assessment in mental health: goals, implementation, setting, measurement characteristics and barriers. International Journal for Quality in Health Care, 34(1), 13-27. https://doi.org/10.1093/intqhc/mzz133
Gonçalves, M. M., Batista, J., Braga, C., Oliveira, J. T., Fernandéz-Navarro, P., Magalhães, C., Ferreira, H., & Sousa, I. (2022). Innovative moments in recovered cases treated with the unified protocol for transdiagnostic treatment of emotional disorders. Psychotherapy Research, 32(6), 736-747. https://doi.org/10.1080/10503307.2021.2003463
Gonçalves, M. M., Sousa, I., & Rosa, C. (2019). Correlation structure in hierarchical linear modeling: an illustration with the therapeutic alliance. Clinical Psychology & Psychotherapy, 26(5), 626-635. https://doi.org/10.1002/cpp.2374
Gouveia, V. V., Milfont, T. L., Fonseca, P. N., & Coelho, J. A. P. M. (2009). Life satisfaction in Brazil: testing the psychometric properties of the Satisfaction With Life Scale (SWLS) in five brazilian samples. Social Indicators Research, 90, 267-277. https://doi.org/10.1007/s11205-008-9257-0
Hutz, C. S., & Zanon, C. (2011). Revisão da adaptação, validação e normatização da Escala de Autoestima de Rosenberg. Avaliação Psicológica, 10(1), 41-49. http://pepsic.bvsalud.org/scielo.php?script=sci_arttext&pid=S1677-
Hyland, P., Shevlin, M., Cloitre, M., Karazitasm T., Vallières, F., McGinty, G., Fox, R., & Power, J. (2019). Quality not quantity: loneliness subtypes, psychological trauma, and mental health in the US adult population. Social Psychiatry and Psychiatric Epidemiology, 54, 1089-1099. https://doi.org/10.1007/s00127-018-1597-8
International Test Commission. (2017). The ITC Guidelines for Translating and Adapting Tests (2nd ed.). www.InTestCom.org
Karp, D. A. (2017). Speaking of sadness: depression, disconnection, and the meanings of illness. Oxford University Press.
Lambert, M. J., Finch, A., Okiishi, J., & Burlingame, G. (2005). Administration and scoring manual for the OQ-10.2. OQ Measures, LLC.
Lutz, W., Rubel, J., Deisenhofer, A. K., & Moggia, D. (2022). Continuous outcome measurement in modern data-informed psychotherapies. World Psychiatry, 21(2), 215-216. https://doi.org/10.1002/wps.20988
McAleavey, A., A., & Moltu, C. (2021). Understanding routine outcome monitoring and clinical feedback in context: introduction to the special section. Psychotherapy Research, 31(2), 142-144. https://doi.org/10.1080/10503307.2020.1866786
Moksnes, U. K., & Reidunsdatter, R. J. (2019). Self-esteem and mental health in adolescents: level and stability during a school year. Norsk Epidemiologi, 28(1-2), 59-67. https://doi.org/10.5324/nje.v28i1-2.3052
Muir, H. J., Coyne, A. E., Morrison, N. R., Boswell, J. F., & Constantino, M. J. (2019). Ethical implications of routine outcomes monitoring for patients, psychotherapists, and mental health care systems. Psychotherapy, 56(4), 459-469. https://doi.org/10.1037/pst0000246
Oliveira, J. T., Faustino, D., Machado, P., Ribeiro, E., Gonçalves, S., & Gonçalves, M. (2021). Sudden gains and ambivalence in the unified protocol for transdiagnostic treatment of emotional disorder. International Journal of Cognitive Therapy, 14, 592-611. https://doi.org/10.1007/s41811-021-00106-w
Park, C., Majeed, A., Gill, H., Tamura, J., Ho, R. C., Mansur, R. B., Nasri, F., Lee, Y., Rosenblat, J. D., Wong, E., & McIntyre, R. S. (2020). The effect of loneliness on distinct health outcomes: a comprehensive review and meta-analysis. Psychiatry Research, 294, e113514. https://doi.org/10.1016/j.psychres.2020.113514
Pasquali, L. (2010). Testes referentes a construto: teoria e modelo de construção. In L. Pasquali (Org.), Instrumentação psicológica: fundamentos e práticas (pp. 165-198). Artmed.
Pilgrim, D. (2017). Key concepts in mental health. Sage Publications Ltd.
Preece, D. A., Goldenberg, A., Becerra, R., Boyes, M., Hasking, P., & Gross, J. J. (2021). Loneliness and emotion regulation. Personality and Individual Differences, 180, e110974. https://doi.org/10.1016/j.paid.2021.110974
Revelle, W. (n.d.). psych: procedures for psychological, psychometric, and personality research (Version 2.0.8). Northwestern University. https://CRAN.R-project.org/package=psych
Robinaug, D. J., Millner, A. J., & McNally, R. J. (2016). Identifying highly influential nodes in the complicated grief network. Journal of Abnormal Psychology, 125(6), 747-757. https://doi.org/10.1037/abn0000181
Seelert, K. R., Hill, R. D., Rigdon, M. A., & Schwenzfeier, E. (1999). Measuring patient distress in primary care. Clinical Research and Methods, 31(7), 483-487.
Soares, A. F., Gutierrez, D. M. D., & Resende, G. C. (2020). A satisfação com a vida, o bem-estar subjetivo e o bem-estar psicológico em estudos com pessoas idosas. GIGAPP Estudios Working Papers, 7(150-165), 275-291. http://www.gigapp.org/ewp/index.php/GIGAPP-EWP/article/view/186
Solstad, S. M., Kleiven, G. S., Castonguay, L. G., &Moltu, C. (2021). Clinical dilemmas of routine outcome monitoring and clinical feedback: a qualitative study of patient experiences. Psychotherapy Research, 31(2), 200-210, https://doi.org/10.1080/10503307.2020.1788741
Timmerman, M. E., & Lorenzo-Seva, U. (2011). Dimensionality assessment of ordered polytomous items with parallel analysis. Psychological Methods, 16(2), 209-220. https://doi.org/10.1037/a0023353
Vignola, R. C. B., & Tucci, A. M. (2014). Adaptation and validation of the depression, anxiety and stress scale (DASS) to Brazilian Portuguese. Journal of Affective Disorders, 155, 104-109. https://doi.org/10.1016/j.jad.2013.10.031
Wild, D., Grove, A., Martin, M., Eremenco, S., McElroy, S., Verjee-Lorenz, A., & Erikson, P. (2005). Principles of good practice for the translation and cultural adaptation process for Patient-Reported Outcomes (PRO) measures: report of the ISPOR task force for translation and cultural adaptation. Value in Health, 8(2), 94-104. https://doi.org/10.1111/j.1524-4733.2005.04054.x
Yang, Z., Algesheimer, R., & Tessone, C. J. (2016). A comparative analysis of community detection algorithms on artificial networks. Scientific Reports, 6, e30750. https://doi.org/10.1038/srep30750
Zuanazzi, A. C., Moreira, T., Queluz, F., & Villemor-Amaral, A. (2021). Avaliação do processo psicoterápico: levantamento de técnicas e instrumentos. Revista Interinstitucional de Psicologia, 14, 1-19. https://dx.doi.org/10.36298/gerais202114e17196
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Julia Macedo Salvador, Carolina Saraiva de Macedo Lisboa, Wagner de Lara Machado
This work is licensed under a Creative Commons Attribution 4.0 International License.
