Current issue
Archive
About the Journal
About us
Aims and Scope
Indexing and Abstracting
Editorial Office
Open Access Policy
Publication Ethics
Contact
For Authors
Editorial Policy
Peer Review Policy
Manuscript Preparation Guidelines
Copyright & Licensing
Publication Fees
Fast-Track Paper Publication Option
Conflict Interest Guidance
Submit an Article
Special Issues
News & Editorials
“Fake,” “Predatory,” and “Pseudo” Journals: Charlatans Threatening Trust in Science
Shifting the Journal submission-review system to the Editorial System Manuscript December 27, 2017.
ORIGINAL ARTICLE
Psychometric evidence of a new short version in Spanish of the COVID-19 impact scale: A study based on confirmatory factor analysis, graded response model, multigroup analysis, and path analysis
1
Facultad de Ciencias de la Salud, Universidad Privada del Norte, Lima, PERU
2
South American Center for Education and Research in Public Health, Universidad Norbert Wiener, Lima, PERU
3
Universidad Norbert Wiener, Lima, PERU
4
Facultad de Psicología, Universidad Peruana de Ciencias Aplicadas, Lima, PERU
5
Departamento de Psicología, Facultad de Ciencias de la Salud, Universidad Católica del Maule, Talca, CHILE
6
Pontificia Universidade Católica de Minas Gerais, Minas Gerais, BRAZIL
7
Consejo Nacional de Investigaciones Científicas y Técnicas, Buenos Aires, ARGENTINA
8
Investigación Avances en Investigación Psicológica, Universidad San Ignacio de Loyola, Lima, PERU
9
Escuela de Psicología, Universidad César Vallejo, Trujillo, PERU
Publication date: 2022-08-20
Electron J Gen Med 2022;19(6):em407
KEYWORDS
ABSTRACT
The aim of the study was to translate and evaluate the psychometric evidence of the Spanish version of the COVID-19 impact scale in the general population of Peru, to measure psychological stress responses produced by the COVID-19 pandemic, including emotional responses and difficulty in performing activities of daily living. Participants were 601 Peruvians, who responded to an online survey consisting of questions designed to collect sociodemographic data, the CIS and the fear of COVID-19 scale. The forward and backward translation method was used to translate the English version into Spanish. A confirmatory factor analysis (CFA), graded response model was used to estimate the discrimination (a) and difficulty (b) parameters of the items. Multi-group CFA was used to assess measurement invariance. Regarding validity based on the validity in relation to other variables, an explanatory model was proposed using the SEM path method. The unidimensional structure of the 10-item CIS was not confirmed. Therefore, it was suggested that a six-item model of the CIS (CIS-6) provides a better fit and reliable score. The multigroup CFA showed that the CIS-6 does not exhibit measurement invariance between males and females. In addition, the CIS-6 items present adequate discrimination and difficulty indices. A higher presence of the latent trait (in this case, perception of the impact of COVID-19) is required to answer the higher response categories. The findings would help to assess those individuals more prone to the impact of the COVID-19 pandemic and to have evidence for the development of interventions aimed at decreasing the impact.
REFERENCES (77)
1.
Fiore E, Corbellini C, Acucella L, et al. Musculoskeletal pain related to COVID-19 survivors after hospitalization: A short review. Retos. 2022;44:789-95. https://doi.org/10.47197/retos....
2.
O’Brien N, Barboza-Palomino M, Ventura-León J, et al. Coronavirus disease (COVID-19). A bibliometric analysis. Rev Chil Anest. 2020;49(3):408-15. https://doi.org/10.25237/revch....
3.
Sánchez Romero EA, Martínez Rolando L, Villafañe JH. Impact of lockdown on patients with fibromyalgia. Electron J Gen Med. 2022;19(3):em366. https://doi.org/10.29333/ejgm/....
4.
Belkin G, Appleton S, Langlois K. Reimagining mental health systems post COVID-19. Lancet Planet Health. 2021;5(4):e181-2. https://doi.org/10.1016/S2542-....
5.
Tandon R. COVID-19 and mental health: preserving humanity, maintaining sanity, and promoting health. Asian J Psychiatr. 2020;51:102256. https://doi.org/10.1016/j.ajp.... PMid:32586624 PMCid:PMC7305748.
6.
Galea S, Merchant RM, Lurie N. The mental health consequences of COVID-19 and physical distancing: the need for prevention and early intervention. JAMA Intern Med. 2020;180(6):817-8. https://doi.org/10.1001/jamain... PMid:32275292.
7.
Ransing R, Adiukwu F, Pereira-Sanchez V, et al. Mental health interventions during the COVID-19 pandemic: A conceptual framework by early career psychiatrists. Asian J Psychiatr. 2020;51:102085. https://doi.org/10.1016/j.ajp.... PMid:32413616 PMCid:PMC7195073.
8.
Ren FF, Guo RJ. Public mental health in post-COVID-19 era. Psychiatr Danub. 2020;32(2):251-5. https://doi.org/10.24869/psyd.... PMid:32796794.
9.
Robinson E, Sutin AR, Daly M, Jones A. A systematic review and meta-analysis of longitudinal cohort studies comparing mental health before versus during the COVID-19 pandemic in 2020. J Affect Disord. 2022;296:567-76. https://doi.org/10.1016/j.jad.... PMid:34600966 PMCid:PMC8578001.
10.
O’Donnell J, Cárdenas D, Orazani N, Evans A, Reynolds KJ. The longitudinal effect of COVID-19 infections and lockdown on mental health and the protective effect of neighbourhood social relations. Soc Sci Med. 2022;297:114821. https://doi.org/10.1016/j.socs... PMid:35219050 PMCid:PMC8847081.
11.
Ahorsu DK, Lin CY, Imani V, Saffari M, Griffiths MD, Pakpour AH. The fear of COVID-19 scale: Development and initial validation. Int J Ment Health Addict. 2020;1-9. https://doi.org/10.1007/s11469... PMid:32226353 PMCid:PMC7100496.
12.
Lee SA. Coronavirus anxiety scale: A brief mental health screener for COVID-19 related anxiety. Death Stud. 2020;44(7):393-401. https://doi.org/10.1080/074811... PMid:32299304.
13.
Taylor S, Landry CA, Paluszek MM, Fergus TA, McKay D, Asmundson GJ. Development and initial validation of the COVID-19 stress scales. J Anxiety Disord. 2020;72:102232. https://doi.org/10.1016/j.janx... PMid:32408047 PMCid:PMC7198206.
14.
Lee SA, Neimeyer RA. Pandemic grief scale: A screening tool for dysfunctional grief due to a COVID-19 loss. Death Stud. 2022;46(1):14-24. https://doi.org/10.1080/074811... PMid:33349159.
15.
Arpaci I, Karatas K, Baloglu M. The development and initial tests for the psychometric properties of the COVID-19 phobia scale (C19P-S). Pers Individ Dif. 2020;164:110108. https://doi.org/10.1016/j.paid... PMid:32394993 PMCid:PMC7211675.
16.
Caycho-Rodríguez T, Vilca LW, Vivanco-Vidal A, et al. Assessment of dysfunctional grief due to death from COVID-19 in Peru: Adaptation and validation of a Spanish version of the pandemic grief scale. Trends Psychol. 2021;29(4):595-616. https://doi.org/10.1007/s43076... PMCid:PMC8279032.
17.
Caycho-Rodríguez T, Tomás JM, Barboza-Palomino M, et al. Assessment of fear of COVID-19 in older adults: Validation of the fear of COVID-19 scale. Int J Ment Health Addict. 2022;20(2):1231-45. https://doi.org/10.1007/s11469... PMid:33432265 PMCid:PMC7787591.
18.
Caycho-Rodríguez T, Vilca LW, Carbajal-León C, et al. Coronavirus anxiety scale: New psychometric evidence for the Spanish version based on CFA and IRT models in a Peruvian sample. Death Stud. 2022;46(5):1090-9. https://doi.org/10.1080/074811... PMid:33427098.
19.
Noe-Grijalva M, Polo-Ambrocio A, Gómez-Bedia K, Caycho-Rodríguez T. Spanish translation and validation of the COVID stress scales in Peru. Front Psychol. 2022;13:840302. https://doi.org/10.3389/fpsyg.... PMid:35418905 PMCid:PMC8995497.
20.
Min H, Kim J, Moon K, Lee S, Kim JY, Ko YG. Development and validation of COVID-19 impact scale. BMC Psychol. 2022;10(1):1-10. https://doi.org/10.1186/s40359... PMid:35379349 PMCid:PMC8978488.
21.
Petrillo J, Cano SJ, McLeod LD, Coon CD. Using classical test theory, item response theory, and Rasch measurement theory to evaluate patient-reported outcome measures: A comparison of worked examples. Value Health. 2015;18(1):25-34. https://doi.org/10.1016/j.jval... PMid:25595231.
22.
Steinberg L, Thissen D. Item response theory. In Comer JS, Kendall PC, editors. The Oxford handbook of research strategies for clinical psychology. Oxford University Press; 2013, p. 336-73. https://doi.org/10.1093/oxford....
23.
Van der Linden WJ, Hambleton RK. Handbook of modern item response theory. New York: Springer-Verlag; 1997. https://doi.org/10.1007/978-1-....
24.
Jabrayilov R, Emons WH, Sijtsma K. Comparison of classical test theory and item response theory in individual change assessment. Appl Psychol Meas. 2016;40(8):559-72. https://doi.org/10.1177/014662... PMid:29881070 PMCid:PMC5978722.
25.
Hernández A, Hidalgo MD, Hambleton RK, Gómez Benito J. International test commission guidelines for test adaptation: A criterion checklist. Psicothema. 2020;32(3):390-8. https://doi.org/10.7334/psicot....
26.
Brown TA. Confirmatory factor analysis for applied research. New York, NY: Guilford Press; 2015.
27.
Gregorich SE. Do self-report instruments allow meaningful comparisons across diverse population groups? Testing measurement invariance using the confirmatory factor analysis framework. Med Care. 2006;44(11 Suppl 3):S78-94. https://doi.org/10.1097/01.mlr... PMid:17060839 PMCid:PMC1808350.
28.
Van de Schoot R, Lugtig P, Hox J. A checklist for testing measurement invariance. Eur J Dev Psychol. 2012;9(4):486-92. https://doi.org/10.1080/174056....
29.
Gibson B, Schneider J, Talamonti D, Forshaw M. The impact of inequality on mental health outcomes during the COVID-19 pandemic: A systematic review. Can Psychol. 2021;62(1):101-26. https://doi.org/10.1037/cap000....
30.
Xiong J, Lipsitz O, Nasri F, et al. Impact of COVID-19 pandemic on mental health in the general population: A systematic review. J Affect Disord. 2020;277:55-64. https://doi.org/10.1016/j.jad.... PMid:32799105 PMCid:PMC7413844.
31.
VanVoorhis CW, Morgan BL. Understanding power and rules of thumb for determining sample sizes. Tutor Quant Methods Psychol. 2007;3(2):43-50. https://doi.org/10.20982/tqmp.....
32.
De Ayala RJ. The influence of multidimensionality on the graded response model. Appl Psychol Meas. 1994;18(2):155-70. https://doi.org/10.1177/014662....
33.
Tabachnick BG, Fidell LS. Using multivariate statistics. Boston: Allyn and Bacon; 2001.
34.
Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000;25(24):3186-91. https://doi.org/10.1097/000076... PMid:11124735.
35.
Caycho-Rodríguez T, Valencia PD, Vilca LW, et al. Cross-cultural measurement invariance of the fear of COVID-19 scale in seven Latin American countries. Death Stud. 2021;1-15. https://doi.org/10.1080/074811... PMid:33560185.
36.
Li CH. Confirmatory factor analysis with ordinal data: Comparing robust maximum likelihood and diagonally weighted least squares. Behav Res Methods. 2016;48(3):936-49. https://doi.org/10.3758/s13428... PMid:26174714.
37.
Kline RB. Principles and practice of structural equation modeling. The Guilford Press; 2015.
38.
Schumacker RE, Lomax RG. A beginner’s guide to structural equation modeling: Fourth edition. Routledge; 2015. https://doi.org/10.4324/978131....
39.
Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16(3):297-334. https://doi.org/10.1007/BF0231....
41.
Raykov T, Hancock GR. Examining change in maximal reliability for multiple-component measuring instruments. Br J Math Stat Psychol. 2005;58(1):65-82. https://doi.org/10.1348/000711... PMid:15969840.
42.
Samejima F. Graded response model. In van der Linden WJ, Hambleton RK, editors. Handbook of modern item response theory. New York: Springer; 1997; p. 85-100. https://doi.org/https://doi.or....
43.
Hambleton RK, van der Linden WJ, Wells CS. IRT models for the analysis of polytomously scored data: Brief and selected history of model building advances. In Nering ML, Ostini R, editors. Handbook of polytomous item response theory models. New York: Routledge; 2010; p. 21-42.
44.
Cai L, Monroe S. A new statistic for evaluating item response theory models for ordinal data. 2014. Available at: https://doi.org/10.4324/978113... (Accessed: 15 June 2022).
45.
Maydeu-Olivares A, Joe H. Assessing approximate fit in categorical data analysis. Multivariate Behav Res. 2014;49(4):305-28. https://doi.org/10.1080/002731... PMid:26765800.
46.
Cai L, Chung SW, Lee T. Incremental model fit assessment in the case of categorical data: Tucker-Lewis index for item response theory modeling. Prev Sci. 2021;1-12. https://doi.org/10.1007/s11121... PMid:33970410.
47.
Lubbe D, Schuster C. A graded response model framework for questionnaires with uniform response formats. Appl Psychol Meas. 2019;43(4):290-302. https://doi.org/10.1177/014662... PMid:31156281 PMCid:PMC6512163.
48.
Chen FF. Sensitivity of goodness of fit indexes to lack of measurement invariance. Struct Equ Modeling. 2007;14(3):464-504. https://doi.org/10.1080/107055....
49.
Rosseel Y. lavaan: An R package for structural equation modeling. J Stat Softw. 2012;48(2):1-36. https://doi.org/10.18637/jss.v....
50.
Jorgensen TD, Pornprasertmanit S, Schoemann AM, Rosseel Y. semTools: Useful tools for structural equation modeling. R package version 0.5-1; 2018. Available at: https://cran.r-project.org/pac... (Accessed: 15 June 2022).
51.
Chalmers RP. Mirt: A multidimensional item response theory package for the R environment. J Stat Softw. 2012;48(6):1-29. https://doi.org/10.18637/jss.v....
52.
Finney SJ, DiStefano C. Nonnormal and categorical data in structural equation modeling. In Hancock GR, Mueller RO, editors. Structural equation modeling: A second course. IAP Information Age Publishing; 2013. p. 439-492.
53.
Yang Y, Green SB. A note on structural equation modeling estimates of reliability. Struct Equ Modeling. 2010;17(1):66-81. https://doi.org/10.1080/107055....
54.
Ransing R, Ramalho R, Orsolini L, et al. Can COVID-19 related mental health issues be measured? Brain Behav Immun. 2020;88:32-4. https://doi.org/10.1016/j.bbi.... PMid:32470593 PMCid:PMC7248629.
55.
Mahmud S, Mohsin M, Dewan M, Muyeed A. The global prevalence of depression, anxiety, stress, and insomnia among general population during COVID-19 pandemic: A systematic review and meta-analysis. Trends Psychol. 2022;1-28. https://doi.org/10.1007/s43076... PMCid:PMC8726528.
56.
Prieto-Molinaria DE, Bravo A, Gianella L, et al. Depresión y ansiedad durante el aislamiento obligatorio por el COVID-19 en Lima Metropolitana [Depression and anxiety during mandatory isolation by COVID-19 in Metropolitan Lima]. Liberabit. 2020;26(2):e425. https://doi.org/10.24265/liber....
57.
Virto-Farfan H, Ccahuana F, Bairo WL, et al. Estrés, ansiedad y depresión en la etapa inicial del aislamiento social por COVID-19, Cusco-Perú [Stress, anxiety, and depression in the initial stage of social isolation by COVID-19, Cusco-Peru]. Rev Cient Enferm. 2021;10(3):5-21.
58.
Arora T, Grey I, Östlundh L, Lam KBH, Omar OM, Arnone D. The prevalence of psychological consequences of COVID-19: A systematic review and meta-analysis of observational studies. J Health Psychol. 2022;27(4):805-24. https://doi.org/10.1177/135910... PMid:33118376.
59.
Cai H, Bai W, Liu H, et al. Network analysis of depressive and anxiety symptoms in adolescents during the later stage of the COVID-19 pandemic. Transl Psychiatry. 2022;12(1):1-8. https://doi.org/10.1038/s41398... PMid:35273161 PMCid:PMC8907388.
60.
Pietrabissa G, Simpson SG. Psychological consequences of social isolation during COVID-19 outbreak. Front Psychol. 2020;11:2201. https://doi.org/10.3389/fpsyg.... PMid:33013572 PMCid:PMC7513674.
61.
Kenny DA, Kaniskan B, McCoach DB. The performance of RMSEA in models with small degrees of freedom. Sociol Methods Res. 2015;44(3):486-507. https://doi.org/10.1177/004912....
62.
Taasoobshirazi G, Wang S. The performance of the SRMR, RMSEA, CFI, and TLI: An examination of sample size, path size, and degrees of freedom. J Appl Quant Methods. 2016;11(3):31-9. Available at: http://jaqm.ro/issues/volume-1... (Accessed: 15 June 2022).
63.
Hays RD, Morales LS, Reise SP. Item response theory and health outcomes measurement in the 21st century. Med Care. 2000;38(9 Suppl):II28-42. https://doi.org/10.1097/000056... PMid:10982088 PMCid:PMC1815384.
64.
Simsir Z, Koc H, Seki T, Griffiths MD. The relationship between fear of COVID-19 and mental health problems: A meta-analysis. Death Stud. 2022;46(3):515-23. https://doi.org/10.1080/074811... PMid:33641626.
65.
Caycho-Rodríguez T, Tomás JM, Vilca LW, et al. Socio-demographic variables, fear of CoViD-19, anxiety, and depression: prevalence, relationships and explanatory model in the general population of seven Latin American countries. Front Psychol. 2021;12:4980. https://doi.org/10.3389/fpsyg.... PMid:34803794 PMCid:PMC8602858.
66.
Satici B, Gocet-Tekin E, Deniz M, Satici SA. Adaptation of the fear of COVID-19 scale: Its association with psychological distress and life satisfaction in Turkey. Int J Ment Health Addict. 2021;19(6): 1980-8. https://doi.org/10.1007/s11469... PMid:32395095 PMCid:PMC7207987.
67.
Shigemura J, Ursano RJ, Morganstein JC, Kurosawa M, Benedek DM. Public responses to the novel 2019 coronavirus (2019‐nCoV) in Japan: Mental health consequences and target populations. Psychiatry Clin Neurosci. 2020;74(4):281-2. https://doi.org/10.1111/pcn.12... PMid:32034840 PMCid:PMC7168047.
68.
Zandifar A, Badrfam R. Iranian mental health during the COVID-19 epidemic. Asian J Psychiatr. 2020;51:101990. https://doi.org/10.1016/j.ajp.... PMid:32163908 PMCid:PMC7128485.
69.
Andrade EF, Pereira LJ, Oliveira APLD, et al. Perceived fear of COVID-19 infection according to sex, age and occupational risk using the Brazilian version of the fear of COVID-19 scale. Death Stud. 2022;46(3):533-42. https://doi.org/10.1080/074811... PMid:32845795.
70.
Broche-Pérez Y, Fernández-Fleites Z, Jiménez-Puig E, Fernández-Castillo E, Rodríguez-Martin BC. Gender and fear of COVID-19 in a Cuban population sample. Int J Ment Health Addict. 2020;1-9. https://doi.org/10.1007/s11469... PMid:32837428 PMCid:PMC7292241.
71.
Liu N, Zhang F, Wei C, et al. Prevalence and predictors of PTSS during COVID-19 outbreak in China hardest-hit areas: Gender differences matter. Psychiatry Res. 2020;287:112921. https://doi.org/10.1016/j.psyc... PMid:32240896 PMCid:PMC7102622.
72.
McLean CP, Anderson ER. Brave men and timid women? A review of the gender differences in fear and anxiety. Clin Psychol Rev. 2009;29(6):496-505. https://doi.org/10.1016/j.cpr.... PMid:19541399.
73.
Alsharawy A, Spoon R, Smith A, Ball S. Gender differences in fear and risk perception during the COVID-19 pandemic. Front Psychol. 2021;12:689467. https://doi.org/10.3389/fpsyg.... PMid:34421741 PMCid:PMC8375576.
74.
Bitan DT, Grossman-Giron A, Bloch Y, Mayer Y, Shiffman N, Mendlovic S. Fear of COVID-19 scale: Psychometric characteristics, reliability and validity in the Israeli population. Psychiatry Res. 2020;289:113100. https://doi.org/10.1016/j.psyc... PMCid:PMC7227556.
75.
Kocak O, Kocak OE, Younis MZ. The psychological consequences of COVID-19 fear and the moderator effects of individuals’ underlying illness and witnessing infected friends and family. Int J Environ Res Public Health. 2021;18(4):1836. https://doi.org/10.3390/ijerph... PMid:33668655 PMCid:PMC7917729.
76.
Mertens G, Gerritsen L, Duijndam S, Salemink E, Engelhard IM. Fear of the coronavirus (COVID-19): Predictors in an online study conducted in March 2020. J Anxiety Disord. 2020;74:102258. https://doi.org/10.1016/j.janx... PMid:32569905 PMCid:PMC7286280.
77.
Taylor SE, Stanton AL. Coping resources, coping processes, and mental health. Annu Rev Clin Psychol. 2007;3:377-401. https://doi.org/10.1146/annure... PMid:17716061.
| eISSN: | 2516-3507 |
We process personal data collected when visiting the website. The function of obtaining information about users and their behavior is carried out by voluntarily entered information in forms and saving cookies in end devices. Data, including cookies, are used to provide services, improve the user experience and to analyze the traffic in accordance with the Privacy policy. Data are also collected and processed by Google Analytics tool (more).
You can change cookies settings in your browser. Restricted use of cookies in the browser configuration may affect some functionalities of the website.
You can change cookies settings in your browser. Restricted use of cookies in the browser configuration may affect some functionalities of the website.
