Stress and worry in the 2020 coronavirus pandemic: relationships to trust and compliance with preventive measures across 48 countries in the COVIDiSTRESS global survey
Abstract
The COVIDiSTRESS global survey collects data on early human responses to the 2020 COVID-19 pandemic from 173 429 respondents in 48 countries. The open science study was co-designed by an international consortium of researchers to investigate how psychological responses differ across countries and cultures, and how this has impacted behaviour, coping and trust in government efforts to slow the spread of the virus. Starting in March 2020, COVIDiSTRESS leveraged the convenience of unpaid online recruitment to generate public data. The objective of the present analysis is to understand relationships between psychological responses in the early months of global coronavirus restrictions and help understand how different government measures succeed or fail in changing public behaviour. There were variations between and within countries. Although Western Europeans registered as more concerned over COVID-19, more stressed, and having slightly more trust in the governments' efforts, there was no clear geographical pattern in compliance with behavioural measures. Detailed plots illustrating between-countries differences are provided. Using both traditional and Bayesian analyses, we found that individuals who worried about getting sick worked harder to protect themselves and others. However, concern about the coronavirus itself did not account for all of the variances in experienced stress during the early months of COVID-19 restrictions. More alarmingly, such stress was associated with less compliance. Further, those most concerned over the coronavirus trusted in government measures primarily where policies were strict. While concern over a disease is a source of mental distress, other factors including strictness of protective measures, social support and personal lockdown conditions must also be taken into consideration to fully appreciate the psychological impact of COVID-19 and to understand why some people fail to follow behavioural guidelines intended to protect themselves and others from infection. The Stage 1 manuscript associated with this submission received in-principle acceptance (IPA) on 18 May 2020. Following IPA, the accepted Stage 1 version of the manuscript was preregistered on the Open Science Framework at https://osf.io/ytbcs. This preregistration was performed prior to data analysis.
1. Background and research questions
This registered report (RR) presents the COVIDiSTRESS global survey, which collects early data on human responses to the 2020 COVID-19 pandemic (caused by the coronavirus SARS-CoV-2) in 48 countries. This open science study was co-designed by researchers from numerous universities across the world (for a full list of universities, see §2; for a full list of consortium co-authors, see electronic supplementary material, co-authorship statement and appendix) to investigate how psychological and behavioural responses to the COVID-19 pandemic differed across countries and cultures, and how this impacted social behaviour, coping and trust in government efforts to slow the spread of the coronavirus.
Global data gathering efforts like the COVIDiSTRESS project are of pressing importance during the COVID-19 crisis, in order to understand how different government measures succeed or fail in achieving objectives to change public behaviour. By generating data rapidly, and disseminating them continuously as open data on the Open Science Framework (OSF), the international research network behind the COVIDiSTRESS project aims to yield rapid insights for the use of practitioners such as health communicators, government officials and policy makers at all levels, as well as members of the academic community. Currently, there are many psychologists and social scientists making a great effort to better understand the psychological effects and implications of the COVID-19 pandemic (e.g. [1–3]) and provide suggestions for practitioners (e.g. [4–6]). To our knowledge, there is currently no other project comparing human responses to COVID-19 across such a large number of countries. Further, the COVIDiSTRESS project specifically attempted to leverage the convenience of unpaid online populations to quickly acquire a large number of responses from 48 countries by using a snowball sample via online and traditional media platforms, rather than pre-specified samples from paid subject pools.
-
1. What is the impact of psychological stress on trust in and compliance with government efforts to prevent COVID-19 compared across countries?
-
2. To what degree is psychological stress related to concerns over COVID-19 itself, and what proportion of the variance in psychological stress can be explained by other factors?
In early 2020, the COVID-19 pandemic quickly became a matter of serious concern for public health throughout the global community. To prevent the spread of coronavirus, governments imposed a range of measures, which included quarantines, physical distancing and limits to civil liberties. Inevitably, these changes have generated a variety of psychological responses [8], which in turn shape the level of compliance with preventive efforts. Extant research on the factors that shape willingness to comply with public health efforts has highlighted the importance of psychological responses such as anxiety and risk aversion [9–11] as well as trust in state authorities [12–14]. A recent study on risk and compliance during the COVID-19 pandemic in Singapore found that high levels of trust in the government led to lower risk perception and non-compliance with preventive measures [11]. Along the same lines, a study on the implications of COVID-19 in New Zealand found an increase in levels of institutional trust in the early stages of the lockdown pointing to the rally-round-the-flag effect [2]. This varied body of findings clearly signifies the urgent need for further exploration of the psychological mechanisms at play that shape responses to preventive measures.
Not only do pandemics foster a fear of contagion, but also misinformation, uncertainty and the lack of clarity about how to react [15,16]. Concern over a disease outbreak has typically been found to be positively correlated with preventive behaviours or compliance with health guidelines [17–19]. However, this relationship is complex; worry, for instance, has been found to be related to trust in disease-related information and media [20–22], the perception of openness and reliability of governments and health organizations [23].
Concern over one's medical risk during a pandemic can also be a source of ongoing stress (e.g. in H1N1, [24]; in MERS, [22]). For instance, stress was widespread during the 2003 SARS epidemic [25,26]. This relationship is potentially exacerbated by the fact that even some of the most efficient methods of slowing the spread of a disease, such as self-isolation and quarantine, also take an immediate and potentially long-lasting psychological toll among affected populations [8,27,28]. Surveys of quarantined healthcare workers [29] and members of the general population [30] following the 2003 SARS outbreak found evidence of acute stress responses in cases with a longer duration of quarantine and greater perceived difficulty in compliance with recommendations. Similarly, studies of patient groups typically find a negative relationship between experienced stress and compliance with prescribed behaviours, often with direct medical consequences [31–33], and this correlation has been extended to compliance with measures intended to minimize the spread of virulent disease [34].
Both the medical situation and the psychological effects of isolation and confinement [35,36] thus need to be taken into consideration when prolonged periods of quarantine are implemented, in order to understand the acceptance of government measures and compliance with preventive measures. Compliance with medical guidelines has been shown to decrease not just as a result of heightened stress levels [37], but also of minor everyday stressors such as workplace conflict or household responsibilities [38]. Efforts such as closing down schools and workplaces and calls for people to self-isolate in their homes are likely to constitute a source of both existential and practical stress, unrelated to the fear of contracting the disease. For instance, some stress is known to result from an inability to participate in work or from interpersonal problems in the family [39,40]. Moreover, a pandemic may also exacerbate existing financial precarity, generating another source of stress for those experiencing financial hardship [10]. Prolonged states of emergency and the chronic psychological, social and economic stressors related to them [8,27] may decrease compliance with behavioural objectives during pandemics. Sources of stress and worry may thus have direct implications not simply for well-being, but also for the effectiveness of collective efforts and the degree of public compliance with self-isolation measures. For this reason, we tested the hypotheses that stress and concern over the coronavirus will be adversely correlated with compliance and preventive behavioural measures suggested in each country.
In sum, it seems that worry, trust and situational stress are associated with each other and jointly influence behaviour during pandemics. It is thus an interesting question whether the known negative relationship between stress and compliance apply to the population at large, especially since, for example, physical distancing measures and hand-washing are recommended to protect not only the individual in question, but also other people in their surroundings. The extent of compliance with preventive measures has repeatedly been found to be influenced by the perceived gravity of the pandemic, as well as trust in the preventive measures against it [18,24,41,42]. Thus, we also expected that trust in the preventive measures taken in each country will lead to better compliance and less worry over the COVID-19 medical situation.
In this context, it is also worth investigating what factors may alleviate perceived stress, and thus, positively impact not just well-being, but also the likelihood of acceptance and compliance with behavioural guidelines. Social and practical support from groups such as one's family, friends and colleagues can moderate the effect of concern for the disease or other sources of stress on one's psychological well-being [43,44]. Indeed, interpersonal communication has been shown to affect the relationship between risk perception and actual behaviour during health crises, where mass media messages may fall short [45]. Various theoretical dimensions of social support, including social integration and reassurance of worth [46] are captured by the Social Provisions Scale (SPS) and its shorter versions (SPS-10; [47]). According to the stress-buffering hypothesis [48], social support through, for example, interpersonal communication buffers people from other negative consequences of distressing events. For instance, those who were ‘isolated but not lonely' [3] might be less susceptible to negative effects of isolation or other stressors related to a pandemic by maintaining strong social contacts while physically distanced. Further, social support could promote less threatening interpretations of stressful situations [47,49], and thus, possibly more positive appraisals of institutional and governmental efforts to stop the spread of a pandemic. Empirical evidence shows that perceived social support has helped build up resilience against disaster or catastrophic events, and exerts its protective function on alleviating psychological distress [50]. Furthermore, social support has been found to correlate positively with compliance in patient populations [51].
It is thus reasonable to investigate if we can extend the previous findings related to the stress-buffering hypothesis to the context of acceptance and compliance with behavioural guidelines during the pandemic. Here, we explored the relationship between experienced stress and trust in the efforts and behavourial guidelines set up by governments to curb the spread of COVID-19, as well as in relation to social provisions. In particular, we hypothesized that social provisions would negatively moderate the negative effect of stress on compliance with behavioural objectives during the pandemic.
So far, little is known about the cross-national differences in reactions to preventive measures during the 2020 pandemic. However, cross-cultural differences have been observed in responding to stressors [52,53] and to various countermeasures against pandemic outbreaks [54]. Further, it has been suggested that cultural variables such as the degree of collectivism, or social ‘tightness', may lead to different attitudes regarding compliance with social norms [3], and one study observed that cultural differences in relational mobility, or the perceived easiness to engage with strangers and freely choose friends, was associated with the spread of COVID-19 [55]. Thus, optimal institutional responses to the COVID-19 crisis may require culturally and situationally appropriate public health interventions, both to alleviate human distress and to communicate the need for preventive measures in an effective manner. In the present study, we took a multilevel analytic approach with individual responses nested within each country in order to estimate the variability in various dependent variables (DVs) residing at both individual and country levels [56]. By taking into consideration non-independence among individual responses within a country, as well as the differences between countries, we can better assess the extent to which individual-level variables measured in the present study explain variance in various criterion variables at the individual level and country level, respectively.
2. Methods
A global survey study was conducted with the purpose of mapping the psychological and behavioural responses to the COVID-19 pandemic across countries, and how these have impacted social behaviour and trust in government efforts to slow the spread of the coronavirus.
The COVIDiSTRESS survey (COVIDiSTRESS global survey network, 2020—available at https://osf.io/z39us/) consists of two parts. The first part collected general demographic data including proximate effects of the COVID-19 pandemic (e.g. isolation status, first-hand experience, attenuated risk), personality traits and self-reported variables, such as loneliness and perceived stress [57], daily behaviours including compliance with general and social preventive measures. The second part contains sets of more specific items related to distress, coping and social provisions. Firstly, we inquired about people's experiences of distress and worry during the ongoing outbreak of coronavirus, e.g. access to amenities, loss of work, adapting work, education and social interactions on digital platforms, the social stresses of confinement with adults and children. We also asked questions about the factors people experience as soothing and positive to coping (e.g. social contact, staying informed, dedicating oneself to preparation, hobbies, religion) and also included the Social Provisions Scale (SPS; [47]). Validated short versions of established measures were used whenever possible and available in local languages. In order to protect participants' data and avoid sensitive information, participants were not asked about COVID-19 symptoms or other data with direct medical implications that would allow third-parties to identify them.
Translations were completed for 46 languages and locations (Afrikaans, Albanian, Arabic, Bangla, Indonesian, Bosnian, Bulgarian, Chinese [Simplified and Traditional], Croatian, Czech, Danish, Dutch [Belgium, Netherlands], English, Spanish [Argentina, Colombia, Cuba, Mexico, Spain], Filipino, Finnish, French, German, Greek [Greece and Cyprus], Hebrew, Hindi, Hungarian, isiXhosa, isiZulu, Italian, Japanese, Korean, Lithuanian, Nepali, Persian, Polish, Portuguese [Brazil, Portugal], Romanian, Russian, Slovakian, Serbian, Turkish, Urdu, Vietnamese) with the possibility for more translations in future waves. Translations were completed by a forward translator from the original English version and then validated through both panel and back-translation process by separate translators when possible.
Given the urgent call for COVID-19 research, the survey received a waiver to commence data collection from the IRB office at Aarhus University, Denmark, followed by formal approval in June 2020 (case number: 2019-616-000009). The survey and data extraction schedule was pre-registered at the Open Science Framework [58]. The full annotated dataset has also been published in Scientific Data [59].
3. Key independent and dependent variables
The COVIDiSTRESS global survey contains a number of variables (full survey at https://osf.io/z39us/). The Royal Society Open Science registration files including the in principle accepted stage one analysis protocol and electronic supplementary material are available at the Open Science Framework https://osf.io/vz73d/. The final version of the cleaned and preprocessed dataset is available at https://osf.io/cjxua/. This urgent call RR focuses on 10 hypotheses (see §§1 and 4) and comparisons between countries. Table 1 gives an overview of all variables relevant for our hypotheses.
variable name | description | measurement | remarks |
---|---|---|---|
independent and dependent variables | |||
[Scale_PSS10] | perceived stress for the past week | Perceived Stress scale (PSS-10). |
Cohen et al. [57] |
[OECD_insititutions] | trust in country's efforts to handle the coronavirus situation | On a scale of 0–10 (0 = not at all, 10 = completely), how much do you personally trust each of the institutions: ‘government's effort to handle |
|
[Corona_concerns] | concern over coronavirus | Five self-reported items to capture concerns about coronavirus consequences on a 6-point Likert scale (1 = strongly disagree, 6 = strongly agree): Concern about consequences of the coronavirus (1) … for yourself, (2) … for your family, (3) … for your close friends, (4) … for your country, (5) … for other countries across the globe. Mean score was computed. Continuous variable. | — |
[Compliance] | compliance with local prevention guidelines | Item ‘I have done everything I could possibly do as an individual, to reduce the spread of coronavirus’ captures compliance with local prevention guidelines on a 6-point Likert scale (1 = strongly disagree, 6 = strongly agree). Continuous variable. | — |
control variables (covariates) | |||
[age] | participants' age | Continuous variable. | — |
[gender] | participants' gender | 0 = male, 1 = female, 2 = other/would rather not say). |
— |
[education] | participants' education | 1 = PhD / doctorate, 2 = college degree, 3 = some college or equivalent, 4 = up to 12 years of school, 5 = up to 9 years of school, 6 = up to 6 years of school, 7 = none). |
— |
[country] | country of residence | List of all countries where the survey was disseminated/spread. Categorical variable (factor). | |
[SPS] | available social provisions in critical/distressing situations | Social Provisions scale short form SPS-10. 10 items. 6-point Likert scale (1 = strongly disagree, 6 = strongly agree). Validated language versions where available. Back-translated where necessary. Mean scores will be computed. Continuous variable. | Steigen & Bergh [47] |
[population_size]). |
country data | — Population size. |
4. Hypotheses
First, this RR was intended to draw a map of differences in the psychological impact of COVID-19, and the trust in government measures and compliance with preventive guidelines in the countries represented in the first data extraction on Monday, 6 April 2020 (see inclusion criteria in §6). We expected the COVIDiSTRESS global survey to show significant differences between countries.
— | H1a: Perceived stress will differ between countries. | ||||
— | H1b: Concern over the coronavirus will differ between countries. | ||||
— | H1c: Trust in government efforts to slow the spread of coronavirus will differ between countries. | ||||
— | H1d: Compliance with behavioural guidelines to slow the spread of coronavirus will differ between countries. |
Second, the present analyses focused on how both stress and concerns about the COVID-19 pandemic (e.g. isolation, changes in public life and worry over the virus itself) are related to compliance with preventive guidelines and trust in government efforts intended to reduce the spread of coronavirus. Compliance with behavioural guidelines:
— | H2a: Across countries, perceived stress will be negatively correlated with compliance to behavioural guidelines to slow the spread of coronavirus. | ||||
— | H2b: Across countries, concern over the coronavirus will be positively correlated with compliance to behavioural guidelines to slow the spread of coronavirus. |
— | H3a: Across countries, trust in government efforts to slow the spread of coronavirus will be negatively correlated with perceived stress. | ||||
— | H3b: Across countries, trust in government efforts to slow the spread of coronavirus will be negatively correlated with concern over the coronavirus. |
— | H4: Across countries, concern over the coronavirus will be a predictor of perceived stress. |
— | H5: Across countries, availability of social provisions will negatively moderate the effect of perceived stress over coronavirus on compliance with behavioural guidelines to slow the spread of coronavirus. |
5. Number of observations to be collected and rule of termination
Given that this large-scale COVIDiSTRESS survey was spread by numerous researchers all over the world, we had limited control over the total number of responses per country. Thus, we defined a set of stopping rules that are practically feasible.
Statistical power in multilevel design is rather complex and greatly depends on the nested structure of the data [67]. Therefore, a general rule of thumb (i.e. 30–30 rule; [68]) is unlikely to be applicable to our data structure. Thus, we sought to refer to a more specific guideline to plan sample sizes according to the estimates acquired from pre-existing databases.
Due to a lack of previous research that could be used for reasonable power analyses, we ran a planned multilevel analysis for H5 (specified in §9), as there was a dataset at hand, which we perceived as sufficiently suitable. We used the 2018 European Social Survey (ESS) database to estimate the effect sizes of fixed and random effects as well as intraclass coefficients (ICCs). The ESS database consists of 43 215 respondents from 23 European countries (on average 1878 respondents per country). Although the variables available in the ESS database are not identical to those in the COVIDiSTRESS survey, given their similarity in the underlying constructs, we used the health condition variable (a higher value indicating poorer health condition) and satisfaction about the government in the ESS data as proxies for stress, compliance and trust in government efforts for our original variables of interest, respectively. The ICC from the observed ESS data was 0.26, indicating that 26% of variability comes from between-country differences. Since random effects are often distorted while the variables are standardized, the random effects were estimated with grand-mean-centred continuous variables. The same multilevel analyses were run again with standardized variables only in order to obtain the standardized estimates of fixed effects. Standardized estimates of fixed effects of the individual-level predictor (individual's health condition: β = 0.09; social provisions: β = 0.21) and its country-level predictor (mean health condition in each country: βs = −0.35) were deemed to have small and medium effect sizes, respectively. Their cross-level interaction effects had only small effect sizes (βs = 0.03–0.10).
Subsequently, we referred to the guidelines from Arend & Schäfer [67], which provided a fast and frugal power estimation for each combination of effect size, the value of ICC, as well as the size of random slope variance. Based on Arend & Schäfer's Table 8 of power simulation results for required sample size and group size (in our case, the number of countries) to detect such effects with 80% statistical power (p. 17), we planned to recruit at least 30 participants per country so as to detect both the effects of individual- and country-level predictors. However, since our data collection process was still ongoing at the time of stage one submission, the potential number of group size and sample size were greater than we had initially reported in this section.
6. Inclusion criteria
All participating researchers received the same task of starting to distribute the survey in their language on 30 March, 2020 (exception: Denmark started on 26 March, 2020, see §7). All possible channels were allowed, e.g. social media, panels, e-mails to friends or organizations, use of media contacts such as the newspaper or TV, websites of organizations such as universities or NGOs involved in health communication. Moreover, we also asked all participants to help spread the survey after they finished their own responses.
Data was extracted each Monday and made available at the Open Science Framework. In order to be considered for the present analysis, however, a country needed at least 30 respondents at the time of acceptance of the RR stage 1 (i.e. the most recent data extracted at time of acceptance). In order to be considered as a valid participant for the present analyses, a respondent must have reported their country of residence and submitted valid responses to the variables treated in each analysis (see also §7).
7. Exclusion criteria
We defined exclusion criteria on the country and on the respondent level.
7.1. Country level
Active dissemination of the survey and calls for participation were carried out via online and traditional media platforms in Afghanistan, Argentina, Australia, Austria, Bangladesh, Belgium, Bosnia, Brazil, Bulgaria, Canada, China, Colombia, Croatia, Republic of Cyprus, Czech Republic, Denmark, Finland, France, Germany, Greece, India, Indonesia, Israel, Italy, Japan, South Korea, Lithuania, Malaysia, Mexico, The Netherlands, Pakistan, The Philippines, Poland, Portugal, Russia, Serbia, Singapore, South Africa, Spain, Switzerland, Taiwan, Turkey, United Kingdom, United States of America and Vietnam. Countries that failed to generate 30 respondents by the time of extraction were not included in the final dataset. Sections 5 and 9 provide a detailed justification for the exclusion of countries that did not reach 30 respondents. In short, 30 respondents per country was the minimal number of respondents required to ensure sufficient statistical power.
7.2. Individual level
On the individual level, the length of the survey can lead some participants to skip questions, but also give repetitive or unrepresentative answers (e.g. [69]), leading to misclassification of participants and responses that do not reflect real experience [70]. We employed the following exclusion measures to protect against these threats.
-
1. First, the predicted duration of the survey in Qualtrics was 22 min if all questions were answered and free text boxes were filled out. On that basis, we excluded all responses who completed the whole survey in less than 2 min and 12 s, equivalent to one-tenth of the estimated time.
-
2. Second, we used Mahalanobis distance to detect multivariate outliers due to random or carelessly invalid responses [71,72]. Participants with a p < 0.001 in the chi-square test were excluded.
8. Quality checks
Regarding quality checks, we checked for floor/ceiling effects within the following scales/item batteries: Perceived Stress Scale (PSS-10), Corona concerns, Compliance, SPS-10. We evaluated floor/ceiling effects on the base of the percentage of the respondents with the minimum/maximum scores. Therefore, we provided the percentage (%) and n for respondents with the minimum/maximum scores. Floor/ceiling effects will be considered as present if minimum/maximum scores occur in 15% or more of the respondents, following the previous recommended threshold (see [73]).
Furthermore, we tested the measurement invariance of the included scales: the PSS-10 (see [57,74]), Social Provisions Scale (SPS, short form of PSP-10; [47]) and coronavirus concerns (self-reported measure, constructed for the purpose of this study). The measurement invariance test was required since we wanted to compare scores measured by the aforementioned scales across different countries. Further details regarding the measurement invariance test procedures are described in the next section1. We implemented the examination of the equivalence of measures at the suggestion of a reviewer.
Given that the number of countries to be analysed directly influences the power of the planned multilevel modelling, we conducted the multilevel modelling analyses as follows:
-
1. If our planned analyses can be conducted without any issue (e.g. failed convergence) with the dataset that passed the measurement invariance test, then we would use composite scores and report the findings.
-
2. If 1 failed, then we would apply the alignment method and use aligned factor mean scores instead of composite scores for the planned analyses. If 1 failed and findings from 2 were reported, we would discuss limitations and caveats regarding the interpretation of the findings.
9. Analysis plan
9.1. Measurement invariance testing
We investigated the cross-cultural equivalence of the PSS-10 (see [57,74]), the SPS, short form of PSP-10 [47] and the coronavirus concern scale (self-reported measure, constructed for the purpose of this study) prior to any main analyses. Using a multi-group factor analysis, we compared the models assuming the one-factor structure for SPS and coronavirus concerns, and the two-factor structure for PSS-10 (positive and negative, with the latter consisting of reversed items; [75,76]) across all countries (configural invariance), with a model with factor loadings and latent correlations constrained to be equal (metric invariance), and items' intercepts to be the same in all groups (scalar invariance).
When evaluating the model fit, we relied on the usually applied criteria [77], in which a comparative fit index (CFI) and Tucker–Lewis index (TLI) above 0.90 would indicate adequate fit, whereas a standardized root mean square residual (SRMR) below 0.06, and a root mean square error of approximation (RMSEA) below 0.08 indicate no misfit. When evaluating the measurement equivalence, we compared the configural invariance model with the metric invariance model, and then the metric invariance model with the scalar invariance model [78]. As these models are characterized by a growing complexity (each subsequent model is nested within the previous one), while assessing models' superiority, we relied on cut-off criteria recommended for testing measurement invariance: a change of CFI less than 0.01 (ΔCFI < 0.01), a change of RMSEA of less than 0.015 (ΔRMSEA < 0.015) and a change of SRMR less than 0.01 (ΔSRMR < 0.01) indicating that two compared models do not differ in terms of model fit [79,80]. However, in the case that the equivalence of invariance was not achieved, based on recommendations indicating that partial invariance may allow for reasonable comparisons (see [81]), we also estimated models with partial invariance. If the equivalence of partial invariance was achieved, we proceeded with the cross-countries comparisons.
Nevertheless, considering the fact that even the equivalence of partial invariance is sometimes difficult to achieve when comparing numerous countries [82–84], we used the alignment method implemented in Mplus as an alternative [85]. After applying the alignment method, we used the adjusted factor mean scores that were produced by the alignment process for our planned analyses.
9.2. General data analysis approach
— | The main analysis used the lavaan, tidyverse and brms R packages. | ||||
— | Descriptive statistics were computed for all variables/scales (i.e. M, s.d., α, rs). | ||||
— | Multilevel models (MLMs) were run using SAS PROC MIXED with restricted maximum-likelihood (REML) and Kenward–Roger denominator degrees of freedom. | ||||
— | To test H1a to H1d, we compared different models with MLM with SAS. We tested whether the model with a random intercept, the country, is significantly better than the null model to examine whether the dependent variables are significantly different across different countries. The inclusion of random intercept was assessed by both ICC and goodness of model fit: ICC was calculated to estimate the size of variability that resides at the country level, and a likelihood ratio (LR) test was performed to compare model fit between Model 0 and Model 1: | ||||
|
— | Similarly, while testing H2 to H5, to identify the best model, we compared the following five models for each hypothesis. We performed a LR test to examine whether the addition of random effects significantly improves the model (Model 1 versus Model 2). For other comparisons, i.e. Models 2 versus 3, Models 3 versus 4, Models 4 versus 5, we employed other methods, such as the pseudo-R2 comparison and/or ominous F test because the SAS macro allows the use of the LR test only for the comparison of models with versus without random effects. Bayesian MLM with brms was performed with the best model.
| ||||
— | For frequentist analyses, 95% confidence intervals and the conventional 5% significance level (p < 0.05) were used for H0 significance testing. Categorical variables (such as countries) were dummy coded; continuous variables were centred on grand means. Variables for individual-level predictors (country-mean variables; see §3) were computed and centred on grand means in order to separate variance of country part from the variance of the individual part (see [56]). We used the variance inflation factor (VIF) as a diagnostic for multicollinearity. If VIF > 3, we did the following: If the high VIF concerned the main independent variable (IV), we excluded the IV's collinear variable(s). If the high VIF concerned covariates, we performed a PCA to reduce the number of covariates to a set of uncorrelated covariates. | ||||
— | For multilevel modelling, the significance of fixed effects was examined using Wald tests with degrees of freedom adjusted with Kenward–Roger method; random effects were tested via likelihood ratio tests (−2ΔLL with degrees of freedom equal to the number of new random effects variance and covariance). The effect size for fixed effects was examined via pseudo-R2 for the proportion reduction in each variance component, along with the change in total R2, i.e. the squared correlation between the actual outcome and predicted outcome by the predictive models [87]. Moreover, to increase the power of multilevel modelling, we performed the same analyses with two different datasets: one before and one after the respondent-level exclusion screening (see §7 for criteria). We primarily presented the results of MLM with the whole dataset and those with the screened dataset in the appendix in the Open Science Framework repository for reference. We performed MLM with the whole dataset before the screening to maximize the statistical power by retaining as many samples as possible. | ||||
— | For Bayesian analyses, Bayes factor ≥ 10 (BF10 ≥ 10) was employed, which indicates the presence of strong evidence supporting H1 against H0 for Bayesian testing in general [86,88]. In addition to this main Bayes factor criterion, we used Bayes factor ≥ 3 (BF10 ≥ 3) to indicate the presence of positive but not strong evidence supporting our hypothesis auxiliary. | ||||
— | We interpreted the outcomes based on both p-values and Bayes factors. Further details regarding how to make decisions are presented in table 2. Although p-values and Bayes factors indicate the same direction of the result (e.g. If Bayes factor ≥ 3, then p should be less than 0.05; see [89,90]), if there is an error in either frequentist or Bayesian MLM, they might provide contradictory results. Thus, for robustness reasons, we used both indicators to examine whether the planned MLM analysis is completed without any methodological errors. |
Bayes Factor (BFH10) | Interpretation |
---|---|
≥ 10 | The effect is strongly supported by evidence. |
3 ≤ BF < 10 | The effect is positively supported by evidence but not strongly. |
1/3 < BF < 3 | The current evidence is insufficient to make any decisive decision although the non-zero effect is likely to exist. |
1/3 < BF < 3 | The current evidence is insufficient to make any decisive decision although the null hypothesis (effect = 0) is likely to be the case. |
1/10 < BF ≤ 1/3 | The null hypothesis (effect = 0) is supported by evidence but not strongly. |
≤ 1/10 | The null hypothesis (effect = 0) is strongly supported by evidence. |
In table 3, we specify the analyses for all hypotheses.
question/hypothesis | sampling plan (e.g. power analysis) | analysis | interpretation given different outcomes | test result |
---|---|---|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
9.3 Model specification for multilevel model
Below, we illustrated the model specification for a multilevel model designed to test hypotheses 2A and 5: Compliance with behavioural guidelines was a function of fixed and random intercepts (B00 and R0), perceived stress (B40 and R1) and availability of social provisions (B50), when controlling for both individual-level control variables (B10–B30) and country-level control variables (B01–B05). An interaction term was created to probe into the moderating role of social provisions in the relationship between individual-level stress and compliance (B60).
-
Level 1 (Individual):
-
Y = P0 + P1*(Gender) + P2*(Age) + P3*(Education) + P4*(Stress) + P5*(Social Provisions) + P6*(Stress × Social Provisions) + E
-
Level 2 (Country):
-
P0 = B00 + B01*(Population Size) + B02*(GDP) + B03*(Education Attainment) + B04*(Unemployment) + B05*(Gini Coefficient) + R0
-
P1 = B10, P2 = B20, P3 = B30
-
P4 = B40 + R1
-
P5 = B50
-
P6 = B60
-
Compositional Model for Multilevel Analysis:
-
Compliance = B00 + B10*(Gender) + B20*(Age) + B30*(Education) + B01*(Population Size) + B02*(GDP) + B03*(Educational Attainment) + B04*(Unemployment) + B05*(Gini Coefficient) + (B40 + R1)*(Stress) + B50*(Social Provisions) + B60*(Stress × Social Provisions) + R0 + E
9.4. Effect size analysis
In addition to the originally planned significance testing, we also computed effect sizes of predictor(s) of interest in each model. In the cases of H1a–H1d, we examined intraclass correlation coefficients (ICC). ICCs explain to what extent the variances in a dependent variable of interest (i.e. perceived stress, concern over the coronavirus, trust in government efforts and compliance with behavioural guidelines) are attributable to differences across countries. For H2a–H5, we employed lme.dscore implemented in the R package, EMAtools, to estimate Cohen's D of predictor(s) of interest in each model. The R source code used for this process is available via the OSF (https://osf.io/zscdh/; data and other related files are available in the same folder).
10. Data processing
Data collection started on 30 March 2020 in all participating countries, with a pre-launch in Denmark on 26 March 2020 to test if the survey worked in practice and get a first impression on the response rate. Prior to submitting the RR stage 1, we had not accessed or analysed any data, except following response rates to give all COVIDiSTRESS participant researchers feedback on the recruiting progress.
This RR was submitted under the COVID-19 rapid response call for papers in Spring 2020. Upon acceptance of the stage 1 protocol, we analysed the newest weekly data extraction that fit minimum criteria (see above). The full dataset collected is available to any other researcher for further exploration or hypotheses testing via the Open Science Framework.
The version of the COVIDiSTRESS dataset analysed here was extracted on 30 May 2020. A total of 173 429 responses were recorded and cleaned using the R-code recommended by the COVIDiSTRESS team (available at https://osf.io/z39us/files/). The cleaned dataset consisted of 125 306 responses.
Following our pre-registered plan of analysis, we first checked whether the equivalence of invariance of our measures across countries could be reached. For invariance models to converge, we initially excluded 2538 participants (2.03%) (i) from countries with less than 100 participants and (ii) who did not indicate the country of residence. Next, 1223 participants (0.99%) were excluded who completed the survey in less than 10% of the Qualtrics estimated survey duration (i.e. less than 2 min and 12 s). When the actual duration was examined, the mean duration was 2118.38 s. The 1223 excluded participants completed the survey in the top 0.99% fastest speed. Further, we used Mahalanobis distance to detect multivariate outliers due to random or carelessly invalid responses [71,72]. A total of 5189 (4.27%) participants with a p < 0.001 in the chi-square test were excluded. After these exclusions, the dataset consisted of 116 356 participants (see electronic supplementary material, table S1).
In the second step, following our pre-registered quality check plan, we investigated floor and ceiling effects for our independent variables, testing how many participants' self-reported compliance with preventive guidelines as well as composite scores of perceived stress (PSS-10), available social provision (SPS) and concern over coronavirus reached the minimum or maximum value. If more than 15% of respondents reached either the maximum or minimum value for a measure, the ceiling/floor effect was considered present. For SPS, a ceiling effect was detected for two countries: Brazil (N = 81, 16.0%) and Panama (N = 78, 16.1%). For concern over coronavirus, ceiling effects were found for 11 countries: Mexico (N = 1505, 19.2%), United States (N = 322, 16.0%), Panama (N = 103, 16.1%), Philippines (N = 89, 17.9%), Brazil (N = 112, 18.3%), Colombia (N = 28, 17.2%), Malaysia (N = 137, 29.7%), South Africa (N = 24, 21.4%), Greece (N = 105, 18.8%), Pakistan (N = 40, 15.2%) and Portugal (N = 153, 17.0%). In the third step, we assessed measurement invariance. As detailed in the RR, we expected that the COVIDiSTRESS global survey would show significant differences between countries, and five hypotheses were proposed. In order to test our hypotheses, we needed to examine the extent to which participants from all countries completed the focal measures similarly. Using a classical approach, we reached partial invariance in the case of PSS-10 and SPS-10, but not for concern over coronavirus. Thus, we proceeded with the alignment method (see OSF for the results of measurement invariance tests and alignments; links: https://osf.io/qp96b/ and https://osf.io/hu683/). The three measures examined were the corona concern scale, the PSS and the SPS (table 1).
We followed four main analytical steps in Mplus for measurement testing. First, we conducted an exploratory factor analysis using maximum-likelihood estimation and geomin rotation for each scale to confirm their dimensionality. One-factor structures were confirmed for all three scales. Second, we examined the extent to which the one-factor model was well-fitting across the entire sample using a pooled dataset. This was achieved by adjusting variables so that cases from each country have equal weighing on the covariance matrix. Third, we conducted a multi-group confirmatory factor analysis testing a configural invariance model to examine the measurement invariance of the one-factor model across countries. Fourth, we tested measurement invariance more properly with the alignment optimization method (see detailed description below). Finally, we conducted Monte Carlo simulations to provide a validation check of the alignment results, indicating whether the rank order of latent factors across countries is trustworthy.
The latent factor scores for each scale obtained from the alignment analyses were combined to be used in the key hypotheses testing analyses. We examined data from 104 332 participants from 48 countries. Sample size ranged from 109 (New Zealand) to 20 165 (Finland), with a mean of 2173 and median of 921 participants per participating country. Based on the results reported in detail below, we deemed that measurement invariance of the three measures was achieved. In brief, the results provided strong evidence for the one-factor structure of all three measures, that this unifactorial factor structure was confirmed across all 48 countries, that participants from all countries responded to the items relatively similarly, and the Monte Carlo simulations confirmed the trustworthiness of the latent factor scores obtained.
The final dataset consisted of 116 356 participants from 48 countries with the mean age of 39.4 (s.d. = 14.1), 84 942 (73.00%) of participants identified as female, 29 869 (25.51%) as male, and 1283 (1.10%) provided other responses or declined to respond. For detailed demographic statistics, see electronic supplementary material, (electronic supplementary material, table S1).
For the multilevel models (H1a to H5), we dummy coded individual-level categorical variables (participant gender and education level) and centred the continuous variables (predictors and control variables) on grand means (see electronic supplementary material, table S1 to S4 with descriptive statistics). Because the ICCs showed that a considerable amount of variability of outcome variables was accounted for by between-country difference (see the Results section), country-mean variables for individual-level predictors were created by aggregating individual scores at the country level and centred on the grand means in order to separate variance of country part from the variance of the individual part (see [56]).
Country-level covariates (population size, GDP per capita, Gini coefficient and educational attainment) were acquired from the World Bank World Development Indicators database [92]. We used PPP-adjusted GDP per capita, which represents each country's level of economic activities controlling for purchasing power (i.e. the differences in price levels between countries; Eurostat). Gini coefficient measures the extent to which the distribution of income among individuals in a given country deviates from a perfectly equal distribution (ranging from 0 to 100—0 represents absolute equality, whereas 100 represents absolute inequality; [92]). Educational attainment referred to the percentage of 25 years old or above in the population who completed at least upper secondary education.
11. Results
11.1. Mapping cross-country differences
Hypotheses 1a to 1d tested between-countries differences in perceived stress, concern over the coronavirus, trust in government efforts and compliance with behavioural guidelines.
The ICCs obtained in MLM for the random intercept-only models for stress, concern, trust in government efforts and compliance with behavioural guidelines are 12.16%, 13.04%, 26.97% and 5.59%, respectively, suggesting that a considerable proportion of variances—from 5 to 27%—were attributable to differences across countries (see electronic supplementary material, table S5). Examination of random variance revealed that the hypothesized cross-country differences in perceived stress (H1a), concern over the coronavirus (H1b), trust in government efforts (H1c) and compliance with behavioural guidelines (H1d) were supported by statistically significant country random intercepts (stress: B = 0.16, s.e. = 0.03, Wald Z = 4.81, p < 0.001; concern: B = 0.24, s.e. = 0.05, Wald Z = 4.79, p < 0.001; trust in government efforts: B = 2.26, s.e. = 0.47, Wald Z = 4.82, p < 0.001; compliance: B = 0.05, s.e. = 0.01, Wald Z = 4.74, p < 0.001).
Bayesian MLM also supported the results from the frequentist MLM. In H1a to H1d, the resultant BF10 s were infinite. These results supported the presence of the non-zero country random intercepts for H1a to H1d (see OSF for the full report generated by brms; link: https://osf.io/7g8ej/).
Post hoc comparisons with Scheffe correction were conducted to examine differences across countries (see figures 1–4). Overall, the figures revealed interesting patterns for stress, concern, trust and compliance. For instance, similar patterns were observed for between-country differences in terms of perceived stress and perceived concern. More specifically, while the level of stress and concern in Western European countries appeared to be particularly high, several countries displayed characteristically lower levels of both stress and concern. Among others, Turkey, Portugal, Poland, Philippines, Bulgaria, Brazil and to some extent Bosnia and Herzegovina, experienced comparatively lower levels of stress. Switzerland, Sweden, The Netherlands, Finland, Denmark and to a certain degree Lithuania reported higher levels of stress. On the other hand, Western European countries were somewhat low in trust in their governments' efforts to handle the coronavirus. Regarding compliance with behavioural guidelines, the between-country differences seemed to be less pronounced, with the exception of Japan, which seemed to be relatively compliant.
11.2. Perceived stress and compliance with behavioural guidelines
Hypothesis 2a examined the relationship between stress and self-reported compliance with guidelines for disease-preventive behaviour. The fixed effects of the individual-level predictor (perceived stress) and control variables (age, gender and education) were first added to the model to predict compliance (see electronic supplementary material, table S6). Together all the individual-level variables accounted for 3.40% of the level-1 within-country variance (0.75 as compared with 0.77 in Model 2). As predicted, perceived stress was negatively associated with compliance with behavioural guidelines to slow the spread of coronavirus (B = −0.03, s.e. = 0.01, t100613 = 10.96, p < 0.001). Age positively predicted compliance, so did gender, such that older participants showed greater compliance (B = 0.01, s.e. = 0.00, t100520 = 38.17, p < 0.001), and that females showed a higher level of compliance than males (B = 0.25, s.e. = 0.01, t100612 = 37.83, p < 0.001). In Model 4, both country-mean variables and country-level control variables were added to the model. Inclusion of country-level variables accounted for 51.71% of the level-2 between-country variance (0.02 as compared with 0.05 in Model 3). We found that individual-level perceived stress was still a statistically significant predictor of compliance (B = −0.03, s.e. = 0.00, t100567 = 10.98, p < 0.001; figure 5) after controlling for country-level predictors. Thus, H2a was supported by the data.
In Model 5, where a random slope for stress was added to the model, the random slope was statistically significant (B = 0.00, s.e. = 0.00, Wald Z = 2.40, p = 0.02), suggesting that the negative relationship between stress and compliance varied significantly across countries; the result of likelihood ratio test indicated that the inclusion of stress random slope significantly increased the model fit (, p < 0.001).
The result from the Bayesian MLM was consistent with the frequentist MLM. The Bayesian MLM indicated very strong support (BF10 = infinite) for the presence of the non-zero effect of individual-level perceived stress on self-reported compliance (see OSF for the full report generated by brms; link: https://osf.io/7g8ej/). The estimated effect size of perceived stress was Cohen's D = −0.06, suggesting that the effect was very small.
11.3. Concern over the coronavirus and compliance with behavioural guidelines
Hypothesis 2b examined if concern over the coronavirus positively predicted compliance with behavioural guidelines. In Model 3, the individual-level variables together accounted for 6.29% and 11.07% of the level-1 within-country and level-2 between-country variance, respectively (0.72 and 0.04 versus = 0.77 and = 0.05 in Model 2; see electronic supplementary material, table S7). As predicted, concern over coronavirus positively predicted compliance with behavioural guidelines to slow the spread of coronavirus (B = 0.12, s.e. = 0.00, t100185 = 55.43, p < 0.001). In Model 4, the inclusion of country-level variables accounted for 51.10% of the level-2 between-country variance (0.02 as compared with 0.04 in Model 3). Individual-level concern remained statistically significant (B = 0.12, s.e. = 0.00, t100284 = 55.36, p < 0.001) after controlling for country-level predictors. H2b was thus supported by the data.
In Model 5, the random slope of concern over coronavirus was statistically significant (B = 0.00, s.e. = 0.00, Wald Z = 3.99, p < 0.001), suggesting that the association between concern and compliance significantly varied across countries; the result of likelihood ratio test showed that the inclusion of concern random slope significantly increased the model fit, , p < 0.001.
The result from the Bayesian MLM also supported H2b. The BF10 = infinite result indicated that evidence very strongly supported H2b against the null hypothesis (see OSF for the full report generated by brms; link: https://osf.io/7g8ej/). The calculated effect size of concern was Cohen's D = 0.36, suggesting the presence of a small to medium effect.
11.4. Trust in government efforts and perceived stress
Hypothesis 3a tested if trust in government efforts negatively predicted perceived stress. In Model 3, the individual-level variables together accounted for 12.33% and 51.83% of the level-1 within-country and level-2 between-country variance, respectively (0.85 and 0.04 versus 0.97 and 0.07 in Model 2; see electronic supplementary material, table S8). Trust in government efforts to slow the spread of coronavirus was negatively associated with stress (B = −0.06, s.e. = 0.00, t98431 = 49.35, p < 0.001), such that individuals with a higher level of trust in government efforts showed a lower level of stress. Age, gender and education significantly predicted perceived stress: individuals with younger age (B = −0.02, s.e. = 0.00, t100589 = 83.68, p < 0.001), female (B = 0.34, s.e. = 0.01, t101012 = 50.19, p < 0.001) or with lower education level (B = −0.07, s.e. = 0.02, t101000 = 4.62, p < 0.001; B = −0.14, s.e. = 0.02, t101008 = 9.47, p < 0.001) tended to report greater perceived stress. In Model 4, inclusion of country-level variables accounted for 8.66% of the level-2 between-country variance (0.03 versus 0.04 in Model 3). The negative relationship between trust in government efforts and stress (B = −0.06, s.e. = 0.00, t100969 = 49.14, p < 0.001) remained statistically significant after country-level variables were controlled for. Hence, H3a was supported by the data.
In Model 5, the random slope for trust in government efforts was statistically significant (B = 0.00, s.e. = 0.00, Wald Z = 3.36, p = 0.001), suggesting that the association between government trust and stress significantly varied across countries. Inclusion of the random slopes significantly improved the model fit, , p < 0.001.
The Bayesian MLM showed that evidence very strongly supported the presence of the non-zero effect of trust in government efforts, BF10 = infinite (see OSF for the full report generated by brms; link: https://osf.io/7g8ej/). The estimated effect size of trust in terms of Cohen's D was −0.31, indicating the presence of a small to medium effect.
11.5. Trust in government efforts and concern over the coronavirus
Hypothesis 3b tested if trust in government efforts negatively predicted concern over the coronavirus. In Model 3, the individual-level variables together accounted for 2.91% of the level-1 within-country variance (1.52 versus 1.57 in Model 2; see electronic supplementary material, table S9). Trust in government efforts to slow the spread of coronavirus was significantly negatively associated with concern (B = −0.01, s.e. = 0.00, t100644 = 5.36, p < 0.001). In Model 4, the negative relationship between trust in government efforts and concern (B = −0.01, s.e. = 0.00, t100685 = 5.29, p < 0.001) was still statistically significant after country-level variables were controlled for. The inclusion of country-level variables accounted for 31.55% of the level-2 between-country variance (0.16 versus 0.24 in Model 3). However, in Model 5, when the random slope of government trust was entered in the model, the relationship between government trust and concern was no longer statistically significant, t46 = 1.08, p = 0.29. Analysis of random effects showed that random slope of government trust was statistically significant (B = 0.00, s.e. = 0.00, Wald Z = 4.08, p < 0.001) and adding this random effect significantly improved the model fit, , p < 0.001. These results suggested that although government trust did not significantly predict concern when averaging all countries, the relationship between trust in government efforts and concern varied across countries to a great degree. H3b was therefore not supported.
The result of the Bayesian MLM also suggested that H3b could not be supported by the data. The calculated BF10 = 0.07 indicates that the null hypothesis was very strongly supported by evidence instead of H3b (see OSF for the full report generated by brms; link: https://osf.io/7g8ej/). The estimated effect size of trust, Cohen's D = −0.04, suggested the presence of a very small effect.
11.6. Concern as a predictor of stress
H4 tested the relationship between concern over the coronavirus and perceived stress. In Model 3, the individual-level variables accounted for 14.55% and 36.02% of the level-1 within-country and level-2 between-country variance, respectively (0.83 and 0.06 versus 0.97 and 0.07 in Model 2; see electronic supplementary material, table S10). Concern over the coronavirus was positively associated with perceived stress (B = 0.18, s.e. = 0.00, t102284 = 77.92, p < 0.001). In Model 4, the positive relationship between concern and stress (B = 0.18, s.e. = 0.00, t102385 = 77.88, p < 0.001) was still statistically significant after country-level variables were controlled for. The inclusion of country-level variables accounted for 13.83% of the level-2 between-country variance (0.04 versus 0.05 in Model 3). H4 was thus supported by the data.
In Model 5, random slopes of concern were statistically significant (B = 0.00, s.e. = 0.00, Wald Z = 4.08, p < 0.001), suggesting that the association between concern and stress significantly varied across countries. Inclusion of the random slopes significantly improved the model fit, , p < 0.001.
The Bayesian MLM also supported H4. According to the Bayesian MLM result, evidence was found to support H4 very strongly against the null hypothesis, BF10 = infinite (see OSF for the full report generated by brms; link: https://osf.io/7g8ej/). The calculated effect size of stress, Cohen's D = 0.49, suggested the existence of a nearly medium effect.
11.7. Availability to social provisions as moderator
H5 examined if social support moderated the relationship between stress and compliance identified in H2a. At the first step, both individual-level and country-level social support was added in the Model 5 from H2a (see Model 6 in electronic supplementary material, table S11). Individual-level social support significantly predicted compliance (B = 0.10, s.e. = 0.00, t85745 = 37.16, p < 0.001), so did country-level social support (B = 0.15, s.e. = 0.06, t29 = 2.54, p = 0.017), meaning that greater individual-level social support was associated with higher levels of compliance and that living in countries with greater social support also predicted higher levels of compliance. Subsequently, in Model 7, where social support intercept, random slopes and the covariates were introduced to the model, the random slopes of social support were statistically significant (B = 0.00, s.e. = 0.00, Wald Z = 2.74, p = 0.006), such that the relationship between social support and compliance varied significantly across countries; the result of likelihood ratio test showed that the inclusion of the random effects related to social support significantly increased the model fit (, p < 0.001; electronic supplementary material, table S11F).
Next, in Model 8, both individual-level and country-level stress × social support interaction effects were entered in the model. As expected, there was a statistically significant individual-level stress × social support interaction, which suggests that social support moderated the relationship between stress and compliance (B = −0.02, s.e. = 0.00, t6144 = 10.09, p < 0.001).
The Bayesian MLM also supported H5. The BF10 = infinite results indicated that evidence very strongly supported the presence of the non-zero interaction effect (see OSF for the full report generated by brms; link: https://osf.io/7g8ej/). The calculated effect size of the main effect of social support, Cohen's D = 0.26, suggested its effect was small to medium. The effect size of the interaction effect was very small, Cohen's D = −0.07.
Simple slope analyses were conducted to separately examine the strength of the stress-compliance association by high (+1 s.d.) versus low (−1 s.d.) levels of social support [93] (figure 5). When social support was high, perceived stress was found to negatively predict compliance (B = −0.03, s.e. = 0.01, t38 = 4.31, p < 0.001); however, when social support was low, perceived stress positively predicted compliance (B = 0.03, s.e. = 0.01, t37 = 4.55, p < 0.001). Taken together, and contrary to our hypothesis that greater social support would reduce the negative association between stress and compliance, we found that the relationship between stress and compliance in fact became more strongly negative among individuals with greater (and not lower) levels of social support.
11.8. Post hoc analyses
To examine why the association between trust in government was not negatively associated with concern over the coronavirus as we had hypothesized (H3b), we conducted additional exploratory analyses. As changes in institutional and political trust have been found to rise in the aftermath of lockdowns instituted in Western Europe [94] and New Zealand [2], and levels of trust have been shown to predict differing behavioural responses under varying levels of stringency in governmental policy responses to COVID-19 [95], one possibility is that the stringency of lockdowns themselves may have had additional effects on trust, and consequently in how trust relates to experienced concern over the coronavirus. Therefore, in this additional analysis, we explored whether the differences in the measures implemented in different countries were related to the association between people’ trust in their governments and concern over the coronavirus.
We used the 2020 Oxford Government Response Stringency Index to quantify the degree to which each government's preventive measure was strict (see https://ourworldindata.org/grapher/covid-stringency-index). We extracted the index data dated Monday, 6 April 2020. Then, we performed one additional MLM and BMLM after modifying the model for H3b. For this exploratory analysis, we added the interaction effect of the individual-level trust in government efforts × country-level stringency index, and the country-level stringency index as a covariate to the initial model. We examined whether the interaction effect was statistically significant in predicting concern over the coronavirus based on the resultant p-value and BF10 by applying the same interpretation criteria (table 2).
The result of the post hoc analysis demonstrated that there was a statistically significant interaction effect of the individual-level trust in government efforts × country-level stringency index on concern over the coronavirus. Results from both the frequentist MLM (B = 0.07, s.e. = 0.00, t36.18 = 3.49, p = 0.001) and Bayesian MLM (BF10 = 9.10) supported this. Although not very strongly, the evidence positively supported the presence of an effect (BF ≥ 3, table 2). The estimated effect size was very large, Cohen's D = 1.16. As shown in figure 6, we found that in countries where the government response measures were relatively strict (stringency index ≥ +1 s.d.), the relationship between trust in government and concern over the coronavirus was positive while that was not the case in countries where the government response measures were less strict.
12. Discussion
Employing data from participants in 48 countries, we explored early psychological and behavioural responses to the 2020 COVID-19 pandemic, and how differences in psychological and behavioural responses influenced reactions to government efforts to curb the spread of the coronavirus and associated COVID-19 disease. There are five major findings discussed in turn.
First, the results revealed that there were marked differences between countries in the early months of the global COVID-19 crisis. Participants from Western European nations were more concerned over COVID-19, more stressed and had lower levels of trust in the government's efforts, compared with participants from other parts of the world. In their research comparing countries in Europe, Asia and North America, Dryhurst et al. [96] found that levels of risk perception were high among all countries for the period between March and April, with the highest levels being reported in the UK and Spain. In terms of compliance with local behavioural guidelines to slow the spread of coronavirus, there was no clear distinction in the geographical pattern in our data, with the exception of Japanese participants who reported particularly high levels of compliance (figure 4). In line with existing research showing cross-country differences in psychological responses to pandemics (e.g. [52,53,54]), the COVIDiSTRESS global survey finds that this was indeed also the case for early psychological responses to COVID-19. Our findings contribute to the research undertaken by other cross-country surveys highlighting the importance of the psychological underpinnings of public responses to the pandemic (e.g. Winton Centre for Risk and Evidence Communication; [96]).
Second, we found that concern over the coronavirus was positively associated with stress. The more concerned people were, the more stress they experienced. While this relationship between concern and stress seems to be a general pattern during pandemics (e.g. [22,24]), there were notable differences between countries, and concerns about the coronavirus itself did not account for all of the variances in experienced stress during the early months of coronavirus restrictions. As such, we found that while concern about the disease itself was a source of mental distress and perceived pressure, other factors including, for example, working conditions and children's education during lockdown must also be taken into consideration to fully understand the psychological impact of COVID-19 [97]. Our findings add to the existing findings from studies that have highlighted the negative economic impact of the pandemic and its association with anxiety or depression [98], as well as the overall negative psychological effects of the pandemic on parents [99].
Third, we found that the more stressed people felt, the less compliant they were with behavioural guidelines; but also that more concerned individuals tended to display more behavioural compliance. These associations between compliance with local behavioural guidelines, and the psychological factors of perceived stress and concern, respectively, differed across countries. Again, the early COVID-19 period conformed to previous research showing that perceived stress and concern over a pandemic related to people's compliance (e.g. [17–19,31–33]). However, our analyses also contribute further, by providing a detailed cross-country comparison for relationships between early psychological and behavioural responses. While the full breadth of between-country differences is too numerous to discuss, interested readers can study these comparisons in figures 1–4. Specific country-level information can also be found in the electronic supplementary material and online datasets (https://osf.io/z39us/ and [59]).
Fourth, the results showed that the more trust people had in government efforts to slow the spread of coronavirus, the less stress they experienced. Again, cross-country differences could be rooted in a number of factors ranging from differences in local cultures and political history, to variations in behavioural guidelines, government intervention stringency and the impact of COVID-19 at the time. Contrary to the relationship between trust in government efforts and perceived stress, we did not find support for the hypothesis that trust in government efforts to slow the spread of the coronavirus would be negatively correlated with concern over the coronavirus. It would have seemed intuitive that trusting that appropriate measures were being taken by authorities would lessen concern. Instead, our results revealed considerable variation in associations between trust in government efforts and concern across different countries. In an effort to examine why this could be the case, we conducted additional exploratory analyses. Here, we found a significant positive interaction effect of the individual-level trust in government with the country-level Oxford Government Response Stringency Index. The emerging patterns indicate that the relationship between trust and concern became positive only in countries where the measures were objectively strict in comparison with other countries. In other words, most people were concerned over the early COVID-19 situation, but this perception was accompanied by trust in governmental measures only if such measures were relatively strict.
There could be multiple explanations for this exploratory finding. Strict measures may instil a belief that all possible courses of action are being employed to alleviate the situation. We also know from H2 that stress is negatively associated with compliance—but given our findings from H3, namely the negative correlation between perceived stress and trust in government efforts, it could be that better government intervention reduces stress along with the perceived need for compliance, if things seem well in hand. Further, it is plausible that governments will be more likely to implement stronger measures when they perceive a mandate from the populace combined with great concern. Factors like cohesion within society and the ability of each country to withstand downstream economic consequences will probably also play a role in this dynamic. Casualties could thus run in multiple directions, and are likely to interact. Research on the lockdowns implemented in Western Europe in March and April concurrently found an association between lockdowns and greater trust in government, political support for the governing party, and democratic satisfaction [94], suggesting that lockdowns are indeed generally popular among citizens in well-functioning democracies and may feel reassuring to citizens concerned over the progression of the disease; similar effects on trust were also observed in New Zealand [2]. However, countries in which less stringent lockdowns are applied may have experienced a reverse effect, where those most likely to be satisfied by a light government response may also be those who are least concerned with COVID-19 to begin with. Along these lines, a recent cross-country study by Fetzer et al. [100] found that timely and stringent government measures were associated with better mental well-being among citizens, while negative evaluations of the government's response to the pandemic were related to lower mental well-being and a lack of trust in government efforts to tackle the pandemic. Another analysis of mobility in European countries during the early weeks of the pandemic revealed gaps in compliance between populations that had high or low political trust as the stringency of lockdown increased [95], perhaps in part due to varying concern levels, as we also found support for in H2b.
Fifth, greater availability of social support moderated the negative association between stress and compliance. Among people with higher levels of social support, stress was associated with less compliance with local preventive measures, while among people with lower levels of social support, stress was associated with more compliance. These outcomes run counter to our initial hypotheses, which might suggest that complying with society-level preventive measures was an especially attractive coping strategy for individuals who did not have the luxury of being looked out for by friends, family and neighbours. It might also be that those placing more stock in near relations for coping underestimated the importance and legitimacy of country-level restrictions. There might be several reasons why the evidence contradicted H5. Chang & Sivam [101] reported that the perceived stress and SARS-related fears were positively associated with preventive behaviours among Singaporians during the SARS outbreak. Similarly, Tang et al.'s [102] study showed that the perceived stress positively predicted the tendency of social distancing in early 2020 among participants in China and Hong Kong, places where the COVID-19 was more severe compared with other countries during the period. These previous studies would suggest that people tend to adopt behavioural measures to prevent the spread of the virus if they experience significant stress at the epicentres of pandemics, but our findings add the nuance that the psychological buffering role of social support may actually counteract the role of stress as a driver of cautious behaviour in the public sphere. Rather than looking at this phenomenon as a function of individual stress levels, this buffering mechanism could come into play when groups oppose government restrictions for political or practical reasons, or when younger adults converge on the need to retain their social life in the face of pandemic curfews.
A notable limitation of the present study was the sampling method. While other studies (e.g. [3]) have collected survey data using paid representative respondent pools, the goal of the COVIDiSTRESS collaboration was to collect data as quickly and conveniently as possible, with researchers in each country deciding their own recruitment strategies. As such, although spanning across a large number of countries, our sample is not representative of the various national populations. For instance, the COVIDiSTRESS dataset has more female respondents, and, presumably due to the use of online media for recruitment, a younger demographic. Full dataset details can be found in the electronic supplementary material, and on the Open Science Framework.
12.1. Practical implications
The present analysis of the COVIDiSTRESS dataset contributes to an understanding of the complexities at play in early psychological effects of the COVID-19 pandemic. Our findings lead us to suggest several implications for practitioners such as health communicators, government officials and policy makers. Foremost, we find that although there are general patterns, between-countries differences in reactions to the crisis and compliance with behavioural guidelines show that interventions should be context sensitive. The actions already taken by governments, as well as the stress and stressors pervading a society, can at any given time lead to very different reactions to the same disease, the same restrictions, or the same recommendations from health or government authorities.
Lowering stress in the population may be needed to create optimal conditions for compliance with behavioural guidelines. Establishing trust in government efforts by taking decisive and visible action, and addressing stressful issues such as childcare, lockdown predictability or job security during a pandemic, may for instance lead to better compliance by way of lessening the stresses experienced by individuals. However, care must be taken not to lessen concerns over the gravity of the health situation at the same time, as our data suggest that lessened personal concern over the virus, or reliance on close relations rather than collective societal action to handle everyday challenges, can run counter to accepting the need for protective behaviours in society at large. Taken together, this implies that governments should be as transparent and objective as possible in providing guidelines and updates of the most current situation in terms of the number of positive and recovered cases as well as deaths. Initial downplaying or hiding actual numbers of positive cases or deaths can have detrimental effects on public health as well as on institutional trust and levels of compliance as the pandemic surges. In addition, clarity in communicating governmental guidelines to reduce transmission has also the potential to alleviate perceived stress.
Interventions to foster compliance with behavioural guidelines can thus be made more effective in their content and targeting, when based on knowledge of the target groups' current and baseline level of perceived stress, concern over COVID-19 and trust in government efforts. These three psychological constructs are antecedents of compliance with behavioural guidelines to slow the spread of COVID-19 and vary considerably between different countries. As shown, however, the relationship between these constructs is quite complex and varies according to numerous local factors, including the stringency of government interventions in each country, and tracking their relationship over time, and in different locales and social groups, could thus be an important tool for continuously adapting social, psychological and communicative strategies when responding to global pandemics. Further, in order to successfully communicate and implement protective behavioural measures, it appears important to base messages and channels on whether individuals in a target audience are oriented towards the measures in society more broadly, or the personal support of social groups, where the latter may reduce stress and compliance both (i.e. [103]).
Even though general trends can be detected across the globe, we found notable between-countries variations in all our analyses. With a dataset comparing so many countries, it is infeasible to unpack all of these specific differences in the text properly. Instead, these must be considered individually though scrutiny of the graphs and electronic supplementary material, and possibly explained by future dives into the large open data pool combined with other sources of information. For instance, the timeframe for outbreaks has varied greatly across the planet, as has the capacity of health systems to treat the seriously afflicted, and measures to curtail the spread of the coronavirus. Also, while the behavioural guidelines of some governments and health authorities were presented as mere recommendations, other countries, regions and cities enforced strict closing of businesses, schools and public spaces, as well as curfews enforced by local police and military personnel. Communication and execution of these guidelines have also changed over time, and as many such guidelines may have shifted from being perceived as temporary emergency measures to a longer term ‘new normal' by summer 2020 [103], psychological responses to the same measures may shift in turn. Further, factors like cultural norms, distribution of wealth, living conditions, proximity to neighbours, typical work life and trust in authorities all varied before the pandemic in myriad ways, which must be taken into account when interpreting the difference between any two countries as they emerge in the results from H1a to H1d (figures 1–4). For this reason, we invite detailed scrutiny and discussion of any interesting between-country differences using the open science online resources made available as code, data, electronic supplementary material and dynamic visualizations [59].
12.2. Further research
After-effects of the COVID-19 pandemic are to be expected, and just as the emergence of the global pandemic presented new personal and societal challenges, re-opening and getting ‘back to normal' will vary according to how each country opts to face these challenges [103]. As such, follow-up data collection will be important to assess the whole of the impact of the COVID-19 pandemic, as well as how attitudes and psychological reactions changed from 2020 and into the coming years. Conducting a further and deeper between-countries analysis taking into account the preventive and communicative strategies employed by each government, as well as the seriousness of the various consequences from the medical to the economic spheres is thus necessary to understand the effects of the pandemic more broadly, over time. We have included the stringency of intervention in the post hoc work of the present pre-registered analysis, but many more such variables must be considered in the future.
Finally, we believe that it is important to discuss the broad scientific climate of which the COVIDiSTRESS global survey is only a small part. As the global pandemic gained speed, researchers from a plethora of fields felt compelled to send out a barrage of surveys on issues ranging from conspiracy theories about the disease to experiences of parenting and working/learning from home. Indeed, multiple repositories and consortia also cropped up to support collaboration and avoid repetitive research questions in favour of a coordinated global undertaking. While these many research initiatives are bound to vary in quality, and contents will overlap, the period was an amazing example of the scientific community coming together to address a global crisis, and it is likely that the coronavirus pandemic and the lockdowns that ensued will be the most well-studied social event in human history from a perspective of real-time data collection. As such, future reviews and meta-analyses taking measures, sampling and overall study quality into account will lend a much deeper understanding. As a consortium, we believe that especially studies using the open data, pre-registration and publishing in the registered reports format will be decisive in the post-COVID-19 discussion of scientific quality and integrity during global crises. As the surge of new cases during the winter of 2020–2021 demonstrated, the pandemic had the potential to create lasting consequences beyond the measures implemented in the spring of 2020 and their after-effects. As such, longitudinal studies tracing the impact of protective measures on mental health would be particularly welcome. In a similar vein, it would be equally important to differentiate how infected versus uninfected individuals are influenced by the pandemic and related measures to contain it. Emerging research shows that individuals who recover continue to experience increased levels of anxiety, worry and poorer mental health [104]. Thus, future research must focus on comparative studies that investigate coping and stress-related maladaptive strategies and psychological recovery across infected and uninfected populations.
Ethics
Due to the pressing nature of COVID-19 research, a waiver to proceed has been acquired from the Aarhus University board of research ethics office, stating that the study is in accordance with the IRBs standards for acceptable research in human subjects. To further ensure the participant's interests and compliance with GDPR-standards, all data are anonymous, and no medical information is collected.
Data accessibility
The COVIDiSTRESS global survey is a collaborative open science project. The data used here, and all other data including raw data and advice on cleaning/coding are made available at the Open Science Framework https://osf.io/z39us/.
Authors' contributions
A.L. did stage 1 and 2 writing, review and editing; consortium organization; survey design and methodology; data management. S.-Y.L. did stage 1 and 2 writing, review and editing; stage 2 data analysis/visualization. S.S. did stage 1 and 2 writing, review and editing; stage 2 data analysis/visualizations. H.H. did stage 1 and 2 writing, review and editing; stage 2 data analysis/visualization. M.K. did stage 1 and 2 writing, review and editing; stage 2 data analysis/visualization; data management. R.G. did stage 1 and 2 writing, review and editing. S.C. did stage 1 and 2 writing, review and editing. T.P.T. did stage 1 and 2 writing, review and editing; stage 2 data analysis/visualization. A.J. did stage 1 and 2 writing, review and editing. J.R. did stage 1 writing, review and editing; data management. H.C. did stage 1 and 2 writing, review and editing. T.L.M. did stage 2 writing, review and editing; stage 2 data analysis/visualization. Contributions of individual COVIDiSTRESS consortium co-authors are specified in the electronic supplementary material. Authors and consortium co-authors have read and approved the manuscript before submission.
Competing interests
Dr Taciano Milfont acted as a referee in the first two rounds of review of the stage one registered report. Upon discussion of the appropriateness of particular analysis methods in his field of expertize, and with the consent of RSOS editors, it has been agreed that he will join the list of authors when the RR proceeds to stage two instead of acting as referee. No competing interests are declared.
Funding
We received no funding for this study.
Footnotes
References
- 1.
Wang J, Wang J-X, Yang G-S . 2020 The psychological impact of COVID-19 on Chinese individuals. Yonsei Med. J 61, 438-440. (doi:10.3349/ymj.2020.61.5.438) Crossref, PubMed, Web of Science, Google Scholar - 2.
Sibley CG 2020 Effects of the COVID-19 pandemic and nationwide lockdown on trust, attitudes towards government, and wellbeing. Am. Psychol. 75, 618-630. (doi:10.1037/amp0000662) Crossref, PubMed, Web of Science, Google Scholar - 3.
Van Bavel JJ 2020 Using social and behavioural science to support COVID-19 pandemic response. Nat. Hum. Behav. 4, 460-471, (doi:10.1038/s41562-020-0884-z) Crossref, PubMed, Web of Science, Google Scholar - 4.
Freeman AL, Kerr J, Recchia G, Schneider C, Lawrence AC, Finikarides L, Luoni G, Dryhurst S, Spiegelhalter DJ . 2020 Communicating personalised risks from COVID-19: guidelines from an empirical study. medRxiv (preprint). (doi:10.1101/2020.10.05.20206961) Google Scholar - 5. Harvard Kennedy School. 2020 COVID-19: Insights and Solutions. See https://www.hks.harvard.edu/faculty-research/policy-topics/health/covid-19-insights-and-solutions. Google Scholar
- 6. London School of Economics and Political Science. 2020 Shaping the Post-COVID World. See https://www.lse.ac.uk/Research/covid. Google Scholar
- 7.
Pauliuk S . 2020 Making sustainability science a cumulative effort. Nat. Sustain. 3, 2-4. (doi:10.1038/s41893-019-0443-7) Crossref, Web of Science, Google Scholar - 8.
Brooks SK, Webster RK, Smith LE, Woodland L, Wessely S, Greenberg N, Rubin GJ . 2020 The psychological impact of quarantine and how to reduce it: rapid review of the evidence. Lancet 395, 912-920. (doi:10.1016/s0140-6736(20)30460-8) Crossref, PubMed, Web of Science, Google Scholar - 9.
Leung CM, Lam T-H, Ho L-M, Ho S-Y, Chan BHY, Wong IO, Hedley AJ . 2003 The impact of community psychological responses on outbreak control for severe acute respiratory syndrome in Hong Kong. J. Epidemiol. Commun. Health 57, 857-863. (doi:10.1136/jech.57.11.857) Crossref, PubMed, Web of Science, Google Scholar - 10.
Taylor S . 2019 The psychology of pandemics: preparing for the next global outbreak of infectious disease. Newcastle upon Tyne, UK: Cambridge Scholars. Google Scholar - 11.
Wong CML, Jensen O . 2020 The paradox of trust: perceived risk and public compliance during the COVID-19 pandemic in Singapore. J. Risk Res. 23, 1021-1030. (doi:10.1080/13669877.2020.1756386) Crossref, Web of Science, Google Scholar - 12.
Abraham T . 2011 The chronicle of a disease foretold: pandemic H1N1 and the construction of a global health security threat. Polit. Stud. 59, 797-812. (doi:10.1111/j.1467-9248.2011.00925.x) Crossref, Web of Science, Google Scholar - 13.
Capelos T, Provost C, Parouti M, Barnett J, Chenoweth J, Fife-Schaw C, Kelay T . 2016 Ingredients of institutional reputations and citizen engagement with regulators. Reg. Govern. 10, 350-367. (doi:10.1111/rego.12097) Crossref, Web of Science, Google Scholar - 14.
Seligman AB . 1997 The problem of trust. Princeton, NJ: Princeton University Press. Crossref, Google Scholar - 15.
Khan S, Huremović D . 2019 Psychology of the pandemic. In Psychiatry of pandemics: a mental health response to infection outbreak (ed.Huremović D ), pp. 37-44. Berlin, Germany: Springer Nature. Crossref, Google Scholar - 16.
Cava MA, Fay KE, Beanlands HJ, McCay EA, Wignall R . 2005 The experience of quarantine for individuals affected by SARS in Toronto. Public Health Nurs. 22, 398-406. (doi:10.1111/j.0737-1209.2005.220504.x) Crossref, PubMed, Web of Science, Google Scholar - 17.
Chien PM, Sharifpour M, Ritchie BW, Watson B . 2017 Travelers' health risk perceptions and protective behavior: a psychological approach. J. Travel Res. 56, 744-759. (doi:10.1177/0047287516665479) Crossref, Web of Science, Google Scholar - 18.
Prati G, Pietrantoni L, Zani B . 2011 Compliance with recommendations for pandemic influenza H1N1 2009: the role of trust and personal beliefs. Health Educ. Res. 26, 761-769. (doi:10.1093/her/cyr035) Crossref, PubMed, Web of Science, Google Scholar - 19.
Taha SA, Matheson K, Anisman H . 2013 The 2009 H1N1 influenza pandemic: the role of threat, coping, and media trust on vaccination intentions in Canada. J. Health Commun. 18, 278-290. (doi:10.1080/10810730.2012.727960) Crossref, PubMed, Web of Science, Google Scholar - 20.
Boyd AD, Jardine CG . 2011 Did public risk perspectives of mad cow disease reflect media representations and actual outcomes? J. Risk Res. 14, 615-630. (doi:10.1080/13669877.2010.547258) Crossref, Web of Science, Google Scholar - 21.
Liao Q, Cowling BJ, Lam WWT, Fielding R . 2011 The influence of social-cognitive factors on personal hygiene practices to protect against influenzas: using modelling to compare avian A/H5N1 and 2009 pandemic A/H1N1 influenzas in Hong Kong. Int. J. Behav. Med. 18, 93-104. (doi:10.1007/s12529-010-9123-8) Crossref, PubMed, Web of Science, Google Scholar - 22.
Ro J, Lee J, Kang S, Jung H . 2017 Worry experienced during the 2015 Middle East respiratory syndrome (MERS) pandemic in Korea. PLoS ONE 12, e0173234. (doi:10.1371/journal.pone.0173234) Crossref, PubMed, Web of Science, Google Scholar - 23.
Bish A, Michie S . 2010 Demographic and attitudinal determinants of protective behaviours during a pandemic: a review. Br. J. Health Psychol. 15, 797-824. (doi:10.1348/135910710(485826) Crossref, PubMed, Web of Science, Google Scholar - 24.
Bults M, Beaujean DJ, De Zwart O, Kok G, Van Empelen P, Van Steenbergen JE, Richardus JH, Voeten HA . 2011 Perceived risk, anxiety, and behavioural responses of the general public during the early phase of the influenza A (H1N1) pandemic in The Netherlands: results of three consecutive online surveys. BMC Public Health 11, 1. (doi:10.1186/1471-2458-11-2) Crossref, PubMed, Web of Science, Google Scholar - 25.
Cong Z, Lv Q, Yan J, Huang X . 2003 Beijing da xue xue bao. Yi xue ban=Journal of Peking University. Health sci. 35, 47-50. PubMed, Google Scholar - 26.
Deurenberg-Yap M, Foo LL, Low YY, Chan SP, Vijaya K, Lee M . 2005 The Singaporean response to the SARS outbreak: knowledge sufficiency versus public trust. Health Promot. Int. 20, 320-326. (doi:10.1093/heapro/dai010) Crossref, PubMed, Web of Science, Google Scholar - 27.
Huremović D . 2019 Psychiatry of pandemics: a mental health response to infection outbreak. Berlin, Germany: Springer. Crossref, Google Scholar - 28.
Maunder RG . 2009 Was SARS a mental health catastrophe? Gen. Hosp. Psychiatry 31, 316-317. (doi:10.1016/j.genhosppsych.2009.04.004) Crossref, PubMed, Web of Science, Google Scholar - 29.
Reynolds D, Garay J, Deamond S, Moran M, Gold W, Styra R . 2008 Understanding, compliance and psychological impact of the SARS quarantine experience. Epidemiol. Infect. 136, 997-1007. (doi:10.1017/s0950268807009156) Crossref, PubMed, Web of Science, Google Scholar - 30.
Hawryluck L, Gold WL, Robinson S, Pogorski S, Galea S, Styra R . 2004 SARS control and psychological effects of quarantine, Toronto, Canada. Emerg. Infect. Dis. 10, 1206-1212. (doi:10.3201/eid1007.030703) Crossref, PubMed, Web of Science, Google Scholar - 31.
Baucom KJW, Queen TL, Wiebe DJ, Turner SL, Wolfe KL, Godbey EI, Fortenberry KT, Mansfield JH, Berg CA . 2015 Depressive symptoms, daily stress, and adherence in late adolescents with type 1 diabetes. Health Psychol. 34, 522-530. (doi:10.1037/hea0000219) Crossref, PubMed, Web of Science, Google Scholar - 32.
Mugavero MJ, Raper JL, Reif S, Whetten K, Leserman J, Thielman NM, Pence BW . 2009 Overload: impact of incident stressful events on antiretroviral medication adherence and virologic failure in a longitudinal, multisite human immunodeficiency virus cohort study. Psychosom. Med. 71, 920-926. (doi:10.1097/PSY.0b013e3181bfe8d2) Crossref, PubMed, Web of Science, Google Scholar - 33.
Singh N, Squier C, Sivek C, Wagener M, Nguyen MH, Yu VL . 1996 Determinants of compliance with antiretroviral therapy in patients with human immunodeficiency virus: prospective assessment with implications for enhancing compliance. AIDS Care 8, 261-269. (doi:10.1080/09540129650125696) Crossref, PubMed, Web of Science, Google Scholar - 34.
Perez V, Uddin M, Galea S, Monto AS, Aiello AE . 2012 Stress, adherence to preventive measures for reducing influenza transmission and influenza-like illness. J. Epidemiol. Community Health 66, 605-610. (doi:10.1136/jech.2010.117002) Crossref, PubMed, Web of Science, Google Scholar - 35.
Oliver DC . 1991 Psychological effects of isolation and confinement of a winter-over group at McMurdo Station, Antarctica. In From Antarctica to outer space: life in isolation and confinement (edsHarrison AA, Clearwater YA, McKay CP ), pp. 217-227. Berlin, Germany: Springer. Crossref, Google Scholar - 36.
Palinkas LA, Suedfeld P . 2008 Psychological effects of polar expeditions. Lancet 371, 153-163. (doi:10.1016/s0140-6736(07)61056-3) Crossref, PubMed, Web of Science, Google Scholar - 37.
Karvinen KH, Murray NP, Arastu H, Allison RR . 2013 Stress reactivity, health behaviors, and compliance to medical care in breast cancer survivors. Oncol. Nurs. Forum 40, 149-156. (doi:10.1188/13.onf.149-156) Crossref, PubMed, Web of Science, Google Scholar - 38.
Hitchcock PB, Brantley PJ, Jones GN, McKnight GT . 1992 Stress and social support as predictors of dietary compliance in hemodialysis patients. Behav. Med. 18, 13-20. (doi:10.1080/08964289.1992.10544236) Crossref, PubMed, Web of Science, Google Scholar - 39.
Lynch DA . 1999 Sources of stress, perceived stress levels, and levels of self-esteem among career oriented mothers who are employed full-time, part-time, and those who opted to stay home full-time. Unpublished doctoral dissertation. Seton Hall University. Dissertation Abstracts International, 60(3-B), 1307. Google Scholar - 40.
Neighbors HW . 1997 Husbands, wives, family, and friends: Sources of stress, sources of support. In Family life in black America (edsTaylor RJ, Jackson JS, Chatters LM. ), pp. 277-292. Thousand Oaks, CA: Sage Publications. Google Scholar - 41.
Gilles I, Bangerter A, Clémence A, Green EG, Krings F, Staerklé C, Wagner-Egger P . 2011 Trust in medical organizations predicts pandemic (H1N1) 2009 vaccination behavior and perceived efficacy of protection measures in the Swiss public. Eur. J. Epidemiol. 26, 203-210. (doi:10.1007/s10654-011-9577-2) Crossref, PubMed, Web of Science, Google Scholar - 42.
Lin TTC, Bautista JR . 2016 Predicting intention to take protective measures during haze: the roles of efficacy, threat, media trust, and affective attitude. J. Health Commun. 21, 790-799. (doi:10.1080/10810730.2016.1157657) Crossref, PubMed, Web of Science, Google Scholar - 43.
Mak WW, Law RW, Woo J, Cheung FM, Lee D . 2009 Social support and psychological adjustment to SARS: the mediating role of self-care self-efficacy. Psychol. Health 24, 161-174. (doi:10.1080/08870440701447649) Crossref, PubMed, Web of Science, Google Scholar - 44.
Wang X, Cai L, Qian J, Peng J . 2014 Social support moderates stress effects on depression. Int. J. Mental Health Syst. 8, 41. (doi:10.1186/1752-4458-8-41) Crossref, PubMed, Web of Science, Google Scholar - 45.
Griffin RJ, Dunwoody S . 2000 The relation of communication to risk judgment and preventive behavior related to lead in tap water. Health Commun. 12, 81-107. (doi:10.1207/S15327027HC1201_05) Crossref, PubMed, Web of Science, Google Scholar - 46.
Weiss RS . 1974 The provisions of social relationships. In Doing unto others: joining, molding, conforming, helping, loving (edRubin Z. ), pp. 17-26. Englewood Cliffs, NJ: Prentice-Hall. Google Scholar - 47.
Steigen AM, Bergh D . 2018 The social provisions scale: psychometric properties of the SPS-10 among participants in nature-based services. Disabil. Rehabil. 41, 1690-1698. (doi:10.1080/09638288.2018.1434689) Crossref, PubMed, Web of Science, Google Scholar - 48.
Cohen S . 2004 Social relationships and health. Am. Psychol. 59, 676-684. (doi:10.1037/0003-066x.59.8.676) Crossref, PubMed, Web of Science, Google Scholar - 49.
Cohen S, Wills TA . 1985 Stress, social support, and the buffering hypothesis. Psychol. Bull. 98, 310-357. (doi:10.1037/0033-2909.98.2.310) Crossref, PubMed, Web of Science, Google Scholar - 50.
Chan CS, Lowe SR, Weber E, Rhodes JE . 2015 The contribution of pre- and post-disaster social support to short- and long-term mental health after Hurricanes Katrina: a longitudinal study of low-income survivors. Soc. Sci. Med. 138, 38-43. (doi:10.1016/j.socscimed.2015.05.037) Crossref, PubMed, Web of Science, Google Scholar - 51.
Adewuya AO, Afolabi MO, Ola BA, Ogundele OA, Ajibare AO, Oladipo BF, Fakande I . 2010 The effect of psychological distress on medication adherence in persons with HIV infection in Nigeria. Psychosomatics: J. Consult. Liaison Psychiatry 51, 68-73. (doi:10.1016/S0033-3182(10)70661-7) Google Scholar - 52.
Kuo BCH . 2011 Culture's consequences on coping: theories, evidence and dimensionalities. J. Cross-cultural Psychol. 42, 1084-1100. (doi:10.1177/0022022110381126) Crossref, Web of Science, Google Scholar - 53.
Lee H, Mason D . 2014 Cultural and gender differences in coping strategies between Caucasian American and Korean American older people. J. Cross Cult. Gerontol. 29, 429-446. (doi:10.1007/s10823-014-9241-x) Crossref, PubMed, Google Scholar - 54.
Bennett B, Carney T . 2010 Law, ethics and pandemic preparedness: the importance of cross-jurisdictional and cross-cultural perspectives. Aust. N Z J. Public Health 34, 106-112. (doi:10.1111/j.1753-6405.2010.00492.x) Crossref, PubMed, Web of Science, Google Scholar - 55.
Salvador C, Berg M, Yu Q, Alvaro SM, Kitayama S . 2020 Relational mobility predicts a faster spread of COVID-19: a 39 country study. Psychol. Sci. 31, 1236-1244. (doi:10.1177/0956797620958118) Crossref, PubMed, Web of Science, Google Scholar - 56.
Hox J . 2010 Multilevel analysis: techniques and applications, 2nd edn. New York, NY: Routledge. Crossref, Google Scholar - 57.
Cohen S, Kamarck T, Mermelstein R . 1983 A global measure of perceived stress. J. Health Soc. Behav. 24, 385. (doi:10.2307/2136404) Crossref, PubMed, Web of Science, Google Scholar - 58. The COVIDiSTRESS global survey network. 2020 COVIDiSTRESS global survey pre-registration. Open Sci. Framework (doi:10.17605/osf.io/z39us) Google Scholar
- 59.
Yamada Y 2020 COVIDiSTRESS global survey dataset on psychological and behavioural consequences of the COVID-19 outbreak. Sci. Data 8, 3. (doi:10.1038/s41597-020-00784-9) Crossref, Web of Science, Google Scholar - 60.
- 61.
- 62.
Coffé H, Bolzendahl C . 2010 Same game, different rules? Gender differences in political participation. Sex Roles 62, 318-333. (doi:10.1007/s11199-009-9729-y) Crossref, PubMed, Web of Science, Google Scholar - 63.
Aldwin CM, Sutton KJ, Chiara G, Spiro A . 1996 Age differences in stress, coping, and appraisal: findings from the normative aging study. J. Gerontol. Ser. B Psychol. Sci. Soc. Sci. 51B, P179-P188. (doi:10.1093/geronb/51b.4.p179) Google Scholar - 64.
Dalton RJ . 2005 The social transformation of trust in government. In. Rev. Sociol. 15, 133-154. (doi:10.1080/03906700500038819) Google Scholar - 65.
Haushofer J, Fehr E . 2014 On the psychology of poverty. Science 344, 862-867. (doi:10.1126/science.1232491) Crossref, PubMed, Web of Science, Google Scholar - 66.
Schütte S, Chastang JF, Parent-Thirion A, Vermeylen G, Niedhammer I . 2014 Social inequalities in psychological well-being: a European comparison. Commun. Ment. Health J. 50, 987-990. (doi:10.1007/s10597-014-9725-8) Crossref, PubMed, Web of Science, Google Scholar - 67.
Arend MG, Schäfer T . 2019 Statistical power in two-level models: a tutorial based on Monte Carlo simulation. Psychol. Methods 24, 1-19. (doi:10.1037/met0000195) Crossref, PubMed, Web of Science, Google Scholar - 68.
Kreft I, de Leeuw J . 1998 Introducing multilevel modeling. Thousand Oaks, CA: Sage Publications. Crossref, Google Scholar - 69.
Krosnick JA, Alwin DF . 1987 An evaluation of a cognitive theory of response-order effects in survey measurement. Public Opin Q. 51, 201-219. (doi:10.1086/269029) Crossref, Web of Science, Google Scholar - 70.
Egleston BL, Miller SM, Meropol NJ . 2011 The impact of misclassification due to survey response fatigue on estimation and identifiability of treatment effects. Stat. Med. 30, 3560-3572. (doi:10.1002/sim.4377) Crossref, PubMed, Web of Science, Google Scholar - 71.
Curran PG . 2016 Methods for the detection of carelessly invalid responses in survey data. J. Exp. Soc. Psychol. 66, 4-19. (doi:10.1016/j.jesp.2015.07.006) Crossref, Web of Science, Google Scholar - 72.
Dupuis M, Meier E, Cuneo F . 2019 Detecting computer-generated random responding in questionnaire-based data: a comparison of seven indices. Behav. Res. Methods 51, 2228-2237. (doi:10.3758/s13428-018-1103-y) Crossref, PubMed, Web of Science, Google Scholar - 73.
McHorney CA, Tarlov AR . 1995 Individual-patient monitoring in clinical practice: are available health status surveys adequate? Qual. Life Res. 4, 293-307. (doi:10.1007/BF01593882) Crossref, PubMed, Web of Science, Google Scholar - 74.
Cohen S, Williamson G . 1988 Perceived stress in a probability sample of the U.S. In The Social Psychology of Health: Claremont Symposium on Applied Social Psychology (edsSpacapam S, Oskamp S ). Newbury Park, CA: Sage. Google Scholar - 75.
Chaaya M, Osman H, Naassan G, Mahfoud Z . 2010 Validation of the Arabic version of the Cohen perceived stress scale (PSS-10) among pregnant and postpartum women. BMC Psychiatry 10, 1. (doi:10.1186/1471-244x-10-111) Crossref, PubMed, Web of Science, Google Scholar - 76.
Roberti JW, Harrington LN, Storch EA . 2006 Further psychometric support for the 10-item version of the perceived stress scale. J. Coll. Counseling 9, 135-147. (doi:10.1002/j.2161-1882.2006.tb00100.x) Crossref, Google Scholar - 77.
Hu LT, Bentler PM . 1999 Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct. Eq. Model Multidisc. J. 6, 1-55. (doi:10.1080/10705519909540118) Crossref, Web of Science, Google Scholar - 78.
Milfont TL, Fischer R . 2010 Testing measurement invariance across groups: applications in cross-cultural research. Int. J. Psychol. Res. 3, 111-130. (doi:10.21500/20112084.857) Crossref, Google Scholar - 79.
Feinian Chen C, Bollen PJ, Kirby KA, & Paxton J . 2008 An empirical evaluation of the use of fixed cutoff points in RMSEA test statistic in structural equation models. Sociol. Methods Res. 36, 462-494. (doi:10.1177/0049124108314720) Crossref, PubMed, Web of Science, Google Scholar - 80.
Cheung GW, Rensvold RB . 2002 Evaluating goodness-of-fit indexes for testing measurement invariance. Struct. Eq. Model. Multidisc. J. 9, 233-255. (doi:10.1207/s15328007sem0902_5) Crossref, Web of Science, Google Scholar - 81.
Byrne BM, Shavelson RJ, Muthén B . 1989 Testing for the equivalence of factor covariance and mean structures: the issue of partial measurement invariance. Psychol. Bull. 105, 456-466. (doi:10.1037/0033-2909.105.3.456) Crossref, Web of Science, Google Scholar - 82.
Davidov E, Meuleman B, Cieciuch J, Schmidt P, Billiet J . 2014 Measurement equivalence in cross-national research. Annu. Rev. Sociol. 40, 55-75. (doi:10.1146/annurev-soc-071913-043137) Crossref, Web of Science, Google Scholar - 83.
Rutkowski L, Svetina D . 2014 Assessing the hypothesis of measurement invariance in the context of large-scale international surveys. Edu. Psychol. Meas. 74, 31-57. (doi:10.1177/0013164413498257) Crossref, Web of Science, Google Scholar - 84.
Jang S 2017 Measurement invariance of the satisfaction with life scale across 26 countries. J. Cross-Cultural Psychol. 48, 560-576. (doi:10.1177/0022022117697844) Crossref, Web of Science, Google Scholar - 85.
Asparouhov T, Muthén B . 2014 Multiple-group factor analysis alignment. Struct. Eq. Model. Multidisc. J. 21, 495-508. (doi:10.1080/10705511.2014.919210) Crossref, Web of Science, Google Scholar - 86.
Han H, Park J, Thoma SJ . 2018 Why do we need to employ Bayesian statistics and how can we employ it in studies of moral education?: with practical guidelines to use JASP for educators and researchers. J. Moral Edu. 47, 519-537. (doi:10.1080/03057240.2018.1463204) Web of Science, Google Scholar - 87.
Hoffman L . 2015 Longitudinal analysis: modeling within-person fluctuation and change. New York, NY: Routledge. Crossref, Google Scholar - 88.
Wagenmakers E 2018 Bayesian inference for psychology. Part II: example applications with JASP. Psychon. Bull. Rev. 25, 58-76. (doi:10.3758/s13423-017-1323-7) Crossref, PubMed, Web of Science, Google Scholar - 89.
Benjamin DJ 2018 Redefine statistical significance. Nat. Hum. Behav. 2, 6-10. Crossref, PubMed, Web of Science, Google Scholar - 90.
Han H . 2020 Implementation of Bayesian multiple comparison correction in the second-level analysis of fMRI data: with pilot analyses of simulation and real fMRI datasets based on voxelwise inference. Cogn. Neurosci. 11, 157-169. (doi:10.1080/17588928.2019.1700222) Crossref, PubMed, Web of Science, Google Scholar - 91.
Rouder JN, Morey RD . 2012 Default Bayes factors for model selection in regression. Multivariate Behav. Res. 47, 877-903. (doi:10.1080/00273171.2012.734737) Crossref, PubMed, Web of Science, Google Scholar - 92. World Bank. 2020 World Development Indicators. See https://datacatalog.worldbank.org/dataset/world-development-indicators. Google Scholar
- 93.
Aiken LS, West SG . 1991 Multiple regression: testing and interpreting interactions. Thousand Oaks, CA: Sage Publications. Google Scholar - 94.
Bol D, Giani M, Blais A, Loewen PJ . 2020 The effect of COVID-19 lockdowns on political support: some good news for democracy? Eur. J. Polit. Res. (doi:10.1111/1475-6765.12401) Crossref, Web of Science, Google Scholar - 95.
Bargain O, Aminjonov U . 2020 Trust and compliance to public health policies in times of COVID-19. Bordeaux Economics Working Paper BxWP2020-06. https://ideas.repec.org/p/grt/bdxewp/2020-06.html. Google Scholar - 96.
Dryhurst S, Schneider CR, Kerr J, Freeman ALJ, Recchia G, Marthe van der Bles A, Spiegelhalter D, van der Linden S . 2020 Risk perceptions of COVID-19 around the world. J. Risk Res. 23, 994-1006. (doi:10.1080/13669877.2020.1758193) Crossref, Web of Science, Google Scholar - 97.
Kowal M 2020 Who is the most stressed during the COVID-19 pandemic? Data from 26 countries and areas. Appl. Psychol. Health and Well-Being 12, 946-966. (doi:10.1111/aphw.12234) Crossref, PubMed, Web of Science, Google Scholar - 98.
Codagnone C, Bogliacino F, Gómez C, Charris R, Montealegre F, Liva G, Lupiáñez-Villanueva F, Folkvord F, Veltri GA . 2020 Assessing concerns for the economic consequence of the COVID-19 response and mental health problems associated with economic vulnerability and negative economic shock in Italy, Spain, and the United Kingdom. PLoS ONE 15, e0240876. (doi:10.1371/journal.pone.0240876) Crossref, PubMed, Web of Science, Google Scholar - 99.
Fontanesi L, Marchetti D, Mazza C, Di Giandomenico S, Roma P, Verrocchio MC . 2020 The effect of the COVID-19 lockdown on parents: a call to adopt urgent measures. Psychol. Trauma 12, S79-S81. (doi:10.1037/tra0000672) Crossref, PubMed, Web of Science, Google Scholar - 100.
Fetzer T 2020 Perceptions of an insufficient government response at the onset of the COVID-19 pandemic are associated with lower mental well-being. PsyArXiv. (doi:10.31234/osf.io.3kfmh) Google Scholar - 101.
Chang WC, Sivam R . 2004 Constant vigilance: heritage values and defensive pessimism in coping with severe acute respiratory syndrome in Singapore. Asian J. Soc. Psychol. 7, 35-53. (doi:10.1111/j.1467-839x.2004.00133.x) Crossref, Web of Science, Google Scholar - 102.
Tang AC, Kwong EW, Chen L, Cheng WL . 2020 Associations between demographic characteristics, perceived threat, perceived stress, coping responses and adherence to COVID-19 prevention measures among healthcare students in China: A cross-sectional survey with implications for the control of COVID-19. medRxiv. (doi:10.1101/2020.07.15.20154997) Google Scholar - 103.
Habersaat KB 2020 Ten considerations for effectively managing the COVID-19 transition. Nat. Hum. Behav. 4, 677-687. (doi:10.1038/s41562-020-0906-x) Crossref, PubMed, Web of Science, Google Scholar - 104.
Barin B, Yoldascan BE, Savaskan F, Ozbalikci G, Karaderi T, Cakal H . In press. Joint investigation of two-month post-diagnosis IgG antibody levels and psychological measures for assessing longer term multi-faceted recovery among COVID-19 cases in Northern Cyprus. Front. Public Health (doi:10.3389/fpubh.2020.590096) Google Scholar