December 14, 2024

Best Health Ideas

Every Health & Fitness Helps

A pooled self-controlled case series study of 11.6 million individuals in England, Scotland, and Wales

A pooled self-controlled case series study of 11.6 million individuals in England, Scotland, and Wales

Abstract

Methods and findings

We created data platforms consisting of linked primary care, secondary care, mortality, and virological testing data in each of England, Scotland, and Wales, with a combined cohort of 11,637,157 people and 6,808,293 person years of follow-up. The cohort start date was December 8, 2020, and the end date was June 30, 2021. The outcome measure we examined was incident CVST events recorded in either primary or secondary care records. We carried out a self-controlled case series (SCCS) analysis of this outcome following first dose vaccination with ChAdOx1 and BNT162b2. The observation period consisted of an initial 90-day reference period, followed by a 2-week prerisk period directly prior to vaccination, and a 4-week risk period following vaccination. Counts of CVST cases from each country were tallied, then expanded into a full dataset with 1 row for each individual and observation time period. There was a combined total of 201 incident CVST events in the cohorts (29.5 per million person years). There were 81 CVST events in the observation period among those who a received first dose of ChAdOx1 (approximately 16.34 per million doses) and 40 for those who received a first dose of BNT162b2 (approximately 12.60 per million doses). We fitted conditional Poisson models to estimate incidence rate ratios (IRRs). Vaccination with ChAdOx1 was associated with an elevated risk of incident CVST events in the 28 days following vaccination, IRR = 1.93 (95% confidence interval (CI) 1.20 to 3.11). We did not find an association between BNT162b2 and CVST in the 28 days following vaccination, IRR = 0.78 (95% CI 0.34 to 1.77). Our study had some limitations. The SCCS study design implicitly controls for variables that are constant over the observation period, but also assumes that outcome events are independent of exposure. This assumption may not be satisfied in the case of CVST, firstly because it is a serious adverse event, and secondly because the vaccination programme in the United Kingdom prioritised the clinically extremely vulnerable and those with underlying health conditions, which may have caused a selection effect for individuals more prone to CVST. Although we pooled data from several large datasets, there was still a low number of events, which may have caused imprecision in our estimates.

Introduction

There have been concerns over possible associations between some Coronavirus Disease 2019 (COVID-19) vaccines and hematological and vascular adverse events, including, in particular, cerebral venous sinus thrombosis (CVST) following ChAdOx1 nCoV-19 (Oxford/AstraZeneca; henceforth ChAdOx1). A number of case reports and case series of CVST following adenovirus vector COVID-19 vaccination have been published [15]. A potential link between ChAdOx1 was initially noted by the European Medicines Agency (EMA) in a safety update on March 29, 2021 [6]. On April 8, 2021, the EMA issued an analysis of pharmacovigilance data covering the European Economic Area that found a safety signal for CVST following ChAdOx1 vaccination, risk ratio = 7.73 (95% confidence interval (CI) 5.35 to 10.80) [7]. An observed versus expected analysis using data from the Mayo Clinic Health System in the United States found a relative risk of 1.50 (95% CI 0.28 to 7.10) of CVST in a combined analysis of COVID-19 vaccines [8]. An observed versus expected analysis in Denmark and Norway found a standardised morbidity ratio of 20.25 (95% CI 8.14 to 41.73) for cerebral venous thrombosis following ChAdOx1 vaccination [9]. A self-controlled case series (SCCS) using the QResearch database in England found incidence rate ratio (IRR) in the 8 to 28 days following vaccination of 2.37 (95% CI 1.34 to 4.21) for ChAdOx1 and 1.93 (95% CI 0.87 to 4.28) for BNT162b2 [10]. Several countries suspended ChAdOx1 or restricted its use to older age groups due to these and other safety concerns [11]. The Joint Committee on Vaccination and Immunisation (JCVI), an independent UK-wide body that advises the government on vaccine approval, has recommended that adults under the age of 40 should be offered an alternative to the ChAdOx1 vaccine, if available [12,13].

At the time of writing, 3 vaccines are being administered in the UK: ChAdOx1, BNT162b2 (Pfizer-BioNTech), and mRNA-1273 (Moderna). They have all shown high levels of efficacy in Phase II and III clinical trials [1416]. ChAdOx1 and BNT162b2 have also shown high levels of “real-world effectiveness” against COVID-19 hospitalisation and death [17,18]. Vaccine rollout in the UK started with BNT162b2 on December 8, 2020, followed by ChAdOx1 on January 4, 2021 and mRNA-1273 on April 7, 2021. Guidance from the JCVI included a list of priority groups with the elderly, frontline social and health care workers, and the clinically extremely vulnerable at the highest levels of priority (S2 File). Relatively few people in our cohort were vaccinated with mRNA-1273, so this study focused on BNT162b2 and ChAdOx1 only.

The aim of this study was to investigate possible associations between COVID-19 vaccines and CVST. We carried out a SCCS study of CVST events following first dose vaccination with ChAdOx1 and BNT162b2. The data platform used in this study consisted of linked primary care, secondary care, mortality and virological testing data stored in secure trusted research environments (TREs) in each of England, Scotland, and Wales. CVST is an extremely rare event, with an estimated incidence of 3 to 4 per million person years in adults [19]. In our previous analysis exploring COVID-19 vaccine associations with thrombocytopenic, thromboembolic, and hemorrhagic events using Scottish national data, there were insufficient CVST events to undertake a statistical analysis [20]. We were not able to reliably estimate the association between COVID-19 vaccines and CVST with any individual country-specific dataset due to the low number of events. In order to address this, we pooled incident CVST cases from each of the datasets and carried out a SCCS analysis to estimate IRRs for CVST in those who received a first dose of ChAdOx1 or BNT162b2 vaccines.

Methods

Study design and population

We followed a prespecified statistical analysis plan (S3 File). The datasets consisted of linked primary care, secondary care, mortality, and virological testing data stored in secure TREs in each of England, Scotland, and Wales (Fig 1). These data were deterministically linked using unique patient identifiers—NHS number in England and Community Health Index (CHI) number in Scotland. In Wales, a combination of deterministic linkage based on NHS number and probabilistic linkage based personal identifiers was used. Anyone under the age of 16 at the date of event was excluded. A case was defined as anyone in our cohorts with a CVST event following the start of the COVID-19 vaccination programme in the UK. An incident case was defined as the first such event in the cohort time period. The cohort start date was December 8, 2020, and the end date was June 30, 2021.

In accordance with our statistical analysis plan, we initially sought to carry out a meta-analysis of estimates from each country. However, there were too few events in each country for this to be feasible. As a result, we undertook a pooled analyses of aggregate count data from each country. We sought to carry out both a SCCS study and a case–control study using pooled data. However, the case–control study would have required sharing of individual-level information, which was not permitted under the data governance rules implemented by each country’s TREs. Therefore, we focused on the pooled SCCS study.

The observation period for the SCCS started 104 days before first dose vaccination and ended 28 days after first dose vaccination (Fig 2). The reference period was defined as the first 90 days of the observation period. The prerisk period was defined as the 14-day period prior to first dose vaccination. The risk period was defined as 0 to 28 days post–first dose vaccination. No individual was censored because we examined incident cases only. We pooled data across the 3 nations on incident cases during the observation period around first dose vaccination with ChAdOx1 or BNT162b2 (Fig 3). Each stratum consisted of an incident case during the reference, prerisk, and risk periods.

Outcomes

The outcome of interest was incident CVST cases in the observation period. SNOMED codes were used to identify CVST events recorded in primary care electronic health records in England, and Read Codes (Version 2) were used in Scotland and Wales (S4 File). International Classification of Diseases-10th Revision (ICD-10) codes were used to identify CVST events in hospital admission records (S4 File). SNOMED and Read Codes have hierarchies that enable thromboembolic events to be grouped by their location. These enable recording of the diagnosis of an event of interest—for example, a thromboembolic event could be recorded as intracranial, with further subdivisions into CVST, intracranial thrombophlebitis, and thrombosis of cerebral veins, within the SNOMED hierarchy. The code lists used in this study were drawn up by the Early Assessment of Vaccine and antiviral Effectiveness (EAVE) II clinical team and validated by experts in neurology and hematology.

Statistical analysis

The data governance procedure of the TREs in each country did not allow for individual level data to be shared. However, we obtained permissions to confidentially share counts of individuals stratified by categories, on the understanding that these would be combined in a pooled count. For a SCCS study of the rate ratios (RRs) of incident events in the observation time periods that does not include any covariates, the only information that is required to estimate the conditional Poisson model is event counts in the reference, prerisk, and risk periods. Analysts in each country had full access to their country’s data. Counts of incident cases in the reference, prerisk, and risk periods stratified by vaccine type received were collated in each nation. These were then gathered in the Scottish TRE and expanded into a full dataset with 1 row per individual and observation time period. Synthetic IDs were generated in order to distinguish distinct incident cases in the count data from each other and to label the strata in the model. The process of pooling the data is explained in more detail in the Supporting information (S5 File). IRRs and their 95% CIs were estimated using a conditional Poisson model, with cases during the reference, prerisk, and risk periods as the strata and an offset for the length of each time period. The reference period was taken as the baseline period for calculating IRRs. Conditional Poisson models have a likelihood function that is identical to the corresponding conditional logistic model [21]. Furthermore, incident events can occur at most once. Thus, we used the clogit function for conditional logistic regression from the survival package in R to fit the model. Following a suggestion from one of the reviewers, we undertook 2 post hoc sensitivity analyses: The first excluded any cases who died within 90 days of their event in order to explore the SCCS assumption of event-dependent exposure, and the second focused only on CVST cases identified in secondary care records.

Results

The cohorts started on December 8, 2020 and ended on June 30, 2021. Tables 13 show the marginal distributions of a number of characteristics in each country’s cohort. Clinical risk groups in these tables were derived from the QCovid algorithm [24]. Among the approximately 4.95 million people vaccinated with ChAdOx1, there were 45 incident cases of CVST during the 90-day reference period and 27 incident cases of CVST during the 28-day postvaccine risk period. We found an IRR of 1.93 (95% CI 1.20 to 3.11) in the risk period following first dose vaccination with ChAdOx1 and an IRR of 0.78 (95% CI 0.34 to 1.77) in the risk period following first dose vaccination with BNT162b2 (Table 4). Assuming a baseline incidence of 3 to 4 cases of CVST per million people per year outside of the risk period, our estimates imply an absolute risk of 0.44 to 0.59 incident CVST cases per million people in the 4-week risk period following vaccination with ChAdOx1.

We sought to carry out a post hoc sensitivity analysis focusing on CVST events identified in secondary care records only; however, there were too few events to permit useful estimation of IRRs. We carried out a post hoc sensitivity analysis excluding anyone who died within 90 days of their CVST event. The only estimate that changed from our main analysis was that for the risk period following vaccination with ChAdOx1, the IRR was 1.79 (95% CI 1.10 to 2.91) (S6 File).

Within each nation, we plotted histograms of event counts in the observation period in order to explore the suitability of the prerisk period to account for event-dependent exposure to vaccination. There appeared to be a reduction in events in the 2-week prerisk period, but no obvious reduction outside of that time period. We are unable to share these histograms due to the statistical disclosure principles enacted by the TREs that hosted this analysis.

Discussion

Our pooled SCCS analysis of national datasets from England, Scotland, and Wales found an elevated risk of CVST in the 4-week period following vaccination with ChAdOx1. We did not find an association between BNT162b2 and CVST.

There have hitherto been few population-based studies estimating the association between COVID-19 vaccines and CVST. Such analyses are made challenging by the extreme rarity of CVST. Our study corroborates previous observed–expected analyses from the EMA [7], the Mayo Clinic Health System [8], a population-based study in Denmark and Norway [9], and a SCCS using the QResearch database in England [10]. Our results are broadly consistent with the latter study [10], as would be expected due to the similar study design and population. Our estimated RRs are, however, notably smaller than risk ratios reported in [79]. This is likely due to the fact that we conducted a SCCS that implicitly controls for variables that are constant over the observation period, as opposed to an observed–expected analysis.

A limitation in the SCCS analysis is the assumption that occurrence of an event does not affect subsequent exposure [25]. CVST is a serious adverse event that can be life threatening. Therefore, the assumption of event-independent exposure may not have been satisfied. This could have caused a selection effect where individuals who were more likely to have a CVST event were less likely to be vaccinated and thus less likely to be included in our analysis. A large multinational study of prognosis for CVST found a death rate of 4.3% and a death or dependency rate of 18.9% at hospital discharge, where dependency was defined as a score of >2 on the modified Rankin scale [26]. On the other hand, among the JCVI priority groups for vaccination are “clinically extremely vulnerable individuals” (group 4), and “all individuals aged 16 to 64 years with underlying health conditions which put them at higher risk of serious disease and mortality” (group 6) (S2 File). It is possible that the vaccination programme created a selection effect for vaccination of people more prone to CVST events.

In order to explore the validity of the assumption of event-independent exposure, we carried out a sensitivity analysis excluding those who died within 90 days of their event. This had a small effect on the IRR for the risk period following vaccination with ChAdOx1, with all other estimates unchanged. We also included a prerisk period in the SCCS study design to account for the possibility that occurrence of a CVST event affected subsequent vaccination and plotted histograms of event counts over time in order to assess its suitability. Our statistical analysis plan included a case–control analysis, which may have been useful to further explore this assumption. However, this would have required sharing more detailed data between TREs, which was not possible under the permissions in place.

We estimated IRRs as opposed to RRs. Estimating RRs with pooled data across the 3 nations could be achieved if we were able to share individual-level data. However, this was not permitted under the statistical disclosure rules implemented by the data controllers. We do not believe that the estimates for RRs and IRRs would be significantly different because of the rarity of CVST events.

We plan to extend our analysis to mRNA-1273 and to second and booster dose vaccinations. To date, there have been very few studies that have estimated the association between COVID-19 vaccine and CVST events using large-scale nationally representative datasets [79]. Although we had access to a large, combined cohort, there were still relatively few events. Further evidence corroborating our results is required.

In conclusion, we found an increased risk of CVST following first dose vaccination with ChAdOx1. We did not find an increased risk following first dose vaccination with BNT162b2. This evidence may be useful in risk–benefit evaluations for vaccine-related policies and in providing quantification of risks associated with vaccination to the general public.

References

  1. 1.
    Schultz NH, Sørvoll IH, Michelsen AE, Munthe LA, Lund-Johansen F, Ahlen MT, et al. Thrombosis and Thrombocytopenia after ChAdOx1 nCoV-19 Vaccination. N Engl J Med. 2021 Jun 3;384(22):2124–2130. Epub 2021 Apr 9. pmid:33835768; PMCID: PMC8112568.
  2. 2.
    Greinacher A, Thiele T, Warkentin TE, Weisser K, Kyrle PA, Eichinger S. Thrombotic Thrombocytopenia after ChAdOx1 nCov-19 Vaccination. N Engl J Med. 2021 Jun 3;384(22):2092–2101. Epub 2021 Apr 9. pmid:33835769; PMCID: PMC8095372.
  3. 3.
    See I, Su JR, Lale A, Woo EJ, Guh AY, Shimabukuro TT, et al. US Case Reports of Cerebral Venous Sinus Thrombosis With Thrombocytopenia After Ad26.COV2.S Vaccination, March 2 to April 21, 2021. JAMA. 2021;325(24):2448–56. pmid:33929487
  4. 4.
    Schultz NH, Sørvoll IH, Michelsen AE, Munthe LA, Lund-Johansen F, Ahlen MT, et al. Thrombosis and thrombocytopenia after ChAdOx1 nCoV-19 vaccination. N Engl J Med. pmid:33835768
  5. 5.
    Scully M, Singh D, Lown R, Poles A, Solomon T, Levi M, et al. Pathologic antibodies to platelet factor 4 after ChAdOx1 nCoV-19 vaccination. N Engl J Med. 2021. pmid:33861525
  6. 6.
    European Medicines Agency, COVID-19 vaccine safety update, 29 March 2021. [cited 2021 Sep 27]. Available from: https://www.ema.europa.eu/en/documents/covid-19-vaccine-safety-update/covid-19-vaccine-safety-update-vaxzevria-previously-covid-19-vaccine-astrazeneca-29-march-2021_en.pdf
  7. 7.
    European Medicines Agency Pharmacovigilance Risk Assessment Committee (PRAC). Signal assessment report on embolic and thrombotic events (SMQ) with COVID-19 Vaccine (ChAdOx1-S [recombinant])–Vaxzevria (previously COVID-19 Vaccine AstraZeneca) (Other viral vaccines). 2021 [cited 2021 Sep 27]. Available from: https://www.ema.europa.eu/en/documents/prac-recommendation/signal-assessment-report-embolic-thrombotic-events-smq-covid-19-vaccine-chadox1-s-recombinant_en.pdf
  8. 8.
    Pawlowski C, Rincón-Hekking J, Awasthi S, Pandey V, Lenehan P, Venkatakrishnan AV, et al. Cerebral venous sinus thrombosis (CVST) is not significantly linked to COVID-19 vaccines or non-COVID vaccines in a large multi-state US health system. J Stroke Cerebrovasc Dis. pmid:34627592
  9. 9.
    Pottegård A, Lund LC, Karlstad DJ, Andersen M, Hallas J, et al. Arterial events, venous thromboembolism, thrombocytopenia, and bleeding after vaccination with Oxford-AstraZeneca ChAdOx1-S in Denmark and Norway: population based cohort study. BMJ. 2021;373(n1114). pmid:33952445
  10. 10.
    Hippisley-Cox J, Patone M, Mei XW, Saatci D, Dixon S, Khunti K, et al. Risk of thrombocytopenia and thromboembolism after covid-19 vaccination and SARS-CoV-2 positive testing: self-controlled case series study. BMJ. 2021;374(n1931). pmid:34446426
  11. 11.
    Wise J. Covid-19: European countries suspend use of Oxford-AstraZeneca vaccine after reports of blood clots. BMJ. 2021;372:n699. pmid:33707182
  12. 12.
    GOV.UK. JCVI statement on use of the AstraZeneca COVID-19 vaccine, 7 April 2021. [cited 2021 Sep 27]. Available from: https://www.gov.uk/government/publications/use-of-the-astrazeneca-covid-19-vaccine-jcvi-statement/jcvi-statement-on-use-of-the-astrazeneca-covid-19-vaccine-7-april-2021
  13. 13.
    GOV.UK. JCVI advises on COVID-19 vaccine for people aged under 40, 7 May 2021. [cited 2021 Sep 27]. Available from: https://www.gov.uk/government/news/jcvi-advises-on-covid-19-vaccine-for-people-aged-under-40
  14. 14.
    Polack FP, Thomas SJ, Kitchin N, Absalon J, Gurtman A, Lockhart, et al. Safety and Efficacy of the BNT162b2 mRNA Covid-19 Vaccine. N Engl J Med. 2020;383(27):2603–15. pmid:33301246
  15. 15.
    Voysey M, Clemens SAC, Madhi SA, Weckx LY, Folegatti PM, Aley PK, et al. Safety and efficacy of the ChAdOx1 nCoV-19 vaccine (AZD1222) against SARS-CoV-2: an interim analysis of four randomised controlled trials in Brazil, South Africa, and the UK. Lancet. 2021;397(10269):99–111. pmid:33306989
  16. 16.
    Baden LR, El Sahly HM, Essink B, Kotloff K, Frey S, Novak R et al. Efficacy and Safety of the mRNA-1273 SARS-CoV-2 Vaccine. N Engl J Med. 2021 Feb 4;384(5):403–416. Epub 2020 Dec 30. pmid:33378609; PMCID: PMC7787219.
  17. 17.
    Bernal JL, Andrews N, Gower C, Stowe J, Robertson C, Tessier E, et al. Early effectiveness of COVID-19 vaccination with BNT162b2 mRNA vaccine and ChAdOx1 adenovirus vector vaccine on symptomatic disease, hospitalisations and mortality in older adults in England. medRxiv. 2021.
  18. 18.
    Vasileiou E, Simpson CR, Shi T, Kerr S, Agrawal U, Akbari A, et al. Interim findings from first dose mass COVID-19 vaccination roll-out and COVID-19 hospitalisations in Scotland: National prospective cohort study of 5.4 million people. Lancet. 2021.
  19. 19.
    Filippidis A, Kapsalaki E, Patramani G, Fountas KN. Cerebral venous sinus thrombosis: review of the demographics, pathophysiology, current diagnosis, and treatment. J Neurosurg. 2009 Nov;27(5):E3. pmid:19877794.
  20. 20.
    Simpson CR, Shi T, Vasileiou E, Katikireddi SV, Kerr S, et al. First-dose ChAdOx1 and BNT162b2 COVID-19 vaccines and thrombocytopenic, thromboembolic and hemorrhagic events in Scotland. Nat Med. 2021;27:1290–7. pmid:34108714
  21. 21.
    Hausman JA, Hall BH, Griliches Z. Econometric models for count data with an application to the patents-R&D relationship. Econometrica. 1984;52,4:909–38.
  22. 22.
    Strengthening the reporting of observational studies in epidemiology (STROBE). [cited 2021 Sep 27]. Available from: https://www.strobe-statement.org
  23. 23.
    Reporting of studies using observational routinely-collected data (RECORD). [cited 2021 Sep 27]. Available from: https://www.record-statement.org
  24. 24.
    Clift AK, Coupland CAC, Keogh RH, Diaz-Ordaz K, Williamson E, Harrison EM, et al. Living risk prediction algorithm (QCOVID) for risk of hospital admission and mortality from coronavirus 19 in adults: national derivation and validation cohort study. BMJ. 2020;371:m3731. pmid:33082154
  25. 25.
    Petersen I, Douglas I, Whitaker H. Self controlled case series methods: an alternative to standard epidemiological study designs. BMJ. 2016 Sep 12;354:i4515. pmid:27618829.
  26. 26.
    Ferro JM, Canhão P, Stam J, Bousser MG, Barinagarrementeria F, ISCVT Investigators. Prognosis of cerebral vein and dural sinus thrombosis: results of the International Study on Cerebral Vein and Dural Sinus Thrombosis (ISCVT). Stroke. 2004 Mar;35(3):664–70. pmid:14976332.