Opinion: Dentistry, Diagnostic Test Accuracy (DTA) and the Covid-19 Antibody Test

Link to the Dental Elf

Virus Outbreak Germany

As we are acutely aware the whole country has been locked down in an attemp to reduce the spread of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2 (Covid-19)), while we restructure the healthcare systems and direct research funding into either a treatment and/or a vaccine. The next stage is to rapidly scale up diagnostic testing to collect robust base-rate data at both an individual, and population level for future high quality decision-making (Ioannidis, 2020). The need to know who has been infected will be particularily important for dental care professionals due to the potential risk of Covid-19 spread via aerosol generating procedures (Coulthard, 2020). So what is the current state of affairs regarding quick point-of-care antibody testing? How good is it, how good should it be, and why is this important?

Firstly I am going to use a recently published paper that evaluated 10 antibody tests for SARS-CoV-2 using Enzyme-Linked Immunosorbent Assay (ELISA) and Lateral Flow Immune Assay (LFIA), lateral flow assay utilise the same technology commonly used for pregnancy tests (Crook, 2020). This particular paper has sparked considerable controversy which I will go into later. If you need more detail on how these tests work and their advantages/disadvantages then please take a look at the Oxford COVID-19 Evidence Service (Green et al., 2020). When looking at diagnostic accuracy testing the two main concepts to understand are:

Sensitivity The ability of a diagnostic test to give a positive result when it is supposed to be positive.

Specificity The ability of a diagnostic test to indicate a negative result when it is supposed to be negative.

 Results

After extracting the primary data from the individual tests, meta-analysis was carried out using the ‘mada’ package in R. The summary estimate for sensitivity was 62.7% (95%CI: 57.5 to 67.7) and specificity 96.9% (95%CI: 95.2 to 98.0) The results for the ELISA test and the 9 LFIA tests were plotted below on to a Summary Receiver Operating Characteristic (sROC) curve ( See Figure 1). The y-axis represents the sensitivity (1.0 =100%), and the x-axis represents 1- specificity (0.10 = 10%). For a test to be perfect the summary estimate point should be in the top left corner representing 100% true-positives and 0% false-positives. The blue dot represents the summary estimate for the tests surrounded by a 95% confidence area, the red dot represents the specification target of >98% (95%CI: 96 to 100%)  for sensitivity, and >98% (95%CI: 96 to 100%) for specificity, set by the Medicines & Healthcare Products Regulatory Agency (MHRA., 2020).

Figure 1. sROC curve – Antibody tests

sROC_DT_1_LI (2)

Discussion

So why is so important to set the levels of sensitivity and specificity so high? Imagine we have a small city with a population of 100,000. The prevalence of people who have had the virus and recovered is 6%  and you are using an LFIA test with a sensitivity of 63% and specificity of 97%. Out of 6600 people who test positive for virus antibody only 3780 are true positives which corresponds to 57% having a correct positive diagnosis (See Figure 2.). Another important consideration is that 3% of the population who do not have antibodies test positive (n= 2820) and could lead them to believe they are immune.

Figure 2.Frequency tree of Covid-19 antibody screening

Annotation 2020-05-09 193854

The second point about this paper is that in its present format it cannot be used in any future analysis since the companies that supplied the tests required a commercial confidentiality agreement to be signed with the UK Department of Health making it impossible to discriminate between tests. The current set of results show poor performance, and that is why the MHRA has specifically set its targets high because of the risks that  results could pose if they were used to ease a lockdown, or they become part of an immunity passport system (Mahase., 2020; WHO, 2020). The final point is that whenever we have to deal with diagnostic tests or screening devices in either our professional or private lives we need to be able to identify the products, their comparators, and how accurate they are before making a significant decision to use or purchase the product. False-positive and false-negative results can pose significant harms to both ourselves and the population in general.

Disclaimer:  The article has not been peer-reviewed; it should not replace individual clinical judgement, and the sources cited should be checked. The views expressed in this commentary represent the views of the author and not necessarily those of the host institution. The views are not a substitute for professional advice.

References

COULTHARD, P. 2020. Dentistry and coronavirus (COVID-19) – moral decision-making. Br Dent J, 228, 503-505.

CROOK, D. W. 2020. Evaluation of antibody testing for SARS-CoV-2 using ELISA and lateral flow immunoassays [Online]. Department of Microbiology, John Radcliffe Hospital, Oxford, OX3 9DU, United Kingdom.  [Accessed].

GREEN, K., , A. W., DICKINSON, R., GRAZIADIO, S., ROBERT WOLFF, MALLETT, S. & ALLEN, A. J. 2020. What tests could potentially be used for the screening, diagnosis and monitoring of COVID-19 and what are their advantages and disadvantages? [Online]. Available: https://www.cebm.net/covid-19/what-tests-could-potentially-be-used-for-the-screening-diagnosis-and-monitoring-of-covid-19-and-what-are-their-advantages-and-disadvantages/ [Accessed].

IOANNIDIS, J. P. 2020. A fiasco in the making? As the coronavirus pandemic takes hold, we are making decisions without reliable data [Online]. STAT. Available: https://www.statnews.com/2020/03/17/a-fiasco-in-the-making-as-the-coronavirus-pandemic-takes-hold-we-are-making-decisions-without-reliable-data/ [Accessed].

MAHASE., E. 2020. Covid-19: Confidentiality agreements allow antibody test manufacturers to withhold evaluation results.

MHRA.2020.Target_Product_Profile_antibody_tests_to_help_determine_if_people_have_immunity_to_SARS-CoV-2_ [Online]. Available: https://www.gov.uk/guidance/guidance-on-coronavirus-covid-19-tests-and-testing-kits [Accessed].

WHO.2020. “Immunity passports” in the context of COVID-19 [Online]. Available: https://www.who.int/news-room/commentaries/detail/immunity-passports-in-the-context-of-covid-19 [Accessed].

Disclaimer: the article has not been peer-reviewed; it should not replace individual clinical judgement, and the sources cited should be checked. The views expressed in this commentary represent the views of the author. The views are not a substitute for professional medical advice.

 

What is the most appropriate gown/apron for preventing Covid-19 contaminated fluids transfer in dental practice?

Originally posted on the Dental Elf

L0028811 A nurse and a surgeon, both wearing gown and mask. Etching b

Question:

Which gown/apron combination provides the best protection in the dental practice?

Bottom-line answer:

From this reanalysis of the primary data the reusable cotton surgical gown may be more practical in the dental environment in the long-term than the disposable fluid resistant gown due to its reduce potential for cross contamination during use. The plastic apron creates the most cross contamination and should only be used if there is significant risk of fluid contamination.

Background

This paper is a reanalysis of a recent systematic review (Verbeek et al., 2020) on personal protective equipment (PPE), reframing the question to fit into the new clinical workflow created by Covid-19, and dental aerosol generating procedures (AGPs). I have covered face masks in a previous post.

Much has been written on the epidemiology of Covid-19 and its transmissibility via contact, droplets, aerosols, or faeco-oral route. The main concern within dentistry being the aerosol generated during many routine dental procedures (Coulthard, 2020). To reduce this contamination risk Public Health England’s guidance document for personal protective equipment updated 3 May 2020 Section 10.4 (GOV.UK, 2020) states that:-

‘Disposable fluid repellent coveralls or long-sleeved gowns must be worn when a disposable plastic apron provides inadequate cover of staff uniform or clothes for the procedure or task being performed, and when there is a risk of splashing of body fluids such as during AGPs in higher risk areas or in operative procedures. If non-fluid-resistant gowns are used, a disposable plastic apron should be worn’.

As this advice is generic and the workflow within a critical care unit differs from a dental practice it is important to evaluate the best available evidence from a primary care rather than secondary care perspective.

Method

To save unnecessary duplication of search strategies and risk of bias/quality assessments I utilised the most up to date Cochrane Review of PPE for preventing highly infectious diseases due to exposure to contaminated body fluids in healthcare staff (Verbeek et al., 2020). This systematic review included 17 studies with 1950 participants evaluating 21 interventions. The authors concluded:

‘We found low- to very low-certainty evidence that covering more parts of the body leads to better protection but usually comes at the cost of more difficult donning or doffing and less user comfort, and may therefore even lead to more contamination. More breathable types of PPE may lead to similar contamination but may have greater user satisfaction.’

The authors conclusion helped to focus the next stage of analysis which was based around the levels of contamination and wearability. From the included studies two randomised simulation trials, one of a parallel design (Wong et al., 2004) and a second of a cross-over design (Guo et al., 2014) were selected as they contained sufficient primary data to undertake a meta-analysis. A simulation trial utilises aerosolised fluorescent dye sprayed on the PPE instead of true viral contamination. It was possible to extract data on contamination of  fluid resistant disposable gowns, standard cotton surgical gowns, and plastic aprons. The data was placed in Excel and then transferred to R for meta-analysis using the ’meta’ package. A random effect model was used with a Hartung Knapp conversion due to variability within the studies. Prediction intervals were included to facilitate the estimation for future studies.

Findings

The first meta-analysis compared a fluid resistant disposable gown with a standard cotton gown for both Wong and Guo. In Guo’s study the group tried two methods of doffing PPE: their individual accustomed removal method (IARM), and gown removal methods recommended by the Centers for Disease Control and Prevention (CDC).

The overall result favoured the cotton gown, but the result was non-significant, the mean difference (MD) was 0.91 (95%CI: -0.34 to 2.66) (See Figure 1.). The second meta-analysis showed significantly less contamination of the cotton surgical gowns compared with the plastic apron, the  MD was 8.4 (95%CI: 0.59 to 16.2) (See Figure 2.). The final analysis looked at the  contamination of the clinician post PPE removal showing equal contamination between the different PPE types MD was -0.02 (95% CI: -1.43 to 1.40) (See Figure 3).

Figure 1.Forest plot of disposable fluid resistant gown vs cotton gown

FIGURE 1

Figure 2. Forest plot of plastic apron vs cotton gown

FIGURE 2.

Figure 3. Forest plot of body contamination

 FIGURE 3

Conclusion

From the results of the meta-analysis there is little difference between the disposable fluid resistant gown and the reusable cotton surgical gown in terms of contamination/protection of both the wearer, patient, and clinical environment. The results favour the cotton gown as cotton through its material and properties can absorb droplet contaminants and thereby reduce opportunities for such contaminants to spread to the environment. The plastic apron performed worst and may significantly increase the risk of cross contamination both to the clinician and patient and should only be necessary where there is a risk of serious fluid contamination.

There is an interesting paper recently published by Phan and co-workers (Phan et al., 2019) who observed that ‘90% of observed doffing was incorrect, with respect to the doffing sequence, doffing technique, or use of appropriate PPE. Common errors were doffing gown from the front, removing face shield of the mask, and touching potentially contaminated surfaces and PPE during doffing’.

These results presented are hypothetical and due to the lack of specific studies of virus penetration through gowns in dentistry and are based on surrogate, and composite outcomes. There is an urgent need for specific studies to address PPE performance in the dental surgery environment.

Disclaimer:  The article has not been peer-reviewed; it should not replace individual clinical judgement, and the sources cited should be checked. The views expressed in this commentary represent the views of the author and not necessarily those of the host institution. The views are not a substitute for professional advice.

References

COULTHARD, P. 2020. Dentistry and coronavirus (COVID-19) – moral decision-making. Br Dent J, 228, 503-505.

GOV.UK. 2020. COVID-19 ( personal protective equipment (PPE) [Online]. Available: https://www.gov.uk/government/publications/wuhan-novel-coronavirus-infection-prevention-and-control/covid-19-personal-protective-equipment-ppe [Accessed].

GUO, Y. P., LI, Y. & WONG, P. L. 2014. Environment and body contamination: a comparison of two different removal methods in three types of personal protective clothing. Am J Infect Control, 42, e39-45.

PHAN, L. T., MAITA, D., MORTIZ, D. C., WEBER, R., FRITZEN-PEDICINI, C., BLEASDALE, S. C., JONES, R. M. & PROGRAM, C. P. E. 2019. Personal protective equipment doffing practices of healthcare workers. Journal of occupational and environmental hygiene, 16, 575-581.

VERBEEK, J. H., RAJAMAKI, B., IJAZ, S., SAUNI, R., TOOMEY, E., BLACKWOOD, B., TIKKA, C., RUOTSALAINEN, J. H. & KILINC BALCI, F. S. 2020. Personal protective equipment for preventing highly infectious diseases due to exposure to contaminated body fluids in healthcare staff. Cochrane Database Syst Rev, 4, CD011621.

WONG, T. K., CHUNG, J. W., LI, Y., CHAN, W. F., CHING, P. T., LAM, C. H., CHOW, C. B. & SETO, W. H. 2004. Effective personal protective clothing for health care workers attending patients with severe acute respiratory syndrome. American journal of infection control, 32, 90-96.

Other  links

Personal protective equipment: a commentary for the dental and oral health care team on  Verbeek et al .

Eye protection and Covid-19

Medical staff combats COVID-19

What is the efficacy of eye protection equipment compared to no eye protection equipment in preventing transmission of COVID-19-type respiratory illnesses in primary and community care?(Khunti, 2020)

 

Link to The Dental Elf

Background

This rapid review asked whether, and in what circumstances lack of eye protection equipment is putting primary care clinicians at risk of contagion compared to use of eye protective equipment such as goggles. COVID-19 is spread by four means: via contact directly or contaminated surfaces; via droplet infection; via aerosols,  and aerosol generating procedures (AGPs)  which are created during many routine dental treatments; and finally the faeco-oral through poor hand hygiene. Even though there is limited evidence of Covid-19 virus being present in tears and conjunctival secretions there is a hypothetical risk that the virus could enter the body through the eye as a droplet or aerosol(Sun et al., 2020).

Methods

The Medline and Cochrane library digital databases were searched without date restrictions. Due to the large number of non-peer reviewed preprint publications in circulation they also conducted searches of Google Scholar. Critical appraisal of the systematic reviews was undertaken using the  AMSTAR II checklist (Shea et al., 2017).

Results

  • 52 randomised controlled trials and 12 systematic reviews were found on Medline.
  • 2 systematic reviews were assessed as good quality.
  • Verbeek (Verbeek et al., 2020) conducted a comprehensive Cochrane Review on the ‘Personal protective equipment for preventing highly infectious diseases due to exposure to contaminated body fluids in healthcare,’ and concluded there were no recent studies that investigated goggles or face shields.
  • French (French et al., 2016) identified two studies in which eye protection was used (eye–nose goggle or goggles plus masks) and found this to be effective in preventing transmission to staff (Agah et al., 1987, Gala et al., 1986). The control groups in both studies however were not wearing PPE so it was impossible to correctly evaluate the protective efficacy of the goggles from the face mask (See Table 1).

Table 1. Results from SR (French 2016)

Study Intervention Control Transmission risk in intervention group Transmission risk in intervention group
Agah et al, 1987 Goggles, mask and gowns No mask or goggles 5% (RSV illness rate) 61% (RSV illness rate)
Gala et al, 1986 Eye nose goggles No mask or goggles 5% 34%

RSV – Respiratory syncytial virus

Conclusion (Authors)

‘There is no direct evidence from randomised trials that eye protection equipment alone prevents transmission of COVID-19. Indirect evidence suggests that healthcare workers’ conjunctivae could be exposed to infective droplets and aerosols from patients during close contact. It is important to assess contagion risk of every encounter and take appropriate precautions   Where close contact is required, guidance for full personal protective equipment should be followed. For non-AGPs, there is no evidence from randomised trials that eye protective equipment provides additional protection’

Comments

In this well conducted rapid review the authors highlight the lack of direct evidence regarding the use of googles or face-shields in both non-AGP and AGP’s. There are many ethical reasons why there are so few studies and therefore current guidance is based on simulations using data from SARS and MERS outbreaks – as well as expert opinion, common sense, custom and practice. There is an urgent need for specific studies to address goggle and face shield performance in the dental surgery environment.

Disclaimer:  The article has not been peer-reviewed; it should not replace individual clinical judgement, and the sources cited should be checked. The views expressed in this commentary represent the views of the author and not necessarily those of the host institution. The views are not a substitute for professional advice.

 

Links

 

AGAH, R., CHERRY, J. D., GARAKIAN, A. J. & CHAPIN, M. 1987. Respiratory syncytial virus (RSV) infection rate in personnel caring for children with RSV infections: routine isolation procedure vs routine procedure supplemented by use of masks and goggles. American Journal of Diseases of Children, 141, 695-697.

FRENCH, C. E., MCKENZIE, B. C., COOPE, C., RAJANAIDU, S., PARANTHAMAN, K., PEBODY, R., NGUYEN‐VAN‐TAM, J. S., GROUP, N. R. S., HIGGINS, J. P. & BECK, C. R. 2016. Risk of nosocomial respiratory syncytial virus infection and effectiveness of control measures to prevent transmission events: a systematic review. Influenza and other respiratory viruses, 10, 268-290.

GALA, C. L., HALL, C. B., SCHNABEL, K. C., PINCUS, P. H., BLOSSOM, P., HILDRETH, S. W., BETTS, R. F. & DOUGLAS, R. G. 1986. The use of eye-nose goggles to control nosocomial respiratory syncytial virus infection. Jama, 256, 2706-2708.

KHUNTI, K. G., T. 2020. What is the efficacy of eye protection in primary care setting [Online]. Oxford COVID-19 Evidence Service. Available: https://www.cebm.net/covid-19/what-is-the-efficacy-of-eye-protection-equipment-compared-to-no-eye-protection-equipment-in-preventing-transmission-of-covid-19-type-respiratory-illnesses-in-primary-and-community-care/ [Accessed].

SHEA, B. J., REEVES, B. C., WELLS, G., THUKU, M., HAMEL, C., MORAN, J., MOHER, D., TUGWELL, P., WELCH, V. & KRISTJANSSON, E. 2017. AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. bmj, 358, j4008.

SUN, C.-B., WANG, Y.-Y., LIU, G.-H. & LIU, Z. 2020. Role of the Eye in Transmitting Human Coronavirus: What We Know and What We Do Not Know. Frontiers in Public Health, 8.

VERBEEK, J. H., RAJAMAKI, B., IJAZ, S., SAUNI, R., TOOMEY, E., BLACKWOOD, B., TIKKA, C., RUOTSALAINEN, J. H. & KILINC BALCI, F. S. 2020. Personal protective equipment for preventing highly infectious diseases due to exposure to contaminated body fluids in healthcare staff. Cochrane Database Syst Rev, 4, CD011621.