FFP3 fit testing accuracy and Covid-19 prevalence update

File:Atemluftfilter Einwegmaske.jpg - Wikimedia Commons

Link to Dental Elf

The Bottom Line

The prevalence of Covid-19 in England has dropped to 1:1000, reducing the risk of treating an asymptomatic/presymptomatic patient down to 1:3330. Depending on usage between 5% and 55% of fit tested FFP3 mask will truly fit correctly. As the prevalence of Covid-19 drops policy makers will need to be aware of the changing risk/benefits of complex PPE usage.

Introduction

On the 5th June the Office of National Statistics (ONS) updated their prevalence statistics for Covid-19 infections  down to 0.10% (95% CI: 0.05% to 0.18) of the population in England (ONS, 2020). From my previous two blogs the estimated true asymptomatic prevalence for Covid-19 was 16% (95% CI: 12% to 20%) and the combines asymptomatic/presymptomatic prevalence was estimated at 27% (95%CI; 12 to 45%). From this updated data it is now possible to revise down the chance of treating a Covid-19 patient from 1:1333 to 1:3330, so in 20 days the risk has reduces about 2.5 times.

At the same time we have had three major Standard Operating Procedures (SOPs) published by the British Dental Association, Faculty of General Dental Practitioners, and the Office of the Chief Dental Officer (England) (BDA, 2020, FGDP, 2020, OCDOE, 2020). A large proportion of these documents are dedicated to the aerosol generating procedures and the need for properly fit-tested FFP3 respirators. Below I have outlined the diagnostic accuracy of fit testing based on data from the Health and Safety Executive (HSE, 2015).

Methods

In 2015 the HSE produced a document specifically reviewing the fit test criteria for FFP3 respirators. In total 25 volunteers were tested with four consecutive fit test methods, qualitative Bitrex, quantitative Portacount (both with and without the N95-Companion technology), and the laboratory-generated salt aerosol (Total Inward Leakage – TIL) chamber fit test method, tests were conducted on the same subject wearing an FFP3, without adjustment to the fit between tests. I carried out a metanalysis using the ‘mada’ package in R, the reference test used was the laboratory test chamber (TIL) fit test. The summary estimate for the qualitative/quantitative fit-tests for sensitivity was 89.3% (95% CI: 80.1% to 96.7%) and for specificity 58.7% (31.7% to 56.1%). The results have also been charted on a  Summary Receiver Operating Characteristic (sROC) curve (See Figure 1.).

Figure 1. sROC curve for FFP3 fit test

fittest

The main problem with both the qualitative and quantitative tests is the low specificity which produces a high number of false negative results. The reference test found that  37% of the masks tested passed, so if we tested 1000 masks, we get the following results (see Figure 2.).

Figure 2. Frequency tree for fit tests

fit test_v3

From the frequency tree we can see that a false fail will appear as a pass, so if a clinician passes a standard fit test there is a 55% probability that the result is true. On refitting and passing a fit check 58% of FFP3 masks failed their fit-test, so in real-terms this reduces the overall pass rate to 31% of fit checked respirators passing their fit test if reused. In long term real-world usage this ability for a mask to retain the required level of filtration could drop as low as 5% with incorrect usage with 18% of theatre staff wearing their face masks incorrectly (Herron et al., 2019).

Attack rates, hospital AGPs and the relative protection of face masks

Interestingly I found a paper on real-world  SARS infection rates for acute care nursing staff performing medical AGPs (Loeb et al., 2004). The infection rate with SARs according to consistently used FFP2 respirators was 13%, and for surgical masks it was 25%, with inconsistent use this rose to 56%. Combining this data with the updated prevalence data we can model the revised infection natural frequencies (see Table 1.).

Table 1. Face mask protection model

Mask usage Infection rate Protection factor Infection risk
Base rate 100% 1.0 1:3330
Inconsistent mask usage 56% 1.7 1:5661
Surgical face mask 25% 4.0 1:13320
FFP2 13% 7.7 1:25641

 

The problem now is that when the data is placed into an apriori power calculator (G*Power 3.19.2) with an error probability is 0.05 and power (1-beta error probability) of 0.8 one will need a total sample size of 1087610 to test mask effectiveness.

Conclusion

The prevalence of Covid-19 in the population has changed dramatically over the past three weeks, this will have knock on effects regarding the real-world exposure risks of clinical staff to Covid-19 and the application of the advice given in the current SOPs. Clinicians need to be aware of the high failure rates in the true protection offered from properly fit tested FFP2 and FFP3 masks, and as the risk status drops the clinical benefit of these respirator mask  will be harder to detect.

References

BDA. 2020. RETURNING TO FACE-TO-FACE CARE [Online]. Available: https://bda.org/advice/Coronavirus/Pages/returning-to-work.aspx [Accessed].

FGDP. 2020. Implications of COVID-19 for the safe management of general dental practice A practical guide [Online]. Available: https://www.fgdp.org.uk/implications-covid-19-safe-management-general-dental-practice-practical-guide [Accessed].

HERRON, J. B. T., KUHT, J. A., HUSSAIN, A. Z., GENS, K. K. & GILLIAM, A. D. 2019. Do theatre staff use face masks in accordance with the manufacturers’ guidelines of use? J Infect Prev, 20, 99-106.

HSE. 2015. Review of fit test pass criteria for Filtering Facepieces Class 3 (FFP3) Respirators [Online]. Available: https://www.hse.gov.uk/research/rrpdf/rr1029.pdf [Accessed].

LOEB, M., MCGEER, A., HENRY, B., OFNER, M., ROSE, D., HLYWKA, T., LEVIE, J., MCQUEEN, J., SMITH, S. & MOSS, L. 2004. SARS among critical care nurses, Toronto. Emerging infectious diseases, 10, 251.

OCDOE. 2020. Standard operating procedure transition to recovery [Online]. Available: https://www.england.nhs.uk/coronavirus/publication/preparedness-letters-for-dental-care/ [Accessed].

ONS. 2020. Coronavirus (COVID-19) Infection Survey pilot: 5 June 2020 [Online]. Available: https://www.ons.gov.uk/peoplepopulationandcommunity/healthandsocialcare/conditionsanddiseases/bulletins/coronaviruscovid19infectionsurveypilot/5june2020 [Accessed].

 

Covid-19: Asymptomatic/presymptomatic and the next patient?

File:CDC 2019-nCoV Laboratory Test Kit.jpg - Wikimedia Commons

Link to Dental Elf

Bottom line

To date we are seeing a small reduction in Covid-19 prevalence in England, the number of asymptomatic patients being about 13% of those who test positive for SARS-CoV-2. Applying a prediction interval to the latest systematic review suggests the chance of encountering an asymptomatic patient varies between 1% and 78% of those who would test positive. Without rapid and accurate virus and antibody testing at present extreme care still needs to be taken regarding dental aerosol generating procedures to protect both patients and staff. Self-reporting infection without a confirmatory test is about 3% accurate.

Introduction

As with all Covid-19 related data more information is appearing and being updated every day. In this opinion paper I would like to discuss the differences between Covid-19 positive patients who are asymptomatic/presympromatic, and symptomatic; what the latest data locally and globally shows, and how to interpret the data presented when making clinical decisions of individual patient risk.

Methods

The definition of a presymptomatic patient is a person where SARS-CoV-2 is detected before symptom onset, and asymptomatic are persons where SARS-CoV-2 is detected but symptoms never develop. Symptomatic is therefore those persons where SARS-CoV-2 is detected, and they have symptoms (Furukawa et al., 2020). In a cross-sectional study, one cannot separate the two categories of asymptomatic and presymptomatic as the data collected only refers to a specific time point such as the 3rd of May. If a longitudinal study is undertaken over a couple of weeks, then it may be possible to detect the patients who later go on to develop symptoms.

The latest data from the ONS, updated on the 28th May revised its prevalence estimate down to 0.24% of the community with COVID-19 (95% confidence interval: 0.11% to 0.46%) based on tests performed on 18,913 people in 8,799 households (ONS, 2020). Between the 26th April and the 25th May of those participants who reported symptoms 2.62% (95% CI: 1.56% to 4.11%) also tested positive, compared to an estimate of 0.35% of those not reporting any symptoms on the day of the test (95% CI: 0.30% to 0.47%). From this we could conclude that the sensitivity of self-reporting  coronavirus infection without a confirmatory test is 2.62% accurate, and of those individuals with a positive test 13.36% were asymptomatics on the day (both true asymptomatics and presymptomatics).

A recent systematic review by Byambasuren and co-workers set out to estimate the extent of true asymptomatic individuals and the associated risk of community spread (Byambasuren et al., 2020). Their inclusion criteria required  people of any age who were at-risk of contracting SARS-CoV-2 virus, and diagnosed by laboratory-based real time quantitative reverse transcription polymerase chain reaction (RT-qPCR) or serological tests to be positive. These people remained symptomless throughout the follow up period of at least 7 days to distinguish them from pre-symptomatic cases. From the 5 papers that fulfilled these criteria they undertook a meta-analysis and concluded using a fixed-effect model that the proportion of asymptomatic cases was 16% (95% CI: 12% – 20%) (See Figure 1.)

Figure 1.Fixed effects pooled estimates of proportion of asymptomatic carriers

Asymp_fixed

The authors used a fixed effects model possibly due to the small number of studies with similar methodologies. If, however a prediction interval (Borenstein et al., 2011) was added to the same data using the ‘meta’ package in R the summary estimate remains the same but the distribution of true effect sizes one could expect in future studies could be as low as 1% and as high as 78% (See Figure 2.).

Figure 2. Fixed effects pooled estimates of proportion of asymptomatic carriers plus prediction interval

Asmpto_fixed

Discussion

When interpreting the summary estimate within a systematic review it must be remembered this represents the mean and error variability between the different study results, and not the true distribution of asymptomatic Covid-19 carries that one may encounter tomorrow in your practice. In other words, it would not be impossible for you to encounter a group of patients (say a family) where 78% are true asymptomatic patients. As researchers produce more high-quality studies (preferably ≥24) this prediction interval will drop sharply down but unlike a confidence interval never approach zero.

References

BORENSTEIN, M., HEDGES, L. V., HIGGINS, J. P. & ROTHSTEIN, H. R. 2011. Prediction IntervalsI. Introduction to meta-analysis. John Wiley & Sons.

BYAMBASUREN, O., CARDONA, M., BELL, K., CLARK, J., MCLAWS, M.-L. & GLASZIOU, P. 2020. Estimating the extent of true asymptomatic COVID-19 and its potential for community transmission: systematic review and meta-analysis. medRxiv.

FURUKAWA, N., BROOKS, J. & SOBEL, J. 2020. Evidence Supporting Transmission of Severe Acute Respiratory Syndrome Coronavirus 2 While Presymptomatic or Asymptomatic. Emerging infectious diseases, 26.

ONS. 2020. Coronavirus (COVID-19) Infection Surveypilot: England, 28 May 2020 [Online]. Available: https://www.ons.gov.uk/peoplepopulationandcommunity/healthandsocialcare/conditionsanddiseases/bulletins/coronaviruscovid19infectionsurveypilot/28may2020 [Accessed].

Disclaimer:  The article has not been peer-reviewed; it should not replace individual clinical judgement, and the sources cited should be checked. The views expressed in this commentary represent the views of the author and not necessarily those of the host institution. The views are not a substitute for professional advice.

 

Interesting Data from Face Shield Studies

Mask - Wikipedia

Link to Dental Elf

Bottom Line

Face shields are highly effective at preventing large droplet contamination of the operators face and mask but they will not reduce aerosol penetration, so a good fitting mask is imperative. The advantages in this form of PPE can quickly be lost with poor attention to doffing and donning procedures especially when not undertaking AGPs.

Background

In the world before Covid-19 the majority of the dental profession had never heard of the words ‘aerosol generating procedure’(AGP) in relation to the use of low and high-speed dental handpieces, ultrasonic scalers, air polishers, and triple syringes. In late 2019 the Covid-19 virus brought with it the risk of potentially fatal respiratory infection via droplet and aerosol spread (Meng et al., 2020). To counter the risk of droplet infection the majority of international emergency dental care guidance almost universally recommended the use of face shields to protect the clinical team (Cochrane, 2020). Up until now the dental team had mainly been using safety glasses as eye protection, so what additional information can we learn from the research relating to face-shields?

Methods

To simplify the literature review process when there are some many non-peer reviewed unindexed preprint papers available on line I limited my search to a review by Roberge to locate some of the primary literature (Roberge, 2016). 8 studies were extracted from the review for further appraisal, 6 were simulation studies (Shoham et al., Bentley et al., 1994, Rusin et al., 2002, Lindsley et al., 2014, Brady et al., 2017, Weber et al., 2019) , one observational study of personal protective equipment (PPE) usage by operating theatre staff (Herron et al., 2019)  and a further review (Jones et al., 2020).

The simplest of the simulation studies sprayed fluorescent dye at various combinations of glasses, goggles, and a face shield. As one would expect the face shield plus FFP2 mask effectively blocked all droplet contamination to the eyes, nose and mouth (Shoham et al.).

A dental simulation study using similar fluorescent dye demonstrated  aerosols penetration of a single layered face mask behind a face shields to enter the nose indicating the importance of a well-fitting mask to protect against aerosol that can flow round a face shield (Bentley et al., 1994).  Weber and co-workers conducted a far more sophisticated simulation study using a total of 39 participants who performed 74 experiments, involving 10–12 experimental trials for each healthcare activity. Their first interesting finding was that with face shields, facemask contamination was higher among non-AGPs rather than AGPs. The authors concluded that:

‘The lack of correlation between the fluorescein mass on the face shield and fluorescein aerosol concentration suggests that projected droplets or transfer upon contact by contaminated gloves were more likely the source of contamination than particles suspended air.’

A further simulation study by Brady also concluded that improper doffing and reuse of masks increased infected droplet transfer to the hands from 7% to 15.5% (Brady et al., 2017), the 3 to 5 times higher droplet transfer as opposed to nuclei transfer (dehydrated droplet) may be associated with the fluid resistant surface of the FFP2 mask holding the droplets on the surface. Rusin  demonstrated  3300 to 6600 fold increase in transfer efficiency of virus (PRD-1 phage) when comparing a porous surface with a fluid resistant surface (Rusin et al., 2002).

Continuing on the theme of cross contamination Herron observed 1036 operating theatre staff on their technique of applying masks and face shields and found only 18% (190/1034) of surgically scrubbed staff fully complied with the CDC guidelines on the application of a face mask, and face-shields were worn correctly 3.6% of the time (37/1034). The most recent review of PPE for infectious diseases prior to Covid-19 focused on lessons learned from Ebola, SARS, and MRSA,  and in line with the above studies concluded that face shields were susceptible to being by-passed by splash or touch (Jones et al., 2020)

Discussion

From this rapid review we can conclude that face shields are highly effective at preventing large droplet contamination of the operators face and mask. The lack of seal round the periphery however will not prevent aerosol contaminating the inside of an improperly fitting face mask in simulation studies. The two most interesting observations however relate to the major source of contamination of the mask coming from the operator’s hands, and the reduced contamination during AGP procedures. I would hypothesize that the reduced contamination during the AGPs could be attributed to the more focused workflow keeping operators hands more closely confined to the surgical site, and increasing awareness of hand contamination. As with all these reviews there is a need for more high quality long-term real-world studies to evaluate the effectiveness of enhanced PPE usage.

References

BENTLEY, C. D., BURKHART, N. W. & CRAWFORD, J. J. 1994. Evaluating spatter and aerosol contamination during dental procedures. J Am Dent Assoc, 125, 579-84.

BRADY, T. M., STRAUCH, A. L., ALMAGUER, C. M., NIEZGODA, G., SHAFFER, R. E., YORIO, P. L. & FISHER, E. M. 2017. Transfer of bacteriophage MS2 and fluorescein from N95 filtering facepiece respirators to hands: Measuring fomite potential. J Occup Environ Hyg, 14, 898-906.

COCHRANE. 2020. Recommendations for the re-opening of dental services: a rapid review of international sources [Online]. Available: https://oralhealth.cochrane.org/news/recommendations-re-opening-dental-services-rapid-review-international-sources [Accessed].

HERRON, J. B. T., KUHT, J. A., HUSSAIN, A. Z., GENS, K. K. & GILLIAM, A. D. 2019. Do theatre staff use face masks in accordance with the manufacturers’ guidelines of use? J Infect Prev, 20, 99-106.

JONES, R. M., BLEASDALE, S. C., MAITA, D., BROSSEAU, L. M. & PROGRAM, C. D. C. P. E. 2020. A systematic risk-based strategy to select personal protective equipment for infectious diseases. Am J Infect Control, 48, 46-51.

LINDSLEY, W. G., NOTI, J. D., BLACHERE, F. M., SZALAJDA, J. V. & BEEZHOLD, D. H. 2014. Efficacy of face shields against cough aerosol droplets from a cough simulator. Journal of occupational and environmental hygiene, 11, 509-518.

MENG, L., HUA, F. & BIAN, Z. 2020. Coronavirus Disease 2019 (COVID-19): Emerging and Future Challenges for Dental and Oral Medicine. Journal of Dental Research.

ROBERGE, R. J. 2016. Face shields for infection control: A review. J Occup Environ Hyg, 13, 235-42.

RUSIN, P., MAXWELL, S. & GERBA, C. 2002. Comparative surface‐to‐hand and fingertip‐to‐mouth transfer efficiency of gram‐positive bacteria, gram‐negative bacteria, and phage. Journal of Applied Microbiology, 93, 585-592.

SHOHAM, S., ACUNA-VILLAORDUNA, C. & COTTON, M. Comparison of Protection against Ocular Contamination with Disposable Eyewear Products [Online]. Available: www.medonyx.com/media/MedStarFullClinicalPoster.pdf [Accessed].

WEBER, R. T., PHAN, L. T., FRITZEN-PEDICINI, C. & JONES, R. M. 2019. Environmental and Personal Protective Equipment Contamination during Simulated Healthcare Activities. Ann Work Expo Health, 63, 784-796.

Disclaimer:  The article has not been peer-reviewed; it should not replace individual clinical judgement, and the sources cited should be checked. The views expressed in this commentary represent the views of the author and not necessarily those of the host institution. The views are not a substitute for professional advice.