Using Venn Diagrams to Evaluate Digital Contact Tracing: Panel Survey Analysis

Abstract

Background: Mitigation of the spread of infection relies on targeted approaches aimed at preventing nonhousehold interactions. Contact tracing in the form of digital proximity tracing apps has been widely adopted in multiple countries due to its perceived added benefits of tracing speed and breadth in comparison to traditional manual contact tracing. Assessments of user responses to exposure notifications through a guided approach can provide insights into the effect of digital proximity tracing app use on managing the spread of SARS-CoV-2.

Objective: The aim of this study was to demonstrate the use of Venn diagrams to investigate the contributions of digital proximity tracing app exposure notifications and subsequent mitigative actions in curbing the spread of SARS-CoV-2 in Switzerland.

Methods: We assessed data from 4 survey waves (December 2020 to March 2021) from a nationwide panel study (COVID-19 Social Monitor) of Swiss residents who were (1) nonusers of the SwissCovid app, (2) users of the SwissCovid app, or (3) users of the SwissCovid app who received exposure notifications. A Venn diagram approach was applied to describe the overlap or nonoverlap of these subpopulations and to assess digital proximity tracing app use and its associated key performance indicators, including actions taken to prevent SARS-CoV-2 transmission.

Results: We included 12,525 assessments from 2403 participants, of whom 50.9% (1222/2403) reported not using the SwissCovid digital proximity tracing app, 49.1% (1181/2403) reported using the SwissCovid digital proximity tracing app and 2.5% (29/1181) of the digital proximity tracing app users reported having received an exposure notification. Most digital proximity tracing app users (75.9%, 22/29) revealed taking at least one recommended action after receiving an exposure notification, such as seeking SARS-CoV-2 testing (17/29, 58.6%) or calling a federal information hotline (7/29, 24.1%). An assessment of key indicators of mitigative actions through a Venn diagram approach reveals that 30% of digital proximity tracing app users (95% CI 11.9%-54.3%) also tested positive for SARS-CoV-2 after having received exposure notifications, which is more than 3 times that of digital proximity tracing app users who did not receive exposure notifications (8%, 95% CI 5%-11.9%).

Conclusions: Responses in the form of mitigative actions taken by 3 out of 4 individuals who received exposure notifications reveal a possible contribution of digital proximity tracing apps in mitigating the spread of SARS-CoV-2. The application of a Venn diagram approach demonstrates its value as a foundation for researchers and health authorities to assess population-level digital proximity tracing app effectiveness by providing an intuitive approach for calculating key performance indicators.

Keywords: COVID-19; SARS-CoV-2; Venn diagram approach; contact tracing; digital contact tracing; digital health; exposure notification; key performance indicators; mHealth; mobile apps; tracing apps.