COVID-Net Open Initiative (Cancer-Net, TB-Net, Fibrosis-Net Initiatives)

Launched in March 2020 in response to the coronavirus disease 2019 (COVID-19) pandemic, COVID-Net is a global open source, open access initiative dedicated to accelerating advancement in machine learning to aid front-line healthcare workers and clinical institutions around the world fighting the continuing pandemic. Towards this goal, our global multi-disciplinary team of researchers, developers, and clinicians have made publicly available a suite of tailored deep neural network models for tackling different challenges ranging from screening to risk stratification to treatment planning for patients with the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). Furthermore, we have made available fully curated, open access benchmark datasets comprised of some of the largest, most diverse patient cohorts from around the world. We hope the open-source, open-access release of COVID-Net deep learning models and associated large-scale benchmark datasets will motivate and enable researchers, clinicians, and citizen data scientists alike from around the world to build upon them and accelerate progress in this field. We continue to regularly release new models and benchmark datasets to keep up with the dynamic nature of the evolving pandemic, and have since expanded the initiative with the open source TB-Net initiative for tuberculosis screening, Fibrosis-Net initiative for pulmonary fibrosis progression prediction, Cancer-Net initiative for cancer research, and the GenAI4Good initiative.

Updates

• September 28, 2023: Major release of TRUDLMIA, a deep learning framework for building trustworthy models for medical image analysis (Paper)(Datasets)
• May 17, 2023: Major release of Cancer-Net PCa-Data, an open-source benchmark dataset for prostate cancer clinical decision support using correlated diffusion imaging data (Datasets)
• April 12, 2023: Major release of Cancer-Net BCa-S, a volumetric convolutional neural network to learn volumetric deep radiomic features for predicting grading for breast cancer using synthetic correlated diffusion imaging (Paper)(Models)(Datasets)
• April 12, 2023: Major release of Cancer-Net BCa-Data, a multi-Institutional open-source benchmark dataset for breast cancer clinical decision support using synthetic correlated diffusion imaging data (Paper)(Datasets)
• November 26, 2022: Major release of COVID-Net Assistant, a deep learning-driven virtual assistant for COVID-19 symptom prediction and recommendation (Paper)(Models)
• November 26, 2022: Major release of Cancer-Net BCa, a volumetric convolutional neural network to learn volumetric deep radiomic features for predicting the post-treatment response for breast cancer using synthetic correlated diffusion imaging, along with a new benchmark dataset of volumetric synthetic correlated diffusion imaging data from 253 patient cases (Paper)(Models)(Datasets)
• June 8, 2022: Major release of COVIDx CT-3, a new benchmark dataset of 431,205 CT images curated through a multinational cohort of 6,068 patient cases from at least 51 countries (Paper)(Datasets)
• April 10, 2022: Major release of COVID-Net Biochem, a collection of explainability-designed machine learning models for predicting survival and kidney injury of COVID-19 patients from clinical and biochemistry data (Models)(Datasets)
• November 28, 2021: Major release of COVID-Net UI, a new AI-powered clinical decision support platform for COVID-19 (Platform)
• November 23, 2021: Major release of COVIDx CXR-3, a new benchmark dataset of 30,882 CXR images curated through a multinational cohort of 17,036 patient cases from at least 51 countries (Datasets)
• October 19, 2021: Major release of COVID-Net CXR-3, a tailored deep convolutional neural network for detection of COVID-19 cases from chest X-ray images using a multi-scale encoder-decoder self-attention (MEDUSA) (Paper)(Models)
• August 7, 2021: Major release of COVID-Net US, a tailored deep convolutional neural network for detection of COVID-19 cases from point-of-care ultrasound (POCUS) images (Models)(Datasets)
• July 13, 2021: Major release of COVIDx US, now with 29,651 processed point-of-care ultrasound (POCUS) images of patients infected with SARS-CoV-2 pneumonia, non-SARS-CoV-2 pneumonia, as well as healthy control cases. (Paper)(Datasets)
• June 10, 2021: Major release of Fibrosis-Net, a tailored deep convolutional neural network for prediction of pulmonary fibrosis progression from chest CT images (Paper)(Models)
• May 20, 2021: Major release of COVID-Net CXR-S, a tailored deep convolutional neural network for airspace severity assessment from chest X-ray images (Paper)(Models)
• May 14, 2021: Major release of COVIDx CXR-2, a new benchmark dataset of CXR images curated through a multinational cohort of close to 15,000 patients from at least 51 countries (Datasets)
• April 15, 2021: Major release of TB-Net, a tailored neural network for detection of tuberculosis from chest x-ray images (Model) (Paper)
• April 2, 2021: Major release of COVID-Net Clinical ICU, a tailored neural network for ICU admission prediction based on patient clinical data (Model)
• March 19, 2021: Major release of COVIDx US, a new benchmark dataset of 10,774 processed point-of-care ultrasound (POCUS) images of patients infected with SARS-CoV-2 pneumonia, non-SARS-CoV-2 pneumonia, as well as healthy control cases. (Paper)(Datasets)
• January 26, 2021: Major release of COVID-Net CT-2, built using new benchmark dataset with CT slices from at least 15 countries (Paper)(Models)(Datasets)
• January 19, 2021: Major release of Cancer-Net SCa, tailored deep convolutional neural networks for detection of skin cancer from dermoscopy images (Paper)(Models)

------- Courtesy Our World in Data

Benchmark Dataset Status:

• Chest x-rays: 30,882 CXR images across 17,036 patients Click here
• Chest CT: 431,205 CT slices from 6,068 patients Click here
• Chest point-of-care ultrasound: 29,651 POCUS images Click here
• Clinical and biochemisty data: 1336 records Click here
• Synthetic correlated diffusion imaging data: 253 patients Click here

Resources

• COVID-Net UI: AI-Powered Clinical Decision Support Platform for COVID-19:
  • Repo: Click here
    
• COVID-Net CXR: tailored deep convolutional neural networks for detection of COVID-19 cases from chest X-ray images
  • Repo: Click here
  • Models: Click here
  • Benchmark datasets: Click here
  • Paper: Click here
    
• COVID-Net CT: tailored deep convolutional neural networks for detection of COVID-19 cases from chest CT images:
  • Repo: Click here
  • Models: Click here
  • Benchmark datasets: Click here
  • Paper (CT-1): Click here
  • Paper (CT-2): Click here
    
• COVID-Net US: tailored deep convolutional neural network for detection of COVID-19 cases from chest point-of-care ultrasound images:
  • Repo: Click here
  • Models: Click here
  • Benchmark dataset: Click here
    
• COVID-Net CXR-S: tailored deep convolutional neural networks for airspace severity assessment from chest X-ray images:
  • Repo: Click here
  • Models: Click here
  • Benchmark dataset: Click here
  • Paper: Click here
    
• COVID-Net Severity: tailored deep convolutional neural networks for severity assessment from chest X-ray images:
  • Repo: Click here
  • Models: Click here
  • Benchmark dataset: Click here
  • Paper: Click here
    
• COVID-Net Biochem: explainability-designed machine learning models for predicting survival and kidney injury of COVID-19 patients from clinical and biochemistry data:
  • Repo: Click here
  • Model: Click here
  • Benchmark dataset: Click here
    
• COVID-Net Pneumonia: tailored deep convolutional neural networks for detection of pneumonia cases from chest X-ray images:
  • Repo: Click here
  • Models: Click here
  • Benchmark dataset: Click here
    
• COVIDx CT-3: A Large-scale, Multinational, Open-Source Benchmark Dataset for Computer-aided COVID-19 Screening from Chest CT Images:
  • Benchmark dataset: Click here
  • Paper: Click here
    
• COVIDx US: benchmark dataset for detection of COVID-19 cases from chest point-of-care ultrasound images:
  • Repo: Click here
  • Benchmark dataset: Click here
  • Paper: Click here
    
• COVID-Net Clinical ICU: tailored neural network for ICU admission prediction based on patient clinical data:
  • Repo: Click here
  • Model: Click here
    
• COVID-Net Assistant: A Deep Learning-Driven Virtual Assistant for COVID-19 Symptom Prediction and Recommendation:
  • Repo: Click here
  • Models: Click here
  • Paper: Click here
    
    
• TRUDLMIA: a deep learning framework for building trustworthy models for medical image analysis:
  • Paper: Click here
  • Benchmark dataset: Click here
    
• TB-Net: tailored deep convolutional neural networks for detection of tuberculosis cases from chest X-ray images:
  • Repo: Click here
  • Model: Click here
  • Paper: Click here
    
• Fibrosis-Net: tailored deep convolutional neural networks for prediction of pulmonary fibrosis progression from chest CT images:
  • Repo: Click here
  • Model: Click here
  • Paper: Click here
    
• Cancer-Net SCa: tailored deep convolutional neural networks for detection of skin cancer from dermoscopy images:
  • Repo: Click here
  • Models: Click here
  • Paper: Click here
    
• Cancer-Net BCa: Breast Cancer Pathologic Complete Response Prediction using Volumetric Deep Radiomic Features from Synthetic Correlated Diffusion Imaging:
  • Repo: Click here
  • Models: Click here
  • Dataset: Click here
  • Paper: Click here
    
    
• Cancer-Net BCa-S: Breast Cancer Grade Prediction using Volumetric Deep Radiomic Features from Synthetic Correlated Diffusion Imaging:
  • Repo: Click here
  • Models: Click here
  • Dataset: Click here
  • Paper: Click here
    
    
• Cancer-Net BCa-Data: A Multi-Institutional Open-Source Benchmark Dataset for Breast Cancer Clinical Decision Support using Synthetic Correlated Diffusion Imaging Data:
  • Dataset: Click here
  • Paper: Click here
    
    
• Cancer-Net PCa-Data: An Open-Source Benchmark Dataset for Prostate Cancer Clinical Decision Support using Correlated Diffusion Imaging Data:
  • Dataset: Click here
    
    

Core COVID-Net Team

Project Co-Leads: Yuhao Chen, Alexander Wong (a28wong@uwaterloo.ca)

• DarwinAI Corp., Canada and Vision and Image Processing Research Group, University of Waterloo, Canada
  • Linda Wang
  • Alexander Wong
  • Zhong Qiu Lin
  • Paul McInnis
  • Audrey Chung
  • Melissa Rinch
  • Maya Pavlova
  • Hadi Rahmat-Khah
  • Naomi Terhljan
  • Siddharth Surana
  • Hayden Gunraj
  • Jeffer Peng
  • James Lee
• Vision and Image Processing Research Group, University of Waterloo, Canada
  • Hossein Aboutalebi
  • Amy Tai
  • Alex MacLean
  • Saad Abbasi
  • Andy Zhao
  • Frank Shi
  • Yuetong Wang
• Ashkan Ebadi and Pengcheng Xi (National Research Council Canada)
• Adrian Florea (St. Mary’s Hospital, McGill University, Canada)
• Ali Sabri (Niagara Health, McMaster University, Canada)
• Amer Alaref (Thunder Bay Regional Health Sciences Centre, Northern Ontario School of Medicine, Canada)
• Kim-Ann Git (Selayang Hospital)
• Abdul Al-Haimi