8
views
0
recommends
+1 Recommend
1 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: not found

      Covid-MANet: Multi-task attention network for explainable diagnosis and severity assessment of COVID-19 from CXR images

      research-article

      Read this article at

      ScienceOpenPublisherPMC
      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          The devastating outbreak of Coronavirus Disease (COVID-19) cases in early 2020 led the world to face health crises. Subsequently, the exponential reproduction rate of COVID-19 disease can only be reduced by early diagnosis of COVID-19 infection cases correctly. The initial research findings reported that radiological examinations using CT and CXR modality have successfully reduced false negatives by RT-PCR test. This research study aims to develop an explainable diagnosis system for the detection and infection region quantification of COVID-19 disease. The existing research studies successfully explored deep learning approaches with higher performance measures but lacked generalization and interpretability for COVID-19 diagnosis. In this study, we address these issues by the Covid-MANet network, an automated end-to-end multi-task attention network that works for 5 classes in three stages for COVID-19 infection screening. The first stage of the Covid-MANet network localizes attention of the model to the relevant lungs region for disease recognition. The second stage of the Covid-MANet network differentiates COVID-19 cases from bacterial pneumonia, viral pneumonia, normal and tuberculosis cases, respectively. To improve the interpretation and explainability, three experiments have been conducted in exploration of the most coherent and appropriate classification approach. Moreover, the multi-scale attention model MA-DenseNet201 proposed for the classification of COVID-19 cases. The final stage of the Covid-MANet network quantifies the proportion of infection and severity of COVID-19 in the lungs. The COVID-19 cases are graded into more specific severity levels such as mild, moderate, severe, and critical as per the score assigned by the RALE scoring system. The MA-DenseNet201 classification model outperforms eight state-of-the-art CNN models, in terms of sensitivity and interpretation with lung localization network. The COVID-19 infection segmentation by UNet with DenseNet121 encoder achieves dice score of 86.15% outperforming UNet, UNet++, AttentionUNet, R2UNet, with VGG16, ResNet50 and DenseNet201 encoder. The proposed network not only classifies images based on the predicted label but also highlights the infection by segmentation/localization of model-focused regions to support explainable decisions. MA-DenseNet201 model with a segmentation-based cropping approach achieves maximum interpretation of 96% with COVID-19 sensitivity of 97.75%. Finally, based on class-varied sensitivity analysis Covid-MANet ensemble network of MA-DenseNet201, ResNet50 and MobileNet achieve 95.05% accuracy and 98.75% COVID-19 sensitivity. The proposed model is externally validated on an unseen dataset, yields 98.17% COVID-19 sensitivity.

          Related collections

          Most cited references48

          • Record: found
          • Abstract: found
          • Article: not found

          Sensitivity of Chest CT for COVID-19: Comparison to RT-PCR

          Summary In a series of 51 patients with chest CT and RT-PCR assay performed within 3 days, the sensitivity of CT for COVID-19 infection was 98% compared to RT-PCR sensitivity of 71% (p<.001). Introduction In December 2019, an outbreak of unexplained pneumonia in Wuhan [1] was caused by a new coronavirus infection named COVID-19 (Corona Virus Disease 2019). Noncontrast chest CT may be considered for early diagnosis of viral disease, although viral nucleic acid detection using real-time polymerase chain reaction (RT-PCR) remains the standard of reference. Chung et al. reported that chest CT may be negative for viral pneumonia of COVID-19 [2] at initial presentation (3/21 patients). Recently, Xie reported 5/167 (3%) patients who had negative RT-PCR for COVID-19 at initial presentation despite chest CT findings typical of viral pneumonia [3]. The purpose of this study was to compare the sensitivity of chest CT and viral nucleic acid assay at initial patient presentation. Materials and Methods The retrospective analysis was approved by institutional review board and patient consent was waived. Patients at Taizhou Enze Medical Center (Group) Enze Hospital were evaluated from January 19, 2020 to February 4, 2020. During this period, chest CT and RT-PCR (Shanghai ZJ Bio-Tech Co, Ltd, Shanghai, China) was performed for consecutive patients who presented with a history of 1) travel or residential history in Wuhan or local endemic areas or contact with individuals with individuals with fever or respiratory symptoms from these areas within 14 days and 2) had fever or acute respiratory symptoms of unknown cause. In the case of an initial negative RT-PCR test, repeat testing was performed at intervals of 1 day or more. Of these patients, we included all patients who had both noncontrast chest CT scan (slice thickness, 5mm) and RT-PCR testing within an interval of 3 days or less and who had an eventual confirmed diagnosis of COVID-19 infection by RT-PCR testing (Figure 1). Typical and atypical chest CT findings were recorded according to CT features previously described for COVD-19 (4,5). The detection rate of COVID-19 infection based on the initial chest CT and RT-PCR was compared. Statistical analysis was performed using McNemar Chi-squared test with significance at the p <.05 level. Figure 1: Flowchart for patient inclusion. Results 51 patients (29 men and 22 women) were included with median age of 45 (interquartile range, 39- 55) years. All patients had throat swab (45 patients) or sputum samples (6 patients) followed by one or more RT-PCR assays. The average time from initial disease onset to CT was 3 +/- 3 days; the average time from initial disease onset to RT-PCR testing was 3 +/- 3 days. 36/51 patients had initial positive RT-PCR for COVID-19. 12/51 patients had COVID-19 confirmed by two RT-PCR nucleic acid tests (1 to 2 days), 2 patients by three tests (2-5 days) and 1 patient by four tests (7 days) after initial onset. 50/51 (98%) patients had evidence of abnormal CT compatible with viral pneumonia at baseline while one patient had a normal CT. Of 50 patients with abnormal CT, 36 (72%) had typical CT manifestations (e.g. peripheral, subpleural ground glass opacities, often in the lower lobes (Figure 2) and 14 (28%) had atypical CT manifestations (Figure 3) [2]. In this patient sample, difference in detection rate for initial CT (50/51 [98%, 95% CI 90-100%]) patients was greater than first RT-PCR (36/51 [71%, 95%CI 56-83%]) patients (p<.001). Figure 2a: Examples of typical chest CT findings compatible with COVID-19 pneumonia in patients with epidemiological and clinical presentation suspicious for COVID-19 infection. A, male, 74 years old with fever and cough for 5 days. Axial chest CT shows bilateral subpleural ground glass opacities (GGO). B, female, 55 years old, with fever and cough for 7 days. Axial chest CT shows extensive bilateral ground glass opacities and consolidation; C, male, 43 years old, presenting with fever and cough for 1 week. Axial chest CT shows small bilateral areas of peripheral GGO with minimal consolidation; D, female, 43 years old presenting with fever with cough for 5 days. Axial chest CT shows a right lung region of peripheral consolidation. Figure 2b: Examples of typical chest CT findings compatible with COVID-19 pneumonia in patients with epidemiological and clinical presentation suspicious for COVID-19 infection. A, male, 74 years old with fever and cough for 5 days. Axial chest CT shows bilateral subpleural ground glass opacities (GGO). B, female, 55 years old, with fever and cough for 7 days. Axial chest CT shows extensive bilateral ground glass opacities and consolidation; C, male, 43 years old, presenting with fever and cough for 1 week. Axial chest CT shows small bilateral areas of peripheral GGO with minimal consolidation; D, female, 43 years old presenting with fever with cough for 5 days. Axial chest CT shows a right lung region of peripheral consolidation. Figure 2c: Examples of typical chest CT findings compatible with COVID-19 pneumonia in patients with epidemiological and clinical presentation suspicious for COVID-19 infection. A, male, 74 years old with fever and cough for 5 days. Axial chest CT shows bilateral subpleural ground glass opacities (GGO). B, female, 55 years old, with fever and cough for 7 days. Axial chest CT shows extensive bilateral ground glass opacities and consolidation; C, male, 43 years old, presenting with fever and cough for 1 week. Axial chest CT shows small bilateral areas of peripheral GGO with minimal consolidation; D, female, 43 years old presenting with fever with cough for 5 days. Axial chest CT shows a right lung region of peripheral consolidation. Figure 2d: Examples of typical chest CT findings compatible with COVID-19 pneumonia in patients with epidemiological and clinical presentation suspicious for COVID-19 infection. A, male, 74 years old with fever and cough for 5 days. Axial chest CT shows bilateral subpleural ground glass opacities (GGO). B, female, 55 years old, with fever and cough for 7 days. Axial chest CT shows extensive bilateral ground glass opacities and consolidation; C, male, 43 years old, presenting with fever and cough for 1 week. Axial chest CT shows small bilateral areas of peripheral GGO with minimal consolidation; D, female, 43 years old presenting with fever with cough for 5 days. Axial chest CT shows a right lung region of peripheral consolidation. Figure 3a: Examples of chest CT findings less commonly reported in COVID-19 infection (atypical) in patients with epidemiological and clinical presentation suspicious for COVID-19 infection. A, male, 36 years old with cough for 3 days. Axial chest CT shows a small focal and central ground glass opacity (GGO) in the right upper lobe; B, female, 40 years old. Axial chest CT shows small peripheral linear opacities bilaterally. C, male, 38 years old. Axial chest CT shows a GGO in the central left lower lobe; D, male, 31 years old with fever for 1 day. Axial chest CT shows a linear opacity in the left lower lateral mid lung. Figure 3b: Examples of chest CT findings less commonly reported in COVID-19 infection (atypical) in patients with epidemiological and clinical presentation suspicious for COVID-19 infection. A, male, 36 years old with cough for 3 days. Axial chest CT shows a small focal and central ground glass opacity (GGO) in the right upper lobe; B, female, 40 years old. Axial chest CT shows small peripheral linear opacities bilaterally. C, male, 38 years old. Axial chest CT shows a GGO in the central left lower lobe; D, male, 31 years old with fever for 1 day. Axial chest CT shows a linear opacity in the left lower lateral mid lung. Figure 3c: Examples of chest CT findings less commonly reported in COVID-19 infection (atypical) in patients with epidemiological and clinical presentation suspicious for COVID-19 infection. A, male, 36 years old with cough for 3 days. Axial chest CT shows a small focal and central ground glass opacity (GGO) in the right upper lobe; B, female, 40 years old. Axial chest CT shows small peripheral linear opacities bilaterally. C, male, 38 years old. Axial chest CT shows a GGO in the central left lower lobe; D, male, 31 years old with fever for 1 day. Axial chest CT shows a linear opacity in the left lower lateral mid lung. Figure 3d: Examples of chest CT findings less commonly reported in COVID-19 infection (atypical) in patients with epidemiological and clinical presentation suspicious for COVID-19 infection. A, male, 36 years old with cough for 3 days. Axial chest CT shows a small focal and central ground glass opacity (GGO) in the right upper lobe; B, female, 40 years old. Axial chest CT shows small peripheral linear opacities bilaterally. C, male, 38 years old. Axial chest CT shows a GGO in the central left lower lobe; D, male, 31 years old with fever for 1 day. Axial chest CT shows a linear opacity in the left lower lateral mid lung. Discussion In our series, the sensitivity of chest CT was greater than that of RT-PCR (98% vs 71%, respectively, p<.001). The reasons for the low efficiency of viral nucleic acid detection may include: 1) immature development of nucleic acid detection technology; 2) variation in detection rate from different manufacturers; 3) low patient viral load; or 4) improper clinical sampling. The reasons for the relatively lower RT-PCR detection rate in our sample compared to a prior report are unknown (3). Our results support the use of chest CT for screening for COVD-19 for patients with clinical and epidemiologic features compatible with COVID-19 infection particularly when RT-PCR testing is negative.
            Bookmark
            • Record: found
            • Abstract: found
            • Article: not found

            Imaging Profile of the COVID-19 Infection: Radiologic Findings and Literature Review

            Background COVID-19 (formerly known as the 2019 novel coronavirus [2019-nCoV]) has rapidly spread in mainland China and into multiple countries worldwide. The radiographic profile of this infection continues to evolve as more cases present beyond the epicenter of Wuhan, China. Purpose We present 21 COVID-19 cases from two Chinese centers with CT and chest radiograph (CXR) findings, as well as follow-up imaging in 5 cases. Materials and Methods Retrospective study in Shenzhen and Hong Kong. Patients with COVID-19 infection were included. A systematic review of the published literature on COVID-19 infection’s radiological features. Results The predominant imaging pattern is of ground-glass opacification with occasional consolidation in the peripheries. Pleural effusions and lymphadenopathy were absent in all cases. Patients demonstrate evolution of the ground-glass opacities into consolidation, and subsequent resolution of the airspaces changes. Ground-glass and consolidative opacities visible on CT are sometimes undetectable on chest radiographs, suggesting that CT is a more sensitive imaging modality for investigation. The systematic review identified 4 other studies confirming the findings of bilateral and peripheral ground glass with or without consolidation as the predominant finding on CT chest examinations. Conclusion The COVID-19 infection pulmonary manifestation is predominantly characterized by ground-glass opacification with occasional consolidation on CT. Radiographic findings in patients presenting in Shenzhen and Hong Kong are in keeping with 4 previous publications from other sites. The 2019 novel coronavirus (2019-nCoV), initially reported in Wuhan, China, has been declared a global health emergency. CT has been used on a massive scale to help identify and investigate suspected or confirmed cases of COVID-19. We present the findings of 21 confirmed COVID-19 infection in Shenzhen and Hong Kong, China. We found that the most common findings on chest CT were bilateral ground-glass opacities with or without consolidation in the lung periphery. Pleural effusions and lymphadenopathy were absent in all patients. A systematic review was undertaken to summarize the 4 previous publications on the imaging findings of this emerging infection in a total of 233 patients. Ground glass with or without consolidation were the most common findings in all publications, in alignment with our own findings.
              Bookmark
              • Record: found
              • Abstract: found
              • Article: found
              Is Open Access

              Common pitfalls and recommendations for using machine learning to detect and prognosticate for COVID-19 using chest radiographs and CT scans

              Machine learning methods offer great promise for fast and accurate detection and prognostication of coronavirus disease 2019 (COVID-19) from standard-of-care chest radiographs (CXR) and chest computed tomography (CT) images. Many articles have been published in 2020 describing new machine learning-based models for both of these tasks, but it is unclear which are of potential clinical utility. In this systematic review, we consider all published papers and preprints, for the period from 1 January 2020 to 3 October 2020, which describe new machine learning models for the diagnosis or prognosis of COVID-19 from CXR or CT images. All manuscripts uploaded to bioRxiv, medRxiv and arXiv along with all entries in EMBASE and MEDLINE in this timeframe are considered. Our search identified 2,212 studies, of which 415 were included after initial screening and, after quality screening, 62 studies were included in this systematic review. Our review finds that none of the models identified are of potential clinical use due to methodological flaws and/or underlying biases. This is a major weakness, given the urgency with which validated COVID-19 models are needed. To address this, we give many recommendations which, if followed, will solve these issues and lead to higher-quality model development and well-documented manuscripts.
                Bookmark

                Author and article information

                Journal
                Pattern Recognit
                Pattern Recognit
                Pattern Recognition
                Published by Elsevier Ltd.
                0031-3203
                0031-3203
                6 June 2022
                6 June 2022
                : 108826
                Affiliations
                [0001]Department of computer science, Institute of science, Banaras Hindu University, Varanasi, 221005
                Author notes
                [* ]Corresponding author
                Article
                S0031-3203(22)00307-7 108826
                10.1016/j.patcog.2022.108826
                9170279
                35698723
                547a0708-d985-444c-aa2a-766da4918662
                © 2022 Published by Elsevier Ltd.

                Since January 2020 Elsevier has created a COVID-19 resource centre with free information in English and Mandarin on the novel coronavirus COVID-19. The COVID-19 resource centre is hosted on Elsevier Connect, the company's public news and information website. Elsevier hereby grants permission to make all its COVID-19-related research that is available on the COVID-19 resource centre - including this research content - immediately available in PubMed Central and other publicly funded repositories, such as the WHO COVID database with rights for unrestricted research re-use and analyses in any form or by any means with acknowledgement of the original source. These permissions are granted for free by Elsevier for as long as the COVID-19 resource centre remains active.

                History
                : 21 September 2021
                : 24 April 2022
                : 2 June 2022
                Categories
                Article

                Neurosciences
                covid-19,lung segmentation,infection segmentation,chest x-ray,deep learning,transfer learning,explainable ai

                Comments

                Comment on this article