7
views
0
recommends
+1 Recommend
0 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      The effectiveness of continuous quality improvement for developing professional practice and improving health care outcomes: a systematic review

      review-article

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Background

          Efforts to improve the quality, safety, and efficiency of health care provision have often focused on changing approaches to the way services are organized and delivered. Continuous quality improvement (CQI), an approach used extensively in industrial and manufacturing sectors, has been used in the health sector. Despite the attention given to CQI, uncertainties remain as to its effectiveness given the complex and diverse nature of health systems. This review assesses the effectiveness of CQI across different health care settings, investigating the importance of different components of the approach.

          Methods

          We searched 11 electronic databases: MEDLINE, CINAHL, EMBASE, AMED, Academic Search Complete, HMIC, Web of Science, PsycINFO, Cochrane Central Register of Controlled Trials, LISTA, and NHS EED to February 2019. Also, we searched reference lists of included studies and systematic reviews, as well as checking published protocols for linked papers. We selected randomized controlled trials (RCTs) within health care settings involving teams of health professionals, evaluating the effectiveness of CQI. Comparators included current usual practice or different strategies to manage organizational change. Outcomes were health care professional performance or patient outcomes. Studies were published in English.

          Results

          Twenty-eight RCTs assessed the effectiveness of different approaches to CQI with a non-CQI comparator in various settings, with interventions differing in terms of the approaches used, their duration, meetings held, people involved, and training provided. All RCTs were considered at risk of bias, undermining their results. Findings suggested that the benefits of CQI compared to a non-CQI comparator on clinical process, patient, and other outcomes were limited, with less than half of RCTs showing any effect. Where benefits were evident, it was usually on clinical process measures, with the model used (i.e., Plan-Do-Study-Act, Model of Improvement), the meeting type (i.e., involving leaders discussing implementation) and their frequency (i.e., weekly) having an effect. None considered socio-economic health inequalities.

          Conclusions

          Current evidence suggests the benefits of CQI in improving health care are uncertain, reflecting both the poor quality of evaluations and the complexities of health services themselves. Further mixed-methods evaluations are needed to understand how the health service can use this proven approach.

          Trial registration

          Protocol registered on PROSPERO ( CRD42018088309).

          Related collections

          Most cited references48

          • Record: found
          • Abstract: found
          • Article: not found

          Assessing the impact of continuous quality improvement/total quality management: concept versus implementation.

          This study examines the relationships among organizational culture, quality improvement processes and selected outcomes for a sample of up to 61 U. S. hospitals. Primary data were collected from 61 U. S. hospitals (located primarily in the midwest and the west) on measures related to continuous quality improvement/total quality management (CQI/TQM), organizational culture, implementation approaches, and degree of quality improvement implementation based on the Baldrige Award criteria. These data were combined with independently collected data on perceived impact and objective measures of clinical efficiency (i.e., charges and length of stay) for six clinical conditions. The study involved cross-sectional examination of the named relationships. Reliable and valid scales for the organizational culture and quality improvement implementation measures were developed based on responses from over 7,000 individuals across the 61 hospitals with an overall completion rate of 72 percent. Independent data on perceived impact were collected from a national survey and independent data on clinical efficiency from a companion study of managed care. A participative, flexible, risk-taking organizational culture was significantly related to quality improvement implementation. Quality improvement implementation, in turn, was positively associated with greater perceived patient outcomes and human resource development. Larger-size hospitals experienced lower clinical efficiency with regard to higher charges and higher length of stay, due in part to having more bureaucratic and hierarchical cultures that serve as a barrier to quality improvement implementation. What really matters is whether or not a hospital has a culture that supports quality improvement work and an approach that encourages flexible implementation. Larger-size hospitals face more difficult challenges in this regard.
            Bookmark
            • Record: found
            • Abstract: found
            • Article: not found

            Effectiveness of teaching quality improvement to clinicians: a systematic review.

            Accreditation requirements mandate teaching quality improvement (QI) concepts to medical trainees, yet little is known about the effectiveness of teaching QI. To perform a systematic review of the effectiveness of published QI curricula for clinicians and to determine whether teaching methods influence the effectiveness of such curricula. The electronic literature databases of MEDLINE, EMBASE, CINAHL, and ERIC were searched for English-language articles published between January 1, 1980, and April 30, 2007. Experts in the field of QI were queried about relevant studies. Two independent reviewers selected studies for inclusion if the curriculum taught QI principles to clinicians and the evaluation used a comparative study design. Information about the features of each curriculum, its use of 9 principles of adult learning, and the type of educational and clinical outcomes were extracted. The relationship between the outcomes and the number of educational principles used was assessed. Of 39 studies that met eligibility criteria, 31 described team-based projects; 37 combined didactic instruction with experiential learning. The median number of adult learning principles used was 7 (range, 2-8). Evaluations included 22 controlled trials (8 randomized and 14 nonrandomized) and 17 pre/post or time series studies. Fourteen studies described educational outcomes (attitudes, knowledge, or skills or behaviors) and 28 studies described clinical process or patient outcomes. Nine of the 10 studies that evaluated knowledge reported only positive effects but only 2 of these described a validated assessment tool. The 6 assessments of attitudes found mixed results. Four of the 6 studies on skill or behavior outcomes reported only positive effects. Eight of the 28 studies of clinical outcomes reported only beneficial effects. Controlled studies were more likely than other studies to report mixed or null effects. Only 4 studies evaluated both educational and clinical outcomes, providing limited evidence that educational outcomes influence the clinical effectiveness of the interventions. Most published QI curricula apply sound adult learning principles and demonstrate improvement in learners' knowledge or confidence to perform QI. Additional studies are needed to determine whether educational methods have meaningful clinical benefits.
              Bookmark
              • Record: found
              • Abstract: found
              • Article: found
              Is Open Access

              RobotReviewer: evaluation of a system for automatically assessing bias in clinical trials

              Objective To develop and evaluate RobotReviewer, a machine learning (ML) system that automatically assesses bias in clinical trials. From a (PDF-formatted) trial report, the system should determine risks of bias for the domains defined by the Cochrane Risk of Bias (RoB) tool, and extract supporting text for these judgments. Methods We algorithmically annotated 12,808 trial PDFs using data from the Cochrane Database of Systematic Reviews (CDSR). Trials were labeled as being at low or high/unclear risk of bias for each domain, and sentences were labeled as being informative or not. This dataset was used to train a multi-task ML model. We estimated the accuracy of ML judgments versus humans by comparing trials with two or more independent RoB assessments in the CDSR. Twenty blinded experienced reviewers rated the relevance of supporting text, comparing ML output with equivalent (human-extracted) text from the CDSR. Results By retrieving the top 3 candidate sentences per document (top3 recall), the best ML text was rated more relevant than text from the CDSR, but not significantly (60.4% ML text rated ‘highly relevant' v 56.5% of text from reviews; difference +3.9%, [−3.2% to +10.9%]). Model RoB judgments were less accurate than those from published reviews, though the difference was <10% (overall accuracy 71.0% with ML v 78.3% with CDSR). Conclusion Risk of bias assessment may be automated with reasonable accuracy. Automatically identified text supporting bias assessment is of equal quality to the manually identified text in the CDSR. This technology could substantially reduce reviewer workload and expedite evidence syntheses.
                Bookmark

                Author and article information

                Contributors
                JEHill1@uclan.ac.uk
                AStephani@uclan.ac.uk
                p.sapple@btopenworld.com
                AClegg3@uclan.ac.uk
                Journal
                Implement Sci
                Implement Sci
                Implementation Science : IS
                BioMed Central (London )
                1748-5908
                19 April 2020
                19 April 2020
                2020
                : 15
                : 23
                Affiliations
                [1 ]GRID grid.7943.9, ISNI 0000 0001 2167 3843, Faculty of Health and Wellbeing, , University of Central Lancashire (UCLan), ; Preston, Lancashire PR1 2HE UK
                [2 ]Warrington, UK
                Author information
                http://orcid.org/0000-0001-8938-7819
                Article
                975
                10.1186/s13012-020-0975-2
                7168964
                32306984
                2cdbffde-bf6d-43f6-b396-2829ac5e4669
                © The Author(s). 2020

                Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver ( http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

                History
                : 14 October 2019
                : 19 February 2020
                Funding
                Funded by: NIHR CLAHRC NWC
                Categories
                Systematic Review
                Custom metadata
                © The Author(s) 2020

                Medicine
                continuous quality improvement,systematic review,health care,clinical process,patient-based outcomes,rcts

                Comments

                Comment on this article