BACKGROUND: A key function of health systems is implementing interventions to improve health, but coverage of essential health interventions remains low in low-income countries. Implementing interventions can be challenging, particularly if it entails complex changes in clinical routines; in collaborative patterns among different healthcare providers and disciplines; in the behaviour of providers, patients or other stakeholders; or in the organisation of care. Decision-makers may use a range of strategies to implement health interventions, and these choices should be based on evidence of the strategies' effectiveness.
OBJECTIVES: To provide an overview of the available evidence from up-to-date systematic reviews about the effects of implementation strategies for health systems in low-income countries. Secondary objectives include identifying needs and priorities for future evaluations and systematic reviews on alternative implementation strategies and informing refinements of the framework for implementation strategies presented in the overview.
METHODS: We searched Health Systems Evidence in November 2010 and PDQ-Evidence up to December 2016 for systematic reviews. We did not apply any date, language or publication status limitations in the searches. We included well-conducted systematic reviews of studies that assessed the effects of implementation strategies on professional practice and patient outcomes and that were published after April 2005. We excluded reviews with limitations important enough to compromise the reliability of the review findings. Two overview authors independently screened reviews, extracted data and assessed the certainty of evidence using GRADE. We prepared SUPPORT Summaries for eligible reviews, including key messages, 'Summary of findings' tables (using GRADE to assess the certainty of the evidence) and assessments of the relevance of findings to low-income countries.
MAIN RESULTS: We identified 7272 systematic reviews and included 39 of them in this overview. An additional four reviews provided supplementary information. Of the 39 reviews, 32 had only minor limitations and 7 had important methodological limitations. Most studies in the reviews were from high-income countries. There were no studies from low-income countries in eight reviews.Implementation strategies addressed in the reviews were grouped into four categories – strategies targeting:1. healthcare organisations (e.g. strategies to change organisational culture; 1 review);2. healthcare workers by type of intervention (e.g. printed educational materials; 14 reviews);3. healthcare workers to address a specific problem (e.g. unnecessary antibiotic prescription; 9 reviews);4. healthcare recipients (e.g. medication adherence; 15 reviews).Overall, we found the following interventions to have desirable effects on at least one outcome with moderate- or high-certainty evidence and no moderate- or high-certainty evidence of undesirable effects.1.Strategies targeted at healthcare workers: educational meetings, nutrition training of health workers, educational outreach, practice facilitation, local opinion leaders, audit and feedback, and tailored interventions.2.Strategies targeted at healthcare workers for specific types of problems: training healthcare workers to be more patient-centred in clinical consultations, use of birth kits, strategies such as clinician education and patient education to reduce antibiotic prescribing in ambulatory care settings, and in-service neonatal emergency care training.3. Strategies targeted at healthcare recipients: mass media interventions to increase uptake of HIV testing; intensive self-management and adherence, intensive disease management programmes to improve health literacy; behavioural interventions and mobile phone text messages for adherence to antiretroviral therapy; a one time incentive to start or continue tuberculosis prophylaxis; default reminders for patients being treated for active tuberculosis; use of sectioned polythene bags for adherence to malaria medication; community-based health education, and reminders and recall strategies to increase vaccination uptake; interventions to increase uptake of cervical screening (invitations, education, counselling, access to health promotion nurse and intensive recruitment); health insurance information and application support.
AUTHORS' CONCLUSIONS: Reliable systematic reviews have evaluated a wide range of strategies for implementing evidence-based interventions in low-income countries. Most of the available evidence is focused on strategies targeted at healthcare workers and healthcare recipients and relates to process-based outcomes. Evidence of the effects of strategies targeting healthcare organisations is scarce.
OBJECTIVES: To assess the comparative effectiveness of interventions for improving antibiotic use for acute respiratory tract infections (RTIs) in adults and children.
DATA SOURCES: Electronic databases (MEDLINE(®) from 1990 and the Cochrane Library databases from 2005 to February 2015), reference lists of included systematic reviews, and Scientific Information Packets from point-of-care test manufacturers and experts.
REVIEW METHODS: Using predefined criteria, we selected studies of any intervention designed to improve antibiotic use for acute RTIs for which antibiotics are not indicated. Interventions were organized into education, communication, clinical, system-level, and multifaceted categories. We identified interventions that had evidence of reducing resistance to antibiotics, improving appropriate prescribing (i.e., concordant with guidelines), or decreasing overall prescribing of antibiotics for acute RTIs and not causing adverse consequences such as medical complications or patient dissatisfaction. The quality of included studies was rated and the strength of the evidence was assessed. Clinical and methodological heterogeneity limited quantitative analysis.
RESULTS: Although reduction in antibiotic resistance is a major goal of these interventions, there were too few studies to assess this outcome. The few studies that attempted to assess appropriate prescribing had important limitations and lack of consistency in outcome definition and ascertainment methods across studies. Therefore, reduction in overall prescribing was the only commonly reported benefit across interventions. Actual use of antibiotics was also reported in too few studies to assess separately from prescribing. No intervention had high-strength evidence for any outcome. The best evidence, from an evidence base of 133 studies, including 88 randomized controlled trials, was for four interventions with moderate-strength evidence of improved or reduced antibiotic prescribing compared with usual care that also had low-strength evidence of not causing adverse consequences. These were clinic-based parent education (21% overall prescribing reduction; similar return visits); public patient education campaigns combined with clinician education (improved appropriate prescribing; 7% reduction in overall prescribing; similar complications and satisfaction); procalcitonin for adults (12% to 72% overall prescribing reduction; similar continuing symptoms, limited activity, missing work, adverse events or lack of efficacy, treatment failure, hospitalizations, and mortality); and electronic decision support systems (improved appropriate prescribing and 5% to 9% reduction in overall prescribing; similar complications and health care use). Additionally, public parent education campaigns had low-strength evidence of reducing overall prescribing, not increasing diagnosis of complications, and decreasing subsequent visits. Other interventions had evidence of improved or reduced prescribing, but evidence on adverse consequences was lacking (streptococcal antigen testing, rapid multiviral testing in adults), insufficient (clinician and patient education plus audit and feedback plus academic detailing), or mixed (delayed prescribing, C-reactive protein [CRP] testing, clinician communication training, communication training plus CRP testing). Interventions with evidence of no impact on antibiotic prescribing were clinic-based education for parents of children 24 months or younger with acute otitis media, point-of-care testing for influenza or tympanometry in children, and clinician education combined with audit and feedback. Furthermore, limited evidence suggested that using adult procalcitonin algorithms in children is not effective and results in increased antibiotic prescribing.
CONCLUSIONS: The best evidence supports the use of specific education interventions for patients/parents and clinicians, procalcitonin in adults, and electronic decision support to reduce overall antibiotic prescribing (and in some cases improve appropriate prescribing) for acute RTIs without causing adverse consequences, although the reduction in prescribing varied widely. Other interventions also reduced prescribing, but evidence on adverse consequences was lacking, insufficient, or mixed. Future studies should use a complex intervention framework and better evaluate measures of appropriate prescribing, adverse consequences such as hospitalization, sustainability, resource use, and the impact of potential effect modifiers. PROSPERO number: CRD42014010094.
OBJECTIVES: There are various interventions for guideline implementation in clinical practice, but the effects of these interventions are generally unclear. We conducted a systematic review to identify effective methods of implementing clinical research findings and clinical guidelines to change physician practice patterns, in surgical and general practice. STUDY DESIGN: Systematic review of reviews. METHODS: We searched electronic databases (MEDLINE, EMBASE, and PubMed) for systematic reviews published in English that evaluated the effectiveness of different implementation methods. Two reviewers independently assessed eligibility for inclusion and methodological quality, and extracted relevant data. RESULTS: Fourteen reviews covering a wide range of interventions were identified. The intervention methods used include: audit and feedback, computerized decision support systems, continuing medical education, financial incentives, local opinion leaders, marketing, passive dissemination of information, patient-mediated interventions, reminders, and multifaceted interventions. Active approaches, such as academic detailing, led to greater effects than traditional passive approaches. According to the findings of 3 reviews, 71% of studies included in these reviews showed positive change in physician behavior when exposed to active educational methods and multifaceted interventions. CONCLUSIONS: Active forms of continuing medical education and multifaceted interventions were found to be the most effective methods for implementing guidelines into general practice. Additionally, active approaches to changing physician performance were shown to improve practice to a greater extent than traditional passive methods. Further primary research is necessary to evaluate the effectiveness of these methods in a surgical setting.
A key function of health systems is implementing interventions to improve health, but coverage of essential health interventions remains low in low-income countries. Implementing interventions can be challenging, particularly if it entails complex changes in clinical routines; in collaborative patterns among different healthcare providers and disciplines; in the behaviour of providers, patients or other stakeholders; or in the organisation of care. Decision-makers may use a range of strategies to implement health interventions, and these choices should be based on evidence of the strategies' effectiveness.
OBJECTIVES:
To provide an overview of the available evidence from up-to-date systematic reviews about the effects of implementation strategies for health systems in low-income countries. Secondary objectives include identifying needs and priorities for future evaluations and systematic reviews on alternative implementation strategies and informing refinements of the framework for implementation strategies presented in the overview.
METHODS:
We searched Health Systems Evidence in November 2010 and PDQ-Evidence up to December 2016 for systematic reviews. We did not apply any date, language or publication status limitations in the searches. We included well-conducted systematic reviews of studies that assessed the effects of implementation strategies on professional practice and patient outcomes and that were published after April 2005. We excluded reviews with limitations important enough to compromise the reliability of the review findings. Two overview authors independently screened reviews, extracted data and assessed the certainty of evidence using GRADE. We prepared SUPPORT Summaries for eligible reviews, including key messages, 'Summary of findings' tables (using GRADE to assess the certainty of the evidence) and assessments of the relevance of findings to low-income countries.
MAIN RESULTS:
We identified 7272 systematic reviews and included 39 of them in this overview. An additional four reviews provided supplementary information. Of the 39 reviews, 32 had only minor limitations and 7 had important methodological limitations. Most studies in the reviews were from high-income countries. There were no studies from low-income countries in eight reviews.Implementation strategies addressed in the reviews were grouped into four categories – strategies targeting:1. healthcare organisations (e.g. strategies to change organisational culture; 1 review);2. healthcare workers by type of intervention (e.g. printed educational materials; 14 reviews);3. healthcare workers to address a specific problem (e.g. unnecessary antibiotic prescription; 9 reviews);4. healthcare recipients (e.g. medication adherence; 15 reviews).Overall, we found the following interventions to have desirable effects on at least one outcome with moderate- or high-certainty evidence and no moderate- or high-certainty evidence of undesirable effects.1.Strategies targeted at healthcare workers: educational meetings, nutrition training of health workers, educational outreach, practice facilitation, local opinion leaders, audit and feedback, and tailored interventions.2.Strategies targeted at healthcare workers for specific types of problems: training healthcare workers to be more patient-centred in clinical consultations, use of birth kits, strategies such as clinician education and patient education to reduce antibiotic prescribing in ambulatory care settings, and in-service neonatal emergency care training.3. Strategies targeted at healthcare recipients: mass media interventions to increase uptake of HIV testing; intensive self-management and adherence, intensive disease management programmes to improve health literacy; behavioural interventions and mobile phone text messages for adherence to antiretroviral therapy; a one time incentive to start or continue tuberculosis prophylaxis; default reminders for patients being treated for active tuberculosis; use of sectioned polythene bags for adherence to malaria medication; community-based health education, and reminders and recall strategies to increase vaccination uptake; interventions to increase uptake of cervical screening (invitations, education, counselling, access to health promotion nurse and intensive recruitment); health insurance information and application support.
AUTHORS' CONCLUSIONS:
Reliable systematic reviews have evaluated a wide range of strategies for implementing evidence-based interventions in low-income countries. Most of the available evidence is focused on strategies targeted at healthcare workers and healthcare recipients and relates to process-based outcomes. Evidence of the effects of strategies targeting healthcare organisations is scarce.
