BACKGROUND: A key function of health systems is implementing interventions to improve health, but coverage of essential health interventions remains low in low-income countries. Implementing interventions can be challenging, particularly if it entails complex changes in clinical routines; in collaborative patterns among different healthcare providers and disciplines; in the behaviour of providers, patients or other stakeholders; or in the organisation of care. Decision-makers may use a range of strategies to implement health interventions, and these choices should be based on evidence of the strategies' effectiveness.
OBJECTIVES: To provide an overview of the available evidence from up-to-date systematic reviews about the effects of implementation strategies for health systems in low-income countries. Secondary objectives include identifying needs and priorities for future evaluations and systematic reviews on alternative implementation strategies and informing refinements of the framework for implementation strategies presented in the overview.
METHODS: We searched Health Systems Evidence in November 2010 and PDQ-Evidence up to December 2016 for systematic reviews. We did not apply any date, language or publication status limitations in the searches. We included well-conducted systematic reviews of studies that assessed the effects of implementation strategies on professional practice and patient outcomes and that were published after April 2005. We excluded reviews with limitations important enough to compromise the reliability of the review findings. Two overview authors independently screened reviews, extracted data and assessed the certainty of evidence using GRADE. We prepared SUPPORT Summaries for eligible reviews, including key messages, 'Summary of findings' tables (using GRADE to assess the certainty of the evidence) and assessments of the relevance of findings to low-income countries.
MAIN RESULTS: We identified 7272 systematic reviews and included 39 of them in this overview. An additional four reviews provided supplementary information. Of the 39 reviews, 32 had only minor limitations and 7 had important methodological limitations. Most studies in the reviews were from high-income countries. There were no studies from low-income countries in eight reviews.Implementation strategies addressed in the reviews were grouped into four categories – strategies targeting:1. healthcare organisations (e.g. strategies to change organisational culture; 1 review);2. healthcare workers by type of intervention (e.g. printed educational materials; 14 reviews);3. healthcare workers to address a specific problem (e.g. unnecessary antibiotic prescription; 9 reviews);4. healthcare recipients (e.g. medication adherence; 15 reviews).Overall, we found the following interventions to have desirable effects on at least one outcome with moderate- or high-certainty evidence and no moderate- or high-certainty evidence of undesirable effects.1.Strategies targeted at healthcare workers: educational meetings, nutrition training of health workers, educational outreach, practice facilitation, local opinion leaders, audit and feedback, and tailored interventions.2.Strategies targeted at healthcare workers for specific types of problems: training healthcare workers to be more patient-centred in clinical consultations, use of birth kits, strategies such as clinician education and patient education to reduce antibiotic prescribing in ambulatory care settings, and in-service neonatal emergency care training.3. Strategies targeted at healthcare recipients: mass media interventions to increase uptake of HIV testing; intensive self-management and adherence, intensive disease management programmes to improve health literacy; behavioural interventions and mobile phone text messages for adherence to antiretroviral therapy; a one time incentive to start or continue tuberculosis prophylaxis; default reminders for patients being treated for active tuberculosis; use of sectioned polythene bags for adherence to malaria medication; community-based health education, and reminders and recall strategies to increase vaccination uptake; interventions to increase uptake of cervical screening (invitations, education, counselling, access to health promotion nurse and intensive recruitment); health insurance information and application support.
AUTHORS' CONCLUSIONS: Reliable systematic reviews have evaluated a wide range of strategies for implementing evidence-based interventions in low-income countries. Most of the available evidence is focused on strategies targeted at healthcare workers and healthcare recipients and relates to process-based outcomes. Evidence of the effects of strategies targeting healthcare organisations is scarce.
Evidence-based behavior change interventions addressing health systems must be identified and disseminated to improve child health outcomes. Studies of the efficacy of such interventions were identified from systematic searches of the published literature. Two hundred twenty-nine of the initially identified references were judged to be relevant and were further reviewed for the quality and strength of the evidence. Studies were eligible if an intervention addressed policy or health systems interventions, measured relevant behavioral or health outcomes (e.g., nutrition, childhood immunization, malaria prevention and treatment), used at least a moderate quality research design, and were implemented in low- or middle-income countries. Policy or systems interventions able to produce behavior change reviewed included media (e.g., mass media, social media), community mobilization, educational programs (for caregivers, communities, or providers), social marketing, opinion leadership, economic incentives (for both caregiver and provider), health systems strengthening/policy/legislation, and others. Recommendations for policy, practice, and research are given based on fairly strong data across the areas of health service delivery, health workforce, health financing, governance and leadership, and research.
BACKGROUND: One of the greatest challenges in healthcare is how to best translate research evidence into clinical practice, which includes how to change health-care professionals' behaviours. A commonly held view is that multifaceted interventions are more effective than single-component interventions. The purpose of this study was to conduct an overview of systematic reviews to evaluate the effectiveness of multifaceted interventions in comparison to single-component interventions in changing health-care professionals' behaviour in clinical settings.
METHODS: The Rx for Change database, which consists of quality-appraised systematic reviews of interventions to change health-care professional behaviour, was used to identify systematic reviews for the overview. Dual, independent screening and data extraction was conducted. Included reviews used three different approaches (of varying methodological robustness) to evaluate the effectiveness of multifaceted interventions: (1) effect size/dose-response statistical analyses, (2) direct (non-statistical) comparisons of multifaceted to single interventions and (3) indirect comparisons of multifaceted to single interventions.
RESULTS: Twenty-five reviews were included in the overview. Three reviews provided effect size/dose-response statistical analyses of the effectiveness of multifaceted interventions; no statistical evidence of a relationship between the number of intervention components and the effect size was found. Eight reviews reported direct (non-statistical) comparisons of multifaceted to single-component interventions; four of these reviews found multifaceted interventions to be generally effective compared to single interventions, while the remaining four reviews found that multifaceted interventions had either mixed effects or were generally ineffective compared to single interventions. Twenty-three reviews indirectly compared the effectiveness of multifaceted to single interventions; nine of which also reported either a statistical (dose-response) analysis (N = 2) or a non-statistical direct comparison (N = 7). The majority (N = 15) of reviews reporting indirect comparisons of multifaceted to single interventions showed similar effectiveness for multifaceted and single interventions when compared to controls. Of the remaining eight reviews, six found single interventions to be generally effective while multifaceted had mixed effectiveness.
CONCLUSION: This overview of systematic reviews offers no compelling evidence that multifaceted interventions are more effective than single-component interventions.
BACKGROUND: The impact of unmet eye care needs in sub-Saharan Africa is compounded by barriers to accessing eye care, limited engagement with communities, a shortage of appropriately skilled health personnel, and inadequate support from health systems. The renewed focus on primary health care has led to support for greater integration of eye health into national health systems. The aim of this paper is to demonstrate available evidence of integration of eye health into primary health care in sub-Saharan Africa from a health systems strengthening perspective.
METHODS: A scoping review method was used to gather and assess information from published literature, reviews, WHO policy documents and examples of eye and health care interventions in sub-Saharan Africa. Findings were compiled using a health systems strengthening framework.
RESULTS: Limited information is available about eye health from a health systems strengthening approach. Particular components of the health systems framework lacking evidence are service delivery, equipment and supplies, financing, leadership and governance. There is some information to support interventions to strengthen human resources at all levels, partnerships and community participation; but little evidence showing their successful application to improve quality of care and access to comprehensive eye health services at the primary health level, and referral to other levels for specialist eye care.
CONCLUSION: Evidence of integration of eye health into primary health care is currently weak, particularly when applying a health systems framework. A realignment of eye health in the primary health care agenda will require context specific planning and a holistic approach, with careful attention to each of the health system components and to the public health system as a whole. Documentation and evaluation of existing projects are required, as are pilot projects of systematic approaches to interventions and application of best practices. Multi-national research may provide guidance about how to scale up eye health interventions that are integrated into primary health systems.
PURPOSE: Since the Declaration of Alma Ata, universal coverage has been at the heart of international health. The purpose of this study was to review the evidence on factors and interventions which are effective in promoting coverage and access to cataract and other health services, focusing on developing countries.
METHODS: A thorough literature search for systematic reviews was conducted. Information resources searched were Medline, The Cochrane Library and the Health System Evidence database. Medline was searched from January 1950 to June 2010. The Cochrane Library search consisted of identifying all systematic reviews produced by the Cochrane Eyes and Vision Group and the Cochrane Effective Practice and Organisation of Care. These reviews were assessed for potential inclusion in the review. The Health Systems Evidence database hosted by MacMaster University was searched to identify overviews of systematic reviews.
RESULTS: No reviews met the inclusion criteria for cataract surgery. The literature search on other health sectors identified 23 systematic reviews providing robust evidence on the main factors facilitating universal coverage. The main enabling factors influencing access to services in developing countries were peer education, the deployment of staff to rural areas, task shifting, integration of services, supervision of health staff, eliminating user fees and scaling up of health insurance schemes.
CONCLUSION: There are significant research gaps in eye care. There is a pressing need for further high quality primary research on health systems-related factors to understand how the delivery of eye care services and health systems' capacities are interrelated.
BACKGROUND: Anaemia, in particular due to iron deficiency, is common in pregnancy with associated negative outcomes for mother and infant. However, there is evidence of significant variation in management. The objectives of this review of systematic reviews were to analyse and summarise the evidence base, identify gaps in the evidence and develop a research agenda for this important component of maternity care.
METHODS: Multiple databases were searched, including MEDLINE, EMBASE and The Cochrane Library. All systematic reviews relating to interventions to prevent and treat anaemia in the antenatal and postnatal period were eligible. Two reviewers independently assessed data inclusion, extraction and quality of methodology.
RESULTS: 27 reviews were included, all reporting on the prevention and treatment of anaemia in the antenatal (n = 24) and postnatal periods (n = 3). Using AMSTAR as the assessment tool for methodological quality, only 12 of the 27 were rated as high quality reviews. The greatest number of reviews covered antenatal nutritional supplementation for the prevention of anaemia (n = 19). Iron supplementation was the most extensively researched, but with ongoing uncertainty about optimal dose and regimen. Few identified reviews addressed anaemia management post-partum or correlations between laboratory and clinical outcomes, and no reviews reported on clinical symptoms of anaemia.
CONCLUSIONS: The review highlights evidence gaps including the management of anaemia in the postnatal period, screening for anaemia, and optimal interventions for treatment. Research priorities include developing standardised approaches to reporting of laboratory outcomes, and information on clinical outcomes relevant to the experiences of pregnant women.
BACKGROUND: Social franchising developed as a possible means of improving the provision of non-state sector health services in low- and middle-income countries. The objective of this systematic review was to examine the scope and nature of existing research literature on social franchising interventions, including reach, implementation, sustainability and goals, in health service delivery. METHODS: A rigorous search strategy was run in nine major databases, including Medline, Embase and CINAHL. Grey literature was also searched. All types of evaluative study designs were eligible for inclusion. Existing data abstraction and analysis tools were used. The AMSTAR measurement tool was applied to assess the quality of included systematic reviews. Framework analysis was chosen for synthesising qualitative and quantitative research. RESULTS: Twelve studies were included in this review: three systematic reviews and nine primary studies. Social franchising has been evaluated in Asia and Africa, particularly from lowincome countries. Most studies focused on reproductive health and family planning. We found a paucity of rigorous study designs, so the evidence supporting social franchising is weak. Across settings, the government continues to have the highest volume of clients for family planning and other services; however, franchises do better than non-franchised private providers in terms of client volume. The clients of social franchises are satisfied with the quality of care and consistently report an intent to return. CONCLUSIONS: Given that social franchising remains an area of great interest and investment, we recommend evaluations of implementation processes and sustainability, and more rigorous evaluations of the effects of different models.
BACKGROUND: Effective implementation strategies are needed to optimize advancements in the fields of cancer diagnosis, treatment, survivorship, and end-of-life care. We conducted a review of systematic reviews to better understand the evidentiary base of implementation strategies in cancer control.
METHODS: Using three databases, we conducted a search and identified English-language systematic reviews published between 2005 and 2010 that targeted consumer, professional, organizational, regulatory, or financial interventions, tested exclusively or partially in a cancer context (primary focus); generic or non-cancer-specific reviews were also considered. Data were extracted, appraised, and analyzed by members of the research team, and research ideas to advance the field were proposed.
RESULTS: Thirty-four systematic reviews providing 41 summaries of evidence on 19 unique interventions comprised the evidence base. AMSTAR quality ratings ranged between 2 and 10. Team members rated most of the interventions as promising and in need of further research, and 64 research ideas were identified.
CONCLUSIONS: While many interventions show promise of effectiveness in the cancer-control context, few reviews were able to conclude definitively in favor of or against a specific intervention. We discuss the complexity of implementation research and offer suggestions to advance the science in this area.
A key function of health systems is implementing interventions to improve health, but coverage of essential health interventions remains low in low-income countries. Implementing interventions can be challenging, particularly if it entails complex changes in clinical routines; in collaborative patterns among different healthcare providers and disciplines; in the behaviour of providers, patients or other stakeholders; or in the organisation of care. Decision-makers may use a range of strategies to implement health interventions, and these choices should be based on evidence of the strategies' effectiveness.
OBJECTIVES:
To provide an overview of the available evidence from up-to-date systematic reviews about the effects of implementation strategies for health systems in low-income countries. Secondary objectives include identifying needs and priorities for future evaluations and systematic reviews on alternative implementation strategies and informing refinements of the framework for implementation strategies presented in the overview.
METHODS:
We searched Health Systems Evidence in November 2010 and PDQ-Evidence up to December 2016 for systematic reviews. We did not apply any date, language or publication status limitations in the searches. We included well-conducted systematic reviews of studies that assessed the effects of implementation strategies on professional practice and patient outcomes and that were published after April 2005. We excluded reviews with limitations important enough to compromise the reliability of the review findings. Two overview authors independently screened reviews, extracted data and assessed the certainty of evidence using GRADE. We prepared SUPPORT Summaries for eligible reviews, including key messages, 'Summary of findings' tables (using GRADE to assess the certainty of the evidence) and assessments of the relevance of findings to low-income countries.
MAIN RESULTS:
We identified 7272 systematic reviews and included 39 of them in this overview. An additional four reviews provided supplementary information. Of the 39 reviews, 32 had only minor limitations and 7 had important methodological limitations. Most studies in the reviews were from high-income countries. There were no studies from low-income countries in eight reviews.Implementation strategies addressed in the reviews were grouped into four categories – strategies targeting:1. healthcare organisations (e.g. strategies to change organisational culture; 1 review);2. healthcare workers by type of intervention (e.g. printed educational materials; 14 reviews);3. healthcare workers to address a specific problem (e.g. unnecessary antibiotic prescription; 9 reviews);4. healthcare recipients (e.g. medication adherence; 15 reviews).Overall, we found the following interventions to have desirable effects on at least one outcome with moderate- or high-certainty evidence and no moderate- or high-certainty evidence of undesirable effects.1.Strategies targeted at healthcare workers: educational meetings, nutrition training of health workers, educational outreach, practice facilitation, local opinion leaders, audit and feedback, and tailored interventions.2.Strategies targeted at healthcare workers for specific types of problems: training healthcare workers to be more patient-centred in clinical consultations, use of birth kits, strategies such as clinician education and patient education to reduce antibiotic prescribing in ambulatory care settings, and in-service neonatal emergency care training.3. Strategies targeted at healthcare recipients: mass media interventions to increase uptake of HIV testing; intensive self-management and adherence, intensive disease management programmes to improve health literacy; behavioural interventions and mobile phone text messages for adherence to antiretroviral therapy; a one time incentive to start or continue tuberculosis prophylaxis; default reminders for patients being treated for active tuberculosis; use of sectioned polythene bags for adherence to malaria medication; community-based health education, and reminders and recall strategies to increase vaccination uptake; interventions to increase uptake of cervical screening (invitations, education, counselling, access to health promotion nurse and intensive recruitment); health insurance information and application support.
AUTHORS' CONCLUSIONS:
Reliable systematic reviews have evaluated a wide range of strategies for implementing evidence-based interventions in low-income countries. Most of the available evidence is focused on strategies targeted at healthcare workers and healthcare recipients and relates to process-based outcomes. Evidence of the effects of strategies targeting healthcare organisations is scarce.
