OBJECTIVE: An umbrella review providing a comprehensive synthesis of the interventions that are effective in providing routine immunisation outcomes for children in low and middle-income countries (L&MICs).
DESIGN: A systematic review of systematic reviews, or an umbrella review.
DATA SOURCES: We comprehensively searched 11 academic databases and 23 grey literature sources. The search was adopted from an evidence gap map on routine child immunisation sector in L&MICs, which was done on 5 May 2020. We updated the search in October 2021.
ELIGIBILITY CRITERIA: We included systematic reviews assessing the effectiveness of any intervention on routine childhood immunisation outcomes in L&MICs.
DATA EXTRACTION AND SYNTHESIS: Search results were screened by two reviewers independently applying predefined inclusion and exclusion criteria. Data were extracted by two researchers independently. The Specialist Unit for Review Evidence checklist was used to assess review quality. A mixed-methods synthesis was employed focusing on meta-analytical and narrative elements to accommodate both the quantitative and qualitative information available from the included reviews.
RESULTS: 62 systematic reviews are included in this umbrella review. We find caregiver-oriented interventions have large positive and statistically significant effects, especially those focusing on short-term sensitisation and education campaigns as well as written messages to caregivers. For health system-oriented interventions the evidence base is thin and derived from narrative synthesis suggesting positive effects for home visits, mixed effects for pay-for-performance schemes and inconclusive effects for contracting out services to non-governmental providers. For all other interventions under this category, the evidence is either limited or not available. For community-oriented interventions, a recent high-quality mixed-methods review suggests positive but small effects. Overall, the evidence base is highly heterogenous in terms of scope, intervention types and outcomes.
CONCLUSION: Interventions oriented towards caregivers and communities are effective in improving routine child immunisation outcomes. The evidence base on health system-oriented interventions is scant not allowing us to reach firm conclusions, except for home visits. Large evidence gaps exist and need to be addressed. For example, more high-quality evidence is needed for specific caregiver-oriented interventions (eg, monetary incentives) as well as health system-oriented (eg, health workers and data systems) and community-oriented interventions. We also need to better understand complementarity of different intervention types.
BACKGROUND: One target of the Sustainable Development Goals is to achieve "universal health coverage, including financial risk protection, access to quality essential health-care services and access to safe, effective, quality and affordable essential medicines and vaccines for all". A fundamental concern of governments in striving for this goal is how to finance such a health system. This concern is very relevant for low-income countries.
OBJECTIVES: To provide an overview of the evidence from up-to-date systematic reviews about the effects of financial arrangements for health systems in low-income countries. Secondary objectives include identifying needs and priorities for future evaluations and systematic reviews on financial arrangements, and informing refinements in the framework for financial arrangements presented in the overview.
METHODS: We searched Health Systems Evidence in November 2010 and PDQ-Evidence up to 17 December 2016 for systematic reviews. We did not apply any date, language, or publication status limitations in the searches. We included well-conducted systematic reviews of studies that assessed the effects of financial arrangements on patient outcomes (health and health behaviours), the quality or utilisation of healthcare services, resource use, healthcare provider outcomes (such as sick leave), or social outcomes (such as poverty, employment, or financial burden of patients, e.g. out-of-pocket payment, catastrophic disease expenditure) and that were published after April 2005. We excluded reviews with limitations important enough to compromise the reliability of the findings. Two overview authors independently screened reviews, extracted data, and assessed the certainty of evidence using GRADE. We prepared SUPPORT Summaries for eligible reviews, including key messages, 'Summary of findings' tables (using GRADE to assess the certainty of the evidence), and assessments of the relevance of findings to low-income countries.
MAIN RESULTS: We identified 7272 reviews and included 15 in this overview, on: collection of funds (2 reviews), insurance schemes (1 review), purchasing of services (1 review), recipient incentives (6 reviews), and provider incentives (5 reviews). The reviews were published between 2008 and 2015; focused on 13 subcategories; and reported results from 276 studies: 115 (42%) randomised trials, 11 (4%) non-randomised trials, 23 (8%) controlled before-after studies, 51 (19%) interrupted time series, 9 (3%) repeated measures, and 67 (24%) other non-randomised studies. Forty-three per cent (119/276) of the studies included in the reviews took place in low- and middle-income countries. Collection of funds: the effects of changes in user fees on utilisation and equity are uncertain (very low-certainty evidence). It is also uncertain whether aid delivered under the Paris Principles (ownership, alignment, harmonisation, managing for results, and mutual accountability) improves health outcomes compared to aid delivered without conforming to those principles (very low-certainty evidence). Insurance schemes: community-based health insurance may increase service utilisation (low-certainty evidence), but the effects on health outcomes are uncertain (very low-certainty evidence). It is uncertain whether social health insurance improves utilisation of health services or health outcomes (very low-certainty evidence). Purchasing of services: it is uncertain whether increasing salaries of public sector healthcare workers improves the quantity or quality of their work (very low-certainty evidence). Recipient incentives: recipient incentives may improve adherence to long-term treatments (low-certainty evidence), but it is uncertain whether they improve patient outcomes. One-time recipient incentives probably improve patient return for start or continuation of treatment (moderate-certainty evidence) and may improve return for tuberculosis test readings (low-certainty evidence). However, incentives may not improve completion of tuberculosis prophylaxis, and it is uncertain whether they improve completion of treatment for active tuberculosis. Conditional cash transfer programmes probably lead to an increase in service utilisation (moderate-certainty evidence), but their effects on health outcomes are uncertain. Vouchers may improve health service utilisation (low-certainty evidence), but the effects on health outcomes are uncertain (very low-certainty evidence). Introducing a restrictive cap may decrease use of medicines for symptomatic conditions and overall use of medicines, may decrease insurers' expenditures on medicines (low-certainty evidence), and has uncertain effects on emergency department use, hospitalisations, and use of outpatient care (very low-certainty evidence). Reference pricing, maximum pricing, and index pricing for drugs have mixed effects on drug expenditures by patients and insurers as well as the use of brand and generic drugs. Provider incentives: the effects of provider incentives are uncertain (very low-certainty evidence), including: the effects of provider incentives on the quality of care provided by primary care physicians or outpatient referrals from primary to secondary care, incentives for recruiting and retaining health professionals to serve in remote areas, and the effects of pay-for-performance on provider performance, the utilisation of services, patient outcomes, or resource use in low-income countries.
AUTHORS' CONCLUSIONS: Research based on sound systematic review methods has evaluated numerous financial arrangements relevant to low-income countries, targeting different levels of the health systems and assessing diverse outcomes. However, included reviews rarely reported social outcomes, resource use, equity impacts, or undesirable effects. We also identified gaps in primary research because of uncertainty about applicability of the evidence to low-income countries. Financial arrangements for which the effects are uncertain include external funding (aid), caps and co-payments, pay-for-performance, and provider incentives. Further studies evaluating the effects of these arrangements are needed in low-income countries. Systematic reviews should include all outcomes that are relevant to decision-makers and to people affected by changes in financial arrangements.
BACKGROUND: Governance arrangements include changes in rules or processes that determine authority and accountability for health policies, organisations, commercial products and health professionals, as well as the involvement of stakeholders in decision-making. Changes in governance arrangements can affect health and related goals in numerous ways, generally through changes in authority, accountability, openness, participation and coherence. A broad overview of the findings of systematic reviews can help policymakers, their technical support staff and other stakeholders to identify strategies for addressing problems and improving the governance of their health systems.
OBJECTIVES: To provide an overview of the available evidence from up-to-date systematic reviews about the effects of governance arrangements for health systems in low-income countries. Secondary objectives include identifying needs and priorities for future evaluations and systematic reviews on governance arrangements and informing refinements of the framework for governance arrangements outlined in the overview.
METHODS: We searched Health Systems Evidence in November 2010 and PDQ Evidence up to 17 December 2016 for systematic reviews. We did not apply any date, language or publication status limitations in the searches. We included well-conducted systematic reviews of studies that assessed the effects of governance arrangements on patient outcomes (health and health behaviours), the quality or utilisation of healthcare services, resource use (health expenditures, healthcare provider costs, out-of-pocket payments, cost-effectiveness), healthcare provider outcomes (such as sick leave), or social outcomes (such as poverty, employment) and that were published after April 2005. We excluded reviews with limitations that were important enough to compromise the reliability of the findings of the review. Two overview authors independently screened reviews, extracted data and assessed the certainty of evidence using GRADE. We prepared SUPPORT Summaries for eligible reviews, including key messages, 'Summary of findings' tables (using GRADE to assess the certainty of the evidence) and assessments of the relevance of findings to low-income countries.
MAIN RESULTS: We identified 7272 systematic reviews and included 21 of them in this overview (19 primary reviews and 2 supplementary reviews). We focus here on the results of the 19 primary reviews, one of which had important methodological limitations. The other 18 were reliable (with only minor limitations).We grouped the governance arrangements addressed in the reviews into five categories: authority and accountability for health policies (three reviews); authority and accountability for organisations (two reviews); authority and accountability for commercial products (three reviews); authority and accountability for health professionals (seven reviews); and stakeholder involvement (four reviews).Overall, we found desirable effects for the following interventions on at least one outcome, with moderate- or high-certainty evidence and no moderate- or high-certainty evidence of undesirable effects. Decision-making about what is covered by health insurance- Placing restrictions on the medicines reimbursed by health insurance systems probably decreases the use of and spending on these medicines (moderate-certainty evidence). Stakeholder participation in policy and organisational decisions- Participatory learning and action groups for women probably improve newborn survival (moderate-certainty evidence).- Consumer involvement in preparing patient information probably improves the quality of the information and patient knowledge (moderate-certainty evidence). Disclosing performance information to patients and the public- Disclosing performance data on hospital quality to the public probably encourages hospitals to implement quality improvement activities (moderate-certainty evidence).- Disclosing performance data on individual healthcare providers to the public probably leads people to select providers that have better quality ratings (moderate-certainty evidence).
AUTHORS' CONCLUSIONS: Investigators have evaluated a wide range of governance arrangements that are relevant for low-income countries using sound systematic review methods. These strategies have been targeted at different levels in health systems, and studies have assessed a range of outcomes. Moderate-certainty evidence shows desirable effects (with no undesirable effects) for some interventions. However, there are important gaps in the availability of systematic reviews and primary studies for the all of the main categories of governance arrangements.
When faced with vaccine hesitancy, public health authorities are looking for effective strategies to address this issue. In this paper, the findings of 15 published literature reviews or meta-analysis that have examined the effectiveness of different interventions to reduce vaccine hesitancy and/or to enhance vaccine acceptance are presented and discussed. From the literature, there is no strong evidence to recommend any specific intervention to address vaccine hesitancy/refusal. The reviewed studies included interventions with diverse content and approaches that were implemented in different settings and targeted various populations. Few interventions were directly targeted to vaccine hesitant individuals. Given the paucity of information on effective strategies to address vaccine hesitancy, when interventions are implemented, planning a rigorous evaluation of their impact on vaccine hesitancy/vaccine acceptance will be essential.
INTRODUCTION: Ownership of healthcare providers has been considered as one factor that might influence their health and healthcare related performance. The aim of this article was to provide an overview of what is known about the effects on economic, administrative and health related outcomes of different types of ownership of healthcare providers--namely public, private non-for-profit (PNFP) and private for-profit (PFP)--based on the findings of systematic reviews (SR).
METHODS AND FINDINGS: An overview of systematic reviews was performed. Different databases were searched in order to select SRs according to an explicit comprehensive criterion. Included SRs were assessed to determine their methodological quality. Of the 5918 references reviewed, fifteen SR were included, but six of them were rated as having major limitations, so they weren't incorporated in the analyses. According to the nine analyzed SR, ownership does seem to have an effect on health and healthcare related outcomes. In the comparison of PFP and PNFP providers, significant differences in terms of mortality of patients and payments to facilities have been found, both being higher in PFP facilities. In terms of quality and economic indicators such as efficiency, there are no concluding results. When comparing PNFP and public providers, as well as for PFP and public providers, no clear differences were found.
CONCLUSION: PFP providers seem to have worst results than their PNFP counterparts, but there are still important evidence gaps in the literature that needs to be covered, including the comparison between public and both PFP and PNFP providers. More research is needed in low and middle income countries to understand the impact on and development of healthcare delivery systems.
BACKGROUND: Many systematic reviews exist on interventions to improve safe and effective medicines use by consumers, but research is distributed across diseases, populations and settings. The scope and focus of such reviews also vary widely, creating challenges for decision-makers seeking to inform decisions by using the evidence on consumers’ medicines use.
This is an update of a 2011 overview of systematic reviews, which synthesises the evidence, irrespective of disease, medicine type, population or setting, on the effectiveness of interventions to improve consumers' medicines use.
OBJECTIVES: To assess the effects of interventions which target healthcare consumers to promote safe and effective medicines use, by synthesising review-level evidence.
SEARCH METHODS: We included systematic reviews published on the Cochrane Database of Systematic Reviews and the Database of Abstracts of Reviews of Effects. We identified relevant reviews by handsearching databases from their start dates to March 2012.
SELECTION CRITERIA: We screened and ranked reviews based on relevance to consumers’ medicines use, using criteria developed for this overview.
DATA COLLECTION AND ANALYSIS: We used standardised forms to extract data, and assessed reviews for methodological quality using the AMSTAR tool. We used standardised language to summarise results within and across reviews; and gave bottom-line statements about intervention effectiveness. Two review authors screened and selected reviews, and extracted and analysed data. We used a taxonomy of interventions to categorise reviews and guide syntheses.
MAIN RESULTS: We included 75 systematic reviews of varied methodological quality. Reviews assessed interventions with diverse aims including support for behaviour change, risk minimisation and skills acquisition. No reviews aimed to promote systems-level consumer participation in medicines-related activities. Medicines adherence was the most frequently-reported outcome, but others such as knowledge, clinical and service-use outcomes were also reported. Adverse events were less commonly identified, while those associated with the interventions themselves, or costs, were rarely reported.
Looking across reviews, for most outcomes, medicines self-monitoring and self-management programmes appear generally effective to improve medicines use, adherence, adverse events and clinical outcomes; and to reduce mortality in people self-managing antithrombotic therapy. However, some participants were unable to complete these interventions, suggesting they may not be suitable for everyone.
Other promising interventions to improve adherence and other key medicines-use outcomes, which require further investigation to be more certain of their effects, include:
· simplified dosing regimens: with positive effects on adherence;
· interventions involving pharmacists in medicines management, such as medicines reviews (with positive effects on adherence and use, medicines problems and clinical outcomes) and pharmaceutical care services (consultation between pharmacist and patient to resolve medicines problems, develop a care plan and provide follow-up; with positive effects on adherence and knowledge).
Several other strategies showed some positive effects, particularly relating to adherence, and other outcomes, but their effects were less consistent overall and so need further study. These included:
· delayed antibiotic prescriptions: effective to decrease antibiotic use but with mixed effects on clinical outcomes, adverse effects and satisfaction;
· practical strategies like reminders, cues and/or organisers, reminder packaging and material incentives: with positive, although somewhat mixed effects on adherence;
· education delivered with self-management skills training, counselling, support, training or enhanced follow-up; information and counselling delivered together; or education/information as part of pharmacist-delivered packages of care: with positive effects on adherence, medicines use, clinical outcomes and knowledge, but with mixed effects in some studies;
· financial incentives: with positive, but mixed, effects on adherence.
Several strategies also showed promise in promoting immunisation uptake, but require further study to be more certain of their effects. These included organisational interventions; reminders and recall; financial incentives; home visits; free vaccination; lay health worker interventions; and facilitators working with physicians to promote immunisation uptake. Education and/or information strategies also showed some positive but even less consistent effects on immunisation uptake, and need further assessment of effectiveness and investigation of heterogeneity.
There are many different potential pathways through which consumers' use of medicines could be targeted to improve outcomes, and simple interventions may be as effective as complex strategies. However, no single intervention assessed was effective to improve all medicines-use outcomes across all diseases, medicines, populations or settings.
Even where interventions showed promise, the assembled evidence often only provided part of the picture: for example, simplified dosing regimens seem effective for improving adherence, but there is not yet sufficient information to identify an optimal regimen.
In some instances interventions appear ineffective: for example, the evidence suggests that directly observed therapy may be generally ineffective for improving treatment completion, adherence or clinical outcomes.
In other cases, interventions may have variable effects across outcomes. As an example, strategies providing information or education as single interventions appear ineffective to improve medicines adherence or clinical outcomes, but may be effective to improve knowledge; an important outcome for promoting consumers' informed medicines choices.
Despite a doubling in the number of reviews included in this updated overview, uncertainty still exists about the effectiveness of many interventions, and the evidence on what works remains sparse for several populations, including children and young people, carers, and people with multimorbidity.
AUTHORS' CONCLUSIONS: This overview presents evidence from 75 reviews that have synthesised trials and other studies evaluating the effects of interventions to improve consumers' medicines use.
Systematically assembling the evidence across reviews allows identification of effective or promising interventions to improve consumers’ medicines use, as well as those for which the evidence indicates ineffectiveness or uncertainty.
Decision makers faced with implementing interventions to improve consumers' medicines use can use this overview to inform decisions about which interventions may be most promising to improve particular outcomes. The intervention taxonomy may also assist people to consider the strategies available in relation to specific purposes, for example, gaining skills or being involved in decision making. Researchers and funders can use this overview to identify where more research is needed and assess its priority. The limitations of the available literature due to the lack of evidence for important outcomes and important populations, such as people with multimorbidity, should also be considered in practice and policy decisions.
BACKGROUND: The impact of unmet eye care needs in sub-Saharan Africa is compounded by barriers to accessing eye care, limited engagement with communities, a shortage of appropriately skilled health personnel, and inadequate support from health systems. The renewed focus on primary health care has led to support for greater integration of eye health into national health systems. The aim of this paper is to demonstrate available evidence of integration of eye health into primary health care in sub-Saharan Africa from a health systems strengthening perspective.
METHODS: A scoping review method was used to gather and assess information from published literature, reviews, WHO policy documents and examples of eye and health care interventions in sub-Saharan Africa. Findings were compiled using a health systems strengthening framework.
RESULTS: Limited information is available about eye health from a health systems strengthening approach. Particular components of the health systems framework lacking evidence are service delivery, equipment and supplies, financing, leadership and governance. There is some information to support interventions to strengthen human resources at all levels, partnerships and community participation; but little evidence showing their successful application to improve quality of care and access to comprehensive eye health services at the primary health level, and referral to other levels for specialist eye care.
CONCLUSION: Evidence of integration of eye health into primary health care is currently weak, particularly when applying a health systems framework. A realignment of eye health in the primary health care agenda will require context specific planning and a holistic approach, with careful attention to each of the health system components and to the public health system as a whole. Documentation and evaluation of existing projects are required, as are pilot projects of systematic approaches to interventions and application of best practices. Multi-national research may provide guidance about how to scale up eye health interventions that are integrated into primary health systems.
PURPOSE: Since the Declaration of Alma Ata, universal coverage has been at the heart of international health. The purpose of this study was to review the evidence on factors and interventions which are effective in promoting coverage and access to cataract and other health services, focusing on developing countries.
METHODS: A thorough literature search for systematic reviews was conducted. Information resources searched were Medline, The Cochrane Library and the Health System Evidence database. Medline was searched from January 1950 to June 2010. The Cochrane Library search consisted of identifying all systematic reviews produced by the Cochrane Eyes and Vision Group and the Cochrane Effective Practice and Organisation of Care. These reviews were assessed for potential inclusion in the review. The Health Systems Evidence database hosted by MacMaster University was searched to identify overviews of systematic reviews.
RESULTS: No reviews met the inclusion criteria for cataract surgery. The literature search on other health sectors identified 23 systematic reviews providing robust evidence on the main factors facilitating universal coverage. The main enabling factors influencing access to services in developing countries were peer education, the deployment of staff to rural areas, task shifting, integration of services, supervision of health staff, eliminating user fees and scaling up of health insurance schemes.
CONCLUSION: There are significant research gaps in eye care. There is a pressing need for further high quality primary research on health systems-related factors to understand how the delivery of eye care services and health systems' capacities are interrelated.
BACKGROUND: Systematic reviews are increasingly informing policies in tuberculosis (TB) care and control. They may also be a source of questions for future research. As part of the process of developing the International Roadmap for TB Research, we did a systematic review of published systematic reviews on TB, to identify research priorities that are most frequently suggested in reviews.
METHODOLOGY/PRINCIPAL FINDINGS: We searched EMBASE, MEDLINE, Web of Science, and the Cochrane Library for systematic reviews and meta-analyses on any aspect of TB published between 2005 and 2010. One reviewer extracted data and a second reviewer independently extracted data from a random subset of included studies. In total, 137 systematic reviews, with 141 research questions, were included in this review. We used the UK Health Research Classification System (HRCS) to help us classify the research questions and priorities. The three most common research topics were in the area of detection, screening and diagnosis of TB (32.6%), development and evaluation of treatments and therapeutic interventions (23.4%), and TB aetiology and risk factors (19.9%). The research priorities determined were mainly focused on the discovery and evaluation of bacteriological TB tests and drug-resistant TB tests and immunological tests. Other important topics of future research were genetic susceptibility linked to TB and disease determinants attributed to HIV/TB. Evaluation of drug treatments for TB, drug-resistant TB and HIV/TB were also frequently proposed research topics.
CONCLUSIONS: Systematic reviews are a good source of key research priorities. Findings from our survey have informed the development of the International Roadmap for TB Research by the TB Research Movement.
An umbrella review providing a comprehensive synthesis of the interventions that are effective in providing routine immunisation outcomes for children in low and middle-income countries (L&MICs).
DESIGN:
A systematic review of systematic reviews, or an umbrella review.
DATA SOURCES:
We comprehensively searched 11 academic databases and 23 grey literature sources. The search was adopted from an evidence gap map on routine child immunisation sector in L&MICs, which was done on 5 May 2020. We updated the search in October 2021.
ELIGIBILITY CRITERIA:
We included systematic reviews assessing the effectiveness of any intervention on routine childhood immunisation outcomes in L&MICs.
DATA EXTRACTION AND SYNTHESIS:
Search results were screened by two reviewers independently applying predefined inclusion and exclusion criteria. Data were extracted by two researchers independently. The Specialist Unit for Review Evidence checklist was used to assess review quality. A mixed-methods synthesis was employed focusing on meta-analytical and narrative elements to accommodate both the quantitative and qualitative information available from the included reviews.
RESULTS:
62 systematic reviews are included in this umbrella review. We find caregiver-oriented interventions have large positive and statistically significant effects, especially those focusing on short-term sensitisation and education campaigns as well as written messages to caregivers. For health system-oriented interventions the evidence base is thin and derived from narrative synthesis suggesting positive effects for home visits, mixed effects for pay-for-performance schemes and inconclusive effects for contracting out services to non-governmental providers. For all other interventions under this category, the evidence is either limited or not available. For community-oriented interventions, a recent high-quality mixed-methods review suggests positive but small effects. Overall, the evidence base is highly heterogenous in terms of scope, intervention types and outcomes.
CONCLUSION:
Interventions oriented towards caregivers and communities are effective in improving routine child immunisation outcomes. The evidence base on health system-oriented interventions is scant not allowing us to reach firm conclusions, except for home visits. Large evidence gaps exist and need to be addressed. For example, more high-quality evidence is needed for specific caregiver-oriented interventions (eg, monetary incentives) as well as health system-oriented (eg, health workers and data systems) and community-oriented interventions. We also need to better understand complementarity of different intervention types.
