OBJECTIVE: An umbrella review providing a comprehensive synthesis of the interventions that are effective in providing routine immunisation outcomes for children in low and middle-income countries (L&MICs).
DESIGN: A systematic review of systematic reviews, or an umbrella review.
DATA SOURCES: We comprehensively searched 11 academic databases and 23 grey literature sources. The search was adopted from an evidence gap map on routine child immunisation sector in L&MICs, which was done on 5 May 2020. We updated the search in October 2021.
ELIGIBILITY CRITERIA: We included systematic reviews assessing the effectiveness of any intervention on routine childhood immunisation outcomes in L&MICs.
DATA EXTRACTION AND SYNTHESIS: Search results were screened by two reviewers independently applying predefined inclusion and exclusion criteria. Data were extracted by two researchers independently. The Specialist Unit for Review Evidence checklist was used to assess review quality. A mixed-methods synthesis was employed focusing on meta-analytical and narrative elements to accommodate both the quantitative and qualitative information available from the included reviews.
RESULTS: 62 systematic reviews are included in this umbrella review. We find caregiver-oriented interventions have large positive and statistically significant effects, especially those focusing on short-term sensitisation and education campaigns as well as written messages to caregivers. For health system-oriented interventions the evidence base is thin and derived from narrative synthesis suggesting positive effects for home visits, mixed effects for pay-for-performance schemes and inconclusive effects for contracting out services to non-governmental providers. For all other interventions under this category, the evidence is either limited or not available. For community-oriented interventions, a recent high-quality mixed-methods review suggests positive but small effects. Overall, the evidence base is highly heterogenous in terms of scope, intervention types and outcomes.
CONCLUSION: Interventions oriented towards caregivers and communities are effective in improving routine child immunisation outcomes. The evidence base on health system-oriented interventions is scant not allowing us to reach firm conclusions, except for home visits. Large evidence gaps exist and need to be addressed. For example, more high-quality evidence is needed for specific caregiver-oriented interventions (eg, monetary incentives) as well as health system-oriented (eg, health workers and data systems) and community-oriented interventions. We also need to better understand complementarity of different intervention types.
BACKGROUND: Reviews of qualitative studies allow for deeper understanding of concepts and findings beyond the single qualitative studies. Concerns on study reporting quality led to the publication of the COREQ-guidelines for qualitative studies in 2007, followed by the ENTREQ-guidelines for qualitative reviews in 2012. The aim of this meta-review is to: 1) investigate the uptake of the COREQ- and ENTREQ- checklists in qualitative reviews; and 2) compare the quality of reporting of the primary qualitative studies included within these reviews prior- and post COREQ-publication.
METHODS: Reviews were searched on 02-Sept-2020 and categorized as (1) COREQ- or (2) ENTREQ-using, (3) using both, or (4) non-COREQ/ENTREQ. Proportions of usage were calculated over time. COREQ-scores of the primary studies included in these reviews were compared prior- and post COREQ-publication using T-test with Bonferroni correction.
RESULTS: 1.695 qualitative reviews were included (222 COREQ, 369 ENTREQ, 62 both COREQ/ENTREQ and 1.042 non-COREQ/ENTREQ), spanning 12 years (2007-2019) demonstrating an exponential publication rate. The uptake of the ENTREQ in reviews is higher than the COREQ (respectively 28% and 17%), and increases over time. COREQ-scores could be extracted from 139 reviews (including 2.775 appraisals). Reporting quality improved following the COREQ-publication with 13 of the 32 signalling questions showing improvement; the average total score increased from 15.15 to 17.74 (p-value < 0.001).
CONCLUSION: The number of qualitative reviews increased exponentially, but the uptake of the COREQ and ENTREQ was modest overall. Primary qualitative studies show a positive trend in reporting quality, which may have been facilitated by the publication of the COREQ.
Around 200 million people were affected by conflict and natural disasters in 2015. Whereas those populations are at a particular high risk of death, optimal breastfeeding and complementary feeding practices could prevent almost 20% of deaths amongst children less than 5 years old. Yet, coverage of interventions for improving infant and young child feeding (IYCF) practices in emergencies is low, partly due to lack of evidence. Considering the paucity of data generated in emergencies to inform programming, we conducted an evidence map from reviews that included low- and middle-income countries and looked at several interventions: (a) social and behavioural change interpersonal and mass communication for promoting breastfeeding and adequate complementary feeding; (b) provision of donated complementary food; (c) home-based fortification with multiple micronutrient powder; (d) capacity building; (e) cash transfers; (f) agricultural or fresh food supply interventions; and (g) psychological support to caretakers. We looked for availability of evidence of these interventions to improve IYCF practices and nutritional status of infants and young children. We identified 1,376 records and included 28 reviews meeting the inclusion criteria. The highest number of reviews identified was for behavioural change interpersonal communication for promoting breastfeeding, whereas no review was identified for psychological support to caretakers. We conclude that any further research should focus on the mechanisms and delivery models through which effectiveness of interventions can be achieved and on the influence of contextual factors. Efforts should be renewed to generate evidence of effectiveness of IYCF interventions during humanitarian emergencies despite the challenges.
BACKGROUND: Delivery arrangements include changes in who receives care and when, who provides care, the working conditions of those who provide care, coordination of care amongst different providers, where care is provided, the use of information and communication technology to deliver care, and quality and safety systems. How services are delivered can have impacts on the effectiveness, efficiency and equity of health systems. This broad overview of the findings of systematic reviews can help policymakers and other stakeholders identify strategies for addressing problems and improve the delivery of services.
OBJECTIVES: To provide an overview of the available evidence from up-to-date systematic reviews about the effects of delivery arrangements for health systems in low-income countries. Secondary objectives include identifying needs and priorities for future evaluations and systematic reviews on delivery arrangements and informing refinements of the framework for delivery arrangements outlined in the review.
METHODS: We searched Health Systems Evidence in November 2010 and PDQ-Evidence up to 17 December 2016 for systematic reviews. We did not apply any date, language or publication status limitations in the searches. We included well-conducted systematic reviews of studies that assessed the effects of delivery arrangements on patient outcomes (health and health behaviours), the quality or utilisation of healthcare services, resource use, healthcare provider outcomes (such as sick leave), or social outcomes (such as poverty or employment) and that were published after April 2005. We excluded reviews with limitations important enough to compromise the reliability of the findings. Two overview authors independently screened reviews, extracted data, and assessed the certainty of evidence using GRADE. We prepared SUPPORT Summaries for eligible reviews, including key messages, 'Summary of findings' tables (using GRADE to assess the certainty of the evidence), and assessments of the relevance of findings to low-income countries.
MAIN RESULTS: We identified 7272 systematic reviews and included 51 of them in this overview. We judged 6 of the 51 reviews to have important methodological limitations and the other 45 to have only minor limitations. We grouped delivery arrangements into eight categories. Some reviews provided more than one comparison and were in more than one category. Across these categories, the following intervention were effective; that is, they have desirable effects on at least one outcome with moderate- or high-certainty evidence and no moderate- or high-certainty evidence of undesirable effects. Who receives care and when: queuing strategies and antenatal care to groups of mothers. Who provides care: lay health workers for caring for people with hypertension, lay health workers to deliver care for mothers and children or infectious diseases, lay health workers to deliver community-based neonatal care packages, midlevel health professionals for abortion care, social support to pregnant women at risk, midwife-led care for childbearing women, non-specialist providers in mental health and neurology, and physician-nurse substitution. Coordination of care: hospital clinical pathways, case management for people living with HIV and AIDS, interactive communication between primary care doctors and specialists, hospital discharge planning, adding a service to an existing service and integrating delivery models, referral from primary to secondary care, physician-led versus nurse-led triage in emergency departments, and team midwifery. Where care is provided: high-volume institutions, home-based care (with or without multidisciplinary team) for people living with HIV and AIDS, home-based management of malaria, home care for children with acute physical conditions, community-based interventions for childhood diarrhoea and pneumonia, out-of-facility HIV and reproductive health services for youth, and decentralised HIV care. Information and communication technology: mobile phone messaging for patients with long-term illnesses, mobile phone messaging reminders for attendance at healthcare appointments, mobile phone messaging to promote adherence to antiretroviral therapy, women carrying their own case notes in pregnancy, interventions to improve childhood vaccination. Quality and safety systems: decision support with clinical information systems for people living with HIV/AIDS. Complex interventions (cutting across delivery categories and other health system arrangements): emergency obstetric referral interventions.
AUTHORS' CONCLUSIONS: A wide range of strategies have been evaluated for improving delivery arrangements in low-income countries, using sound systematic review methods in both Cochrane and non-Cochrane reviews. These reviews have assessed a range of outcomes. Most of the available evidence focuses on who provides care, where care is provided and coordination of care. For all the main categories of delivery arrangements, we identified gaps in primary research related to uncertainty about the applicability of the evidence to low-income countries, low- or very low-certainty evidence or a lack of studies.
BACKGROUND: Many systematic reviews exist on interventions to improve safe and effective medicines use by consumers, but research is distributed across diseases, populations and settings. The scope and focus of such reviews also vary widely, creating challenges for decision-makers seeking to inform decisions by using the evidence on consumers’ medicines use.
This is an update of a 2011 overview of systematic reviews, which synthesises the evidence, irrespective of disease, medicine type, population or setting, on the effectiveness of interventions to improve consumers' medicines use.
OBJECTIVES: To assess the effects of interventions which target healthcare consumers to promote safe and effective medicines use, by synthesising review-level evidence.
SEARCH METHODS: We included systematic reviews published on the Cochrane Database of Systematic Reviews and the Database of Abstracts of Reviews of Effects. We identified relevant reviews by handsearching databases from their start dates to March 2012.
SELECTION CRITERIA: We screened and ranked reviews based on relevance to consumers’ medicines use, using criteria developed for this overview.
DATA COLLECTION AND ANALYSIS: We used standardised forms to extract data, and assessed reviews for methodological quality using the AMSTAR tool. We used standardised language to summarise results within and across reviews; and gave bottom-line statements about intervention effectiveness. Two review authors screened and selected reviews, and extracted and analysed data. We used a taxonomy of interventions to categorise reviews and guide syntheses.
MAIN RESULTS: We included 75 systematic reviews of varied methodological quality. Reviews assessed interventions with diverse aims including support for behaviour change, risk minimisation and skills acquisition. No reviews aimed to promote systems-level consumer participation in medicines-related activities. Medicines adherence was the most frequently-reported outcome, but others such as knowledge, clinical and service-use outcomes were also reported. Adverse events were less commonly identified, while those associated with the interventions themselves, or costs, were rarely reported.
Looking across reviews, for most outcomes, medicines self-monitoring and self-management programmes appear generally effective to improve medicines use, adherence, adverse events and clinical outcomes; and to reduce mortality in people self-managing antithrombotic therapy. However, some participants were unable to complete these interventions, suggesting they may not be suitable for everyone.
Other promising interventions to improve adherence and other key medicines-use outcomes, which require further investigation to be more certain of their effects, include:
· simplified dosing regimens: with positive effects on adherence;
· interventions involving pharmacists in medicines management, such as medicines reviews (with positive effects on adherence and use, medicines problems and clinical outcomes) and pharmaceutical care services (consultation between pharmacist and patient to resolve medicines problems, develop a care plan and provide follow-up; with positive effects on adherence and knowledge).
Several other strategies showed some positive effects, particularly relating to adherence, and other outcomes, but their effects were less consistent overall and so need further study. These included:
· delayed antibiotic prescriptions: effective to decrease antibiotic use but with mixed effects on clinical outcomes, adverse effects and satisfaction;
· practical strategies like reminders, cues and/or organisers, reminder packaging and material incentives: with positive, although somewhat mixed effects on adherence;
· education delivered with self-management skills training, counselling, support, training or enhanced follow-up; information and counselling delivered together; or education/information as part of pharmacist-delivered packages of care: with positive effects on adherence, medicines use, clinical outcomes and knowledge, but with mixed effects in some studies;
· financial incentives: with positive, but mixed, effects on adherence.
Several strategies also showed promise in promoting immunisation uptake, but require further study to be more certain of their effects. These included organisational interventions; reminders and recall; financial incentives; home visits; free vaccination; lay health worker interventions; and facilitators working with physicians to promote immunisation uptake. Education and/or information strategies also showed some positive but even less consistent effects on immunisation uptake, and need further assessment of effectiveness and investigation of heterogeneity.
There are many different potential pathways through which consumers' use of medicines could be targeted to improve outcomes, and simple interventions may be as effective as complex strategies. However, no single intervention assessed was effective to improve all medicines-use outcomes across all diseases, medicines, populations or settings.
Even where interventions showed promise, the assembled evidence often only provided part of the picture: for example, simplified dosing regimens seem effective for improving adherence, but there is not yet sufficient information to identify an optimal regimen.
In some instances interventions appear ineffective: for example, the evidence suggests that directly observed therapy may be generally ineffective for improving treatment completion, adherence or clinical outcomes.
In other cases, interventions may have variable effects across outcomes. As an example, strategies providing information or education as single interventions appear ineffective to improve medicines adherence or clinical outcomes, but may be effective to improve knowledge; an important outcome for promoting consumers' informed medicines choices.
Despite a doubling in the number of reviews included in this updated overview, uncertainty still exists about the effectiveness of many interventions, and the evidence on what works remains sparse for several populations, including children and young people, carers, and people with multimorbidity.
AUTHORS' CONCLUSIONS: This overview presents evidence from 75 reviews that have synthesised trials and other studies evaluating the effects of interventions to improve consumers' medicines use.
Systematically assembling the evidence across reviews allows identification of effective or promising interventions to improve consumers’ medicines use, as well as those for which the evidence indicates ineffectiveness or uncertainty.
Decision makers faced with implementing interventions to improve consumers' medicines use can use this overview to inform decisions about which interventions may be most promising to improve particular outcomes. The intervention taxonomy may also assist people to consider the strategies available in relation to specific purposes, for example, gaining skills or being involved in decision making. Researchers and funders can use this overview to identify where more research is needed and assess its priority. The limitations of the available literature due to the lack of evidence for important outcomes and important populations, such as people with multimorbidity, should also be considered in practice and policy decisions.
PURPOSE: Since the Declaration of Alma Ata, universal coverage has been at the heart of international health. The purpose of this study was to review the evidence on factors and interventions which are effective in promoting coverage and access to cataract and other health services, focusing on developing countries.
METHODS: A thorough literature search for systematic reviews was conducted. Information resources searched were Medline, The Cochrane Library and the Health System Evidence database. Medline was searched from January 1950 to June 2010. The Cochrane Library search consisted of identifying all systematic reviews produced by the Cochrane Eyes and Vision Group and the Cochrane Effective Practice and Organisation of Care. These reviews were assessed for potential inclusion in the review. The Health Systems Evidence database hosted by MacMaster University was searched to identify overviews of systematic reviews.
RESULTS: No reviews met the inclusion criteria for cataract surgery. The literature search on other health sectors identified 23 systematic reviews providing robust evidence on the main factors facilitating universal coverage. The main enabling factors influencing access to services in developing countries were peer education, the deployment of staff to rural areas, task shifting, integration of services, supervision of health staff, eliminating user fees and scaling up of health insurance schemes.
CONCLUSION: There are significant research gaps in eye care. There is a pressing need for further high quality primary research on health systems-related factors to understand how the delivery of eye care services and health systems' capacities are interrelated.
An umbrella review providing a comprehensive synthesis of the interventions that are effective in providing routine immunisation outcomes for children in low and middle-income countries (L&MICs).
DESIGN:
A systematic review of systematic reviews, or an umbrella review.
DATA SOURCES:
We comprehensively searched 11 academic databases and 23 grey literature sources. The search was adopted from an evidence gap map on routine child immunisation sector in L&MICs, which was done on 5 May 2020. We updated the search in October 2021.
ELIGIBILITY CRITERIA:
We included systematic reviews assessing the effectiveness of any intervention on routine childhood immunisation outcomes in L&MICs.
DATA EXTRACTION AND SYNTHESIS:
Search results were screened by two reviewers independently applying predefined inclusion and exclusion criteria. Data were extracted by two researchers independently. The Specialist Unit for Review Evidence checklist was used to assess review quality. A mixed-methods synthesis was employed focusing on meta-analytical and narrative elements to accommodate both the quantitative and qualitative information available from the included reviews.
RESULTS:
62 systematic reviews are included in this umbrella review. We find caregiver-oriented interventions have large positive and statistically significant effects, especially those focusing on short-term sensitisation and education campaigns as well as written messages to caregivers. For health system-oriented interventions the evidence base is thin and derived from narrative synthesis suggesting positive effects for home visits, mixed effects for pay-for-performance schemes and inconclusive effects for contracting out services to non-governmental providers. For all other interventions under this category, the evidence is either limited or not available. For community-oriented interventions, a recent high-quality mixed-methods review suggests positive but small effects. Overall, the evidence base is highly heterogenous in terms of scope, intervention types and outcomes.
CONCLUSION:
Interventions oriented towards caregivers and communities are effective in improving routine child immunisation outcomes. The evidence base on health system-oriented interventions is scant not allowing us to reach firm conclusions, except for home visits. Large evidence gaps exist and need to be addressed. For example, more high-quality evidence is needed for specific caregiver-oriented interventions (eg, monetary incentives) as well as health system-oriented (eg, health workers and data systems) and community-oriented interventions. We also need to better understand complementarity of different intervention types.
