OBJECTIVE: An umbrella review providing a comprehensive synthesis of the interventions that are effective in providing routine immunisation outcomes for children in low and middle-income countries (L&MICs).
DESIGN: A systematic review of systematic reviews, or an umbrella review.
DATA SOURCES: We comprehensively searched 11 academic databases and 23 grey literature sources. The search was adopted from an evidence gap map on routine child immunisation sector in L&MICs, which was done on 5 May 2020. We updated the search in October 2021.
ELIGIBILITY CRITERIA: We included systematic reviews assessing the effectiveness of any intervention on routine childhood immunisation outcomes in L&MICs.
DATA EXTRACTION AND SYNTHESIS: Search results were screened by two reviewers independently applying predefined inclusion and exclusion criteria. Data were extracted by two researchers independently. The Specialist Unit for Review Evidence checklist was used to assess review quality. A mixed-methods synthesis was employed focusing on meta-analytical and narrative elements to accommodate both the quantitative and qualitative information available from the included reviews.
RESULTS: 62 systematic reviews are included in this umbrella review. We find caregiver-oriented interventions have large positive and statistically significant effects, especially those focusing on short-term sensitisation and education campaigns as well as written messages to caregivers. For health system-oriented interventions the evidence base is thin and derived from narrative synthesis suggesting positive effects for home visits, mixed effects for pay-for-performance schemes and inconclusive effects for contracting out services to non-governmental providers. For all other interventions under this category, the evidence is either limited or not available. For community-oriented interventions, a recent high-quality mixed-methods review suggests positive but small effects. Overall, the evidence base is highly heterogenous in terms of scope, intervention types and outcomes.
CONCLUSION: Interventions oriented towards caregivers and communities are effective in improving routine child immunisation outcomes. The evidence base on health system-oriented interventions is scant not allowing us to reach firm conclusions, except for home visits. Large evidence gaps exist and need to be addressed. For example, more high-quality evidence is needed for specific caregiver-oriented interventions (eg, monetary incentives) as well as health system-oriented (eg, health workers and data systems) and community-oriented interventions. We also need to better understand complementarity of different intervention types.
BACKGROUND: Reviews of qualitative studies allow for deeper understanding of concepts and findings beyond the single qualitative studies. Concerns on study reporting quality led to the publication of the COREQ-guidelines for qualitative studies in 2007, followed by the ENTREQ-guidelines for qualitative reviews in 2012. The aim of this meta-review is to: 1) investigate the uptake of the COREQ- and ENTREQ- checklists in qualitative reviews; and 2) compare the quality of reporting of the primary qualitative studies included within these reviews prior- and post COREQ-publication.
METHODS: Reviews were searched on 02-Sept-2020 and categorized as (1) COREQ- or (2) ENTREQ-using, (3) using both, or (4) non-COREQ/ENTREQ. Proportions of usage were calculated over time. COREQ-scores of the primary studies included in these reviews were compared prior- and post COREQ-publication using T-test with Bonferroni correction.
RESULTS: 1.695 qualitative reviews were included (222 COREQ, 369 ENTREQ, 62 both COREQ/ENTREQ and 1.042 non-COREQ/ENTREQ), spanning 12 years (2007-2019) demonstrating an exponential publication rate. The uptake of the ENTREQ in reviews is higher than the COREQ (respectively 28% and 17%), and increases over time. COREQ-scores could be extracted from 139 reviews (including 2.775 appraisals). Reporting quality improved following the COREQ-publication with 13 of the 32 signalling questions showing improvement; the average total score increased from 15.15 to 17.74 (p-value < 0.001).
CONCLUSION: The number of qualitative reviews increased exponentially, but the uptake of the COREQ and ENTREQ was modest overall. Primary qualitative studies show a positive trend in reporting quality, which may have been facilitated by the publication of the COREQ.
BACKGROUND: Antenatal care (ANC) and postnatal care (PNC) are critical opportunities for women, babies and parents/families to receive quality care and support from health services. Community-based interventions may improve the accessibility, availability, and acceptance of this vital care. For example, community mobilization strategies have been used to involve and collaborate with women, families and communities to improve maternal and newborn health.
OBJECTIVE: To synthesize existing reviews of evidence on community mobilization strategies that strengthen support for appropriate and timely use of ANC and PNC.
METHODS: Six databases (MEDLINE, Embase, CINAHL, PsychINFO, Cochrane Library, PROSPERO) were searched for published reviews that describe community mobilization related strategies for ANC and/or PNC. Reviews were eligible for inclusion if they described any initiatives or strategies targeting the promotion of ANC and/or PNC uptake that included an element of community mobilization in a low- or middle-income country (LMIC), published after 2000. Included reviews were critically appraised according to the Joanna Briggs Institute (JBI) Checklist for Systematic Reviews and Evidence Syntheses. This review of reviews was conducted following JBI guidelines for undertaking and reporting umbrella reviews.
RESULTS: In total 23 papers, representing 22 reviews were included. While all 22 reviews contained some description of community mobilization and ANC/PNC, 13 presented more in-depth details on the community mobilization processes and relevant outcomes. Seventeen reviews focused on ANC, four considered both ANC and PNC, and only one focused on PNC. Overall, 16 reviews reported at least one positive association between community mobilization activities and ANC/PNC uptake, while five reviews presented primary studies with no statistically significant change in ANC uptake and one included a primary study with a decrease in use of antenatal facilities. The community mobilization activities described by the reviews ranged from informative, passive communication to more active, participatory approaches that included engaging individuals or consulting local leaders and community members to develop priorities and action plans.
CONCLUSIONS: While there is considerable momentum around incorporating community mobilization activities in maternal and newborn health programs, such as improving community support for the uptake of ANC and PNC, there is limited evidence on the processes used. Furthermore, the spectrum of terminology and variation in definitions should be harmonized to guide the implementation and evaluation efforts.
Around 200 million people were affected by conflict and natural disasters in 2015. Whereas those populations are at a particular high risk of death, optimal breastfeeding and complementary feeding practices could prevent almost 20% of deaths amongst children less than 5 years old. Yet, coverage of interventions for improving infant and young child feeding (IYCF) practices in emergencies is low, partly due to lack of evidence. Considering the paucity of data generated in emergencies to inform programming, we conducted an evidence map from reviews that included low- and middle-income countries and looked at several interventions: (a) social and behavioural change interpersonal and mass communication for promoting breastfeeding and adequate complementary feeding; (b) provision of donated complementary food; (c) home-based fortification with multiple micronutrient powder; (d) capacity building; (e) cash transfers; (f) agricultural or fresh food supply interventions; and (g) psychological support to caretakers. We looked for availability of evidence of these interventions to improve IYCF practices and nutritional status of infants and young children. We identified 1,376 records and included 28 reviews meeting the inclusion criteria. The highest number of reviews identified was for behavioural change interpersonal communication for promoting breastfeeding, whereas no review was identified for psychological support to caretakers. We conclude that any further research should focus on the mechanisms and delivery models through which effectiveness of interventions can be achieved and on the influence of contextual factors. Efforts should be renewed to generate evidence of effectiveness of IYCF interventions during humanitarian emergencies despite the challenges.
BACKGROUND: Delivery arrangements include changes in who receives care and when, who provides care, the working conditions of those who provide care, coordination of care amongst different providers, where care is provided, the use of information and communication technology to deliver care, and quality and safety systems. How services are delivered can have impacts on the effectiveness, efficiency and equity of health systems. This broad overview of the findings of systematic reviews can help policymakers and other stakeholders identify strategies for addressing problems and improve the delivery of services.
OBJECTIVES: To provide an overview of the available evidence from up-to-date systematic reviews about the effects of delivery arrangements for health systems in low-income countries. Secondary objectives include identifying needs and priorities for future evaluations and systematic reviews on delivery arrangements and informing refinements of the framework for delivery arrangements outlined in the review.
METHODS: We searched Health Systems Evidence in November 2010 and PDQ-Evidence up to 17 December 2016 for systematic reviews. We did not apply any date, language or publication status limitations in the searches. We included well-conducted systematic reviews of studies that assessed the effects of delivery arrangements on patient outcomes (health and health behaviours), the quality or utilisation of healthcare services, resource use, healthcare provider outcomes (such as sick leave), or social outcomes (such as poverty or employment) and that were published after April 2005. We excluded reviews with limitations important enough to compromise the reliability of the findings. Two overview authors independently screened reviews, extracted data, and assessed the certainty of evidence using GRADE. We prepared SUPPORT Summaries for eligible reviews, including key messages, 'Summary of findings' tables (using GRADE to assess the certainty of the evidence), and assessments of the relevance of findings to low-income countries.
MAIN RESULTS: We identified 7272 systematic reviews and included 51 of them in this overview. We judged 6 of the 51 reviews to have important methodological limitations and the other 45 to have only minor limitations. We grouped delivery arrangements into eight categories. Some reviews provided more than one comparison and were in more than one category. Across these categories, the following intervention were effective; that is, they have desirable effects on at least one outcome with moderate- or high-certainty evidence and no moderate- or high-certainty evidence of undesirable effects. Who receives care and when: queuing strategies and antenatal care to groups of mothers. Who provides care: lay health workers for caring for people with hypertension, lay health workers to deliver care for mothers and children or infectious diseases, lay health workers to deliver community-based neonatal care packages, midlevel health professionals for abortion care, social support to pregnant women at risk, midwife-led care for childbearing women, non-specialist providers in mental health and neurology, and physician-nurse substitution. Coordination of care: hospital clinical pathways, case management for people living with HIV and AIDS, interactive communication between primary care doctors and specialists, hospital discharge planning, adding a service to an existing service and integrating delivery models, referral from primary to secondary care, physician-led versus nurse-led triage in emergency departments, and team midwifery. Where care is provided: high-volume institutions, home-based care (with or without multidisciplinary team) for people living with HIV and AIDS, home-based management of malaria, home care for children with acute physical conditions, community-based interventions for childhood diarrhoea and pneumonia, out-of-facility HIV and reproductive health services for youth, and decentralised HIV care. Information and communication technology: mobile phone messaging for patients with long-term illnesses, mobile phone messaging reminders for attendance at healthcare appointments, mobile phone messaging to promote adherence to antiretroviral therapy, women carrying their own case notes in pregnancy, interventions to improve childhood vaccination. Quality and safety systems: decision support with clinical information systems for people living with HIV/AIDS. Complex interventions (cutting across delivery categories and other health system arrangements): emergency obstetric referral interventions.
AUTHORS' CONCLUSIONS: A wide range of strategies have been evaluated for improving delivery arrangements in low-income countries, using sound systematic review methods in both Cochrane and non-Cochrane reviews. These reviews have assessed a range of outcomes. Most of the available evidence focuses on who provides care, where care is provided and coordination of care. For all the main categories of delivery arrangements, we identified gaps in primary research related to uncertainty about the applicability of the evidence to low-income countries, low- or very low-certainty evidence or a lack of studies.
BACKGROUND: A key function of health systems is implementing interventions to improve health, but coverage of essential health interventions remains low in low-income countries. Implementing interventions can be challenging, particularly if it entails complex changes in clinical routines; in collaborative patterns among different healthcare providers and disciplines; in the behaviour of providers, patients or other stakeholders; or in the organisation of care. Decision-makers may use a range of strategies to implement health interventions, and these choices should be based on evidence of the strategies' effectiveness.
OBJECTIVES: To provide an overview of the available evidence from up-to-date systematic reviews about the effects of implementation strategies for health systems in low-income countries. Secondary objectives include identifying needs and priorities for future evaluations and systematic reviews on alternative implementation strategies and informing refinements of the framework for implementation strategies presented in the overview.
METHODS: We searched Health Systems Evidence in November 2010 and PDQ-Evidence up to December 2016 for systematic reviews. We did not apply any date, language or publication status limitations in the searches. We included well-conducted systematic reviews of studies that assessed the effects of implementation strategies on professional practice and patient outcomes and that were published after April 2005. We excluded reviews with limitations important enough to compromise the reliability of the review findings. Two overview authors independently screened reviews, extracted data and assessed the certainty of evidence using GRADE. We prepared SUPPORT Summaries for eligible reviews, including key messages, 'Summary of findings' tables (using GRADE to assess the certainty of the evidence) and assessments of the relevance of findings to low-income countries.
MAIN RESULTS: We identified 7272 systematic reviews and included 39 of them in this overview. An additional four reviews provided supplementary information. Of the 39 reviews, 32 had only minor limitations and 7 had important methodological limitations. Most studies in the reviews were from high-income countries. There were no studies from low-income countries in eight reviews.Implementation strategies addressed in the reviews were grouped into four categories – strategies targeting:1. healthcare organisations (e.g. strategies to change organisational culture; 1 review);2. healthcare workers by type of intervention (e.g. printed educational materials; 14 reviews);3. healthcare workers to address a specific problem (e.g. unnecessary antibiotic prescription; 9 reviews);4. healthcare recipients (e.g. medication adherence; 15 reviews).Overall, we found the following interventions to have desirable effects on at least one outcome with moderate- or high-certainty evidence and no moderate- or high-certainty evidence of undesirable effects.1.Strategies targeted at healthcare workers: educational meetings, nutrition training of health workers, educational outreach, practice facilitation, local opinion leaders, audit and feedback, and tailored interventions.2.Strategies targeted at healthcare workers for specific types of problems: training healthcare workers to be more patient-centred in clinical consultations, use of birth kits, strategies such as clinician education and patient education to reduce antibiotic prescribing in ambulatory care settings, and in-service neonatal emergency care training.3. Strategies targeted at healthcare recipients: mass media interventions to increase uptake of HIV testing; intensive self-management and adherence, intensive disease management programmes to improve health literacy; behavioural interventions and mobile phone text messages for adherence to antiretroviral therapy; a one time incentive to start or continue tuberculosis prophylaxis; default reminders for patients being treated for active tuberculosis; use of sectioned polythene bags for adherence to malaria medication; community-based health education, and reminders and recall strategies to increase vaccination uptake; interventions to increase uptake of cervical screening (invitations, education, counselling, access to health promotion nurse and intensive recruitment); health insurance information and application support.
AUTHORS' CONCLUSIONS: Reliable systematic reviews have evaluated a wide range of strategies for implementing evidence-based interventions in low-income countries. Most of the available evidence is focused on strategies targeted at healthcare workers and healthcare recipients and relates to process-based outcomes. Evidence of the effects of strategies targeting healthcare organisations is scarce.
BACKGROUND: Governance arrangements include changes in rules or processes that determine authority and accountability for health policies, organisations, commercial products and health professionals, as well as the involvement of stakeholders in decision-making. Changes in governance arrangements can affect health and related goals in numerous ways, generally through changes in authority, accountability, openness, participation and coherence. A broad overview of the findings of systematic reviews can help policymakers, their technical support staff and other stakeholders to identify strategies for addressing problems and improving the governance of their health systems.
OBJECTIVES: To provide an overview of the available evidence from up-to-date systematic reviews about the effects of governance arrangements for health systems in low-income countries. Secondary objectives include identifying needs and priorities for future evaluations and systematic reviews on governance arrangements and informing refinements of the framework for governance arrangements outlined in the overview.
METHODS: We searched Health Systems Evidence in November 2010 and PDQ Evidence up to 17 December 2016 for systematic reviews. We did not apply any date, language or publication status limitations in the searches. We included well-conducted systematic reviews of studies that assessed the effects of governance arrangements on patient outcomes (health and health behaviours), the quality or utilisation of healthcare services, resource use (health expenditures, healthcare provider costs, out-of-pocket payments, cost-effectiveness), healthcare provider outcomes (such as sick leave), or social outcomes (such as poverty, employment) and that were published after April 2005. We excluded reviews with limitations that were important enough to compromise the reliability of the findings of the review. Two overview authors independently screened reviews, extracted data and assessed the certainty of evidence using GRADE. We prepared SUPPORT Summaries for eligible reviews, including key messages, 'Summary of findings' tables (using GRADE to assess the certainty of the evidence) and assessments of the relevance of findings to low-income countries.
MAIN RESULTS: We identified 7272 systematic reviews and included 21 of them in this overview (19 primary reviews and 2 supplementary reviews). We focus here on the results of the 19 primary reviews, one of which had important methodological limitations. The other 18 were reliable (with only minor limitations).We grouped the governance arrangements addressed in the reviews into five categories: authority and accountability for health policies (three reviews); authority and accountability for organisations (two reviews); authority and accountability for commercial products (three reviews); authority and accountability for health professionals (seven reviews); and stakeholder involvement (four reviews).Overall, we found desirable effects for the following interventions on at least one outcome, with moderate- or high-certainty evidence and no moderate- or high-certainty evidence of undesirable effects. Decision-making about what is covered by health insurance- Placing restrictions on the medicines reimbursed by health insurance systems probably decreases the use of and spending on these medicines (moderate-certainty evidence). Stakeholder participation in policy and organisational decisions- Participatory learning and action groups for women probably improve newborn survival (moderate-certainty evidence).- Consumer involvement in preparing patient information probably improves the quality of the information and patient knowledge (moderate-certainty evidence). Disclosing performance information to patients and the public- Disclosing performance data on hospital quality to the public probably encourages hospitals to implement quality improvement activities (moderate-certainty evidence).- Disclosing performance data on individual healthcare providers to the public probably leads people to select providers that have better quality ratings (moderate-certainty evidence).
AUTHORS' CONCLUSIONS: Investigators have evaluated a wide range of governance arrangements that are relevant for low-income countries using sound systematic review methods. These strategies have been targeted at different levels in health systems, and studies have assessed a range of outcomes. Moderate-certainty evidence shows desirable effects (with no undesirable effects) for some interventions. However, there are important gaps in the availability of systematic reviews and primary studies for the all of the main categories of governance arrangements.
BACKGROUND: This review is part of a European Commission project, MASCOT, aimed at reducing maternal and child health inequalities. The purpose was to identify and describe the literature on community-based interventions on maternal health in high-income countries (HIC) and conceptually map the literature according to country focus, topics addressed, nature of the intervention and the intervention provider, and interventions designed to address inequalities in maternal health.
METHODS: The research protocol for this review was based on a low-income country (LMIC) systematic review protocol within the MASCOT Project. We searched PubMED and CINAHL databases for literature published between January 2000 and April 2013. OECD countries were used to determine the HIC and different terms were used to refer to community based interventions, defined as those "delivered in community settings or any activities occurring outside of health facilities".
RESULTS: 119 publications were selected for inclusion in this mapping study. 95 (80%) were Randomised Control Trials (RCTs) and 24 (20%) were systematic reviews (SRs). We categorised the study topics according to the main interventions covered: breastfeeding assistance and promotion, preventing and treating post-natal depression, interventions to support and build capacity around parenting and child care, antenatal interventions preparing women for birth, postnatal planning of future births and control trials around changing maternal behaviours. The home was used as the most common setting to implement these interventions and health professionals accounted for the largest group of intervention providers.
CONCLUSIONS: This review maps and brings knowledge on the type of studies and topics being addressed in community based interventions around maternal health in HICs. It opens the opportunity for further studies on interventions' effectiveness and knowledge transfer to LMICs settings.
BACKGROUND: There is growing recognition of the importance of the active involvement of consumers and community members in health care. Despite the long history of consumer and community engagement (CCE) research and practice, there is no consensus on the best strategies for CCE. In this paper, we identify various dimensions of CCE-related strategies and offer a practical model to assist policy-makers, practitioners and researchers.
METHODS: We undertook a large-scale, scoping meta-review and searched six databases using a list of nine medical subject headings (MeSH) and a comprehensive list of 47 phrases. We identified and examined a total of 90 relevant systematic reviews.
RESULTS: Identified reviews show that although there is a significant body of research on CCE, the development of the field is hindered by a lack of evidence relating to specific elements of CCE. They also indicate a diverse and growing enterprise, drawing on a wide range of disciplinary, political and philosophical perspectives and a mix of definitions, targets, approaches, strategies and mechanisms. CCE interventions and strategies aim to involve consumers, community members and the public in general, as well as specific sub-groups, including children and people from culturally and linguistically diverse backgrounds. Strategies for CCE vary in terms of their aim and type of proposed activity, as do the methods and tools which have been developed to support them. Methods and tools include shared decision making, use of decision aids, consumer representation, application of electronic and internet-based facilities, and peer support. The success of CCE is dependent on both the approach taken and contextual factors, including structural facilitators such as governmental support, as well as barriers such as costs, organisational culture and population-specific limitations.
CONCLUSIONS: The diversity of the field indicates the need to measure each component of CCE. This meta-review provides the basis for development of a new eight stage model of consumer and community engagement. This model emphasises the importance of clarity and focus, as well as an extensive evaluation of contextual factors within specific settings, before the implementation of CCE strategies, enabling those involved in CCE to determine potential facilitators and barriers to the process.
BACKGROUND: Uptake of isoniazid preventive therapy (IPT) to prevent tuberculosis has been poor, particularly in the highest risk populations. Interventions to improve IPT delivery could promote implementation. The large number of existing systematic reviews on treatment adherence has made drawing conclusions a challenge. To provide decision makers with the evidence they need, we performed an overview of systematic reviews to compare different organizational interventions to improve IPT delivery as measured by treatment completion among those at highest risk for the development of TB disease, namely child contacts or HIV-infected individuals.
METHODS: We searched the Cochrane Database of Systematic Reviews, the Database of Abstracts of Reviews of Effects (DARE), and MEDLINE up to August 15, 2012. Two authors used a standardized data extraction form and the AMSTAR instrument to independently assess each review.
RESULTS: Six reviews met inclusion criteria. Interventions included changes in the setting/site of IPT delivery, use of quality monitoring mechanisms (e.g., directly observed therapy), IPT delivery integration into other healthcare services, and use of lay health workers. Most reviews reported a combination of outcomes related to IPT adherence and treatment completion rate but without a baseline or comparison rate. Generally, we found limited evidence to demonstrate that the studied interventions improved treatment completion.
CONCLUSIONS: While most of the interventions were not shown to improve IPT completion, integration of tuberculosis and HIV services yielded high treatment completion rates in some settings. The lack of data from high burden TB settings limits applicability. Further research to assess different IPT delivery interventions, including those that address barriers to care in at-risk populations, is urgently needed to identify the most effective practices for IPT delivery and TB control in high TB burden settings.
An umbrella review providing a comprehensive synthesis of the interventions that are effective in providing routine immunisation outcomes for children in low and middle-income countries (L&MICs).
DESIGN:
A systematic review of systematic reviews, or an umbrella review.
DATA SOURCES:
We comprehensively searched 11 academic databases and 23 grey literature sources. The search was adopted from an evidence gap map on routine child immunisation sector in L&MICs, which was done on 5 May 2020. We updated the search in October 2021.
ELIGIBILITY CRITERIA:
We included systematic reviews assessing the effectiveness of any intervention on routine childhood immunisation outcomes in L&MICs.
DATA EXTRACTION AND SYNTHESIS:
Search results were screened by two reviewers independently applying predefined inclusion and exclusion criteria. Data were extracted by two researchers independently. The Specialist Unit for Review Evidence checklist was used to assess review quality. A mixed-methods synthesis was employed focusing on meta-analytical and narrative elements to accommodate both the quantitative and qualitative information available from the included reviews.
RESULTS:
62 systematic reviews are included in this umbrella review. We find caregiver-oriented interventions have large positive and statistically significant effects, especially those focusing on short-term sensitisation and education campaigns as well as written messages to caregivers. For health system-oriented interventions the evidence base is thin and derived from narrative synthesis suggesting positive effects for home visits, mixed effects for pay-for-performance schemes and inconclusive effects for contracting out services to non-governmental providers. For all other interventions under this category, the evidence is either limited or not available. For community-oriented interventions, a recent high-quality mixed-methods review suggests positive but small effects. Overall, the evidence base is highly heterogenous in terms of scope, intervention types and outcomes.
CONCLUSION:
Interventions oriented towards caregivers and communities are effective in improving routine child immunisation outcomes. The evidence base on health system-oriented interventions is scant not allowing us to reach firm conclusions, except for home visits. Large evidence gaps exist and need to be addressed. For example, more high-quality evidence is needed for specific caregiver-oriented interventions (eg, monetary incentives) as well as health system-oriented (eg, health workers and data systems) and community-oriented interventions. We also need to better understand complementarity of different intervention types.
