OBJECTIVE: An umbrella review providing a comprehensive synthesis of the interventions that are effective in providing routine immunisation outcomes for children in low and middle-income countries (L&MICs).
DESIGN: A systematic review of systematic reviews, or an umbrella review.
DATA SOURCES: We comprehensively searched 11 academic databases and 23 grey literature sources. The search was adopted from an evidence gap map on routine child immunisation sector in L&MICs, which was done on 5 May 2020. We updated the search in October 2021.
ELIGIBILITY CRITERIA: We included systematic reviews assessing the effectiveness of any intervention on routine childhood immunisation outcomes in L&MICs.
DATA EXTRACTION AND SYNTHESIS: Search results were screened by two reviewers independently applying predefined inclusion and exclusion criteria. Data were extracted by two researchers independently. The Specialist Unit for Review Evidence checklist was used to assess review quality. A mixed-methods synthesis was employed focusing on meta-analytical and narrative elements to accommodate both the quantitative and qualitative information available from the included reviews.
RESULTS: 62 systematic reviews are included in this umbrella review. We find caregiver-oriented interventions have large positive and statistically significant effects, especially those focusing on short-term sensitisation and education campaigns as well as written messages to caregivers. For health system-oriented interventions the evidence base is thin and derived from narrative synthesis suggesting positive effects for home visits, mixed effects for pay-for-performance schemes and inconclusive effects for contracting out services to non-governmental providers. For all other interventions under this category, the evidence is either limited or not available. For community-oriented interventions, a recent high-quality mixed-methods review suggests positive but small effects. Overall, the evidence base is highly heterogenous in terms of scope, intervention types and outcomes.
CONCLUSION: Interventions oriented towards caregivers and communities are effective in improving routine child immunisation outcomes. The evidence base on health system-oriented interventions is scant not allowing us to reach firm conclusions, except for home visits. Large evidence gaps exist and need to be addressed. For example, more high-quality evidence is needed for specific caregiver-oriented interventions (eg, monetary incentives) as well as health system-oriented (eg, health workers and data systems) and community-oriented interventions. We also need to better understand complementarity of different intervention types.
BACKGROUND: This study aimed to identify targeted interventions for the prevention and treatment of harmful alcohol use. Umbrella review methodology was used to summarise the effectiveness across a broad range of interventions, in order to identify which interventions should be considered for inclusion within universal health coverage schemes in low- and middle-income countries.
METHODS AND FINDINGS: We included systematic reviews with meta-analysis of randomised controlled trials (RCTs) on targeted interventions addressing alcohol use in harmful drinkers or individuals with alcohol use disorder. We only included outcomes related to alcohol consumption, heavy drinking, binge drinking, abstinence, or alcohol-attributable accident, injury, morbidity or mortality. PubMed, Embase, PsycINFO, Cochrane Database of Systematic Reviews, and the International HTA Database were searched from inception to 3 September 2021. Risk of bias of reviews was assessed using the AMSTAR2 tool. After reviewing the abstracts of 9,167 articles, results were summarised narratively and certainty in the body of evidence for each intervention was assessed using GRADE. In total, 86 studies met the inclusion criteria, of which the majority reported outcomes for brief intervention (30 studies) or pharmacological interventions (29 studies). Overall, methodological quality of included studies was low.
CONCLUSIONS: For harmful drinking, brief interventions, cognitive behavioural therapy, and motivational interviewing showed a small effect, whereas mentoring in adolescents and children may have a significant long-term effect. For alcohol use disorder, social network approaches and acamprosate showed evidence of a significant and durable effect. More evidence is required on the effectiveness of gamma-hydroxybutyric acid (GHB), nalmefene, and quetiapine, as well as optimal combinations of pharmacological and psychosocial interventions. As an umbrella review, we were unable to identify the extent to which variation between studies stemmed from differences in intervention delivery or variation between country contexts. Further research is required on applicability of findings across settings and best practice for implementation. Funded by the Thai Health Promotion Foundation, grant number 61-00-1812.
Diet, physical activity, smoking and alcohol behaviour-change interventions delivered in pregnancy aim to prevent adverse pregnancy outcomes. This review reports a synthesis of evidence from meta-analyses on the effectiveness of interventions at reducing risk of adverse health outcomes. Sixty-five systematic reviews (63 diet and physical activity; 2 smoking) reporting 602 meta-analyses, published since 2011, were identified; no data were identified for alcohol interventions. A wide range of outcomes were reported, including gestational weight gain, hypertensive disorders, gestational diabetes (GDM) and fetal growth. There was consistent evidence from diet and physical activity interventions for a significantly reduced mean gestational weight gain (ranging from -0.21 kg (95% confidence interval -0.34, -0.08) to -5.77 kg (95% CI -9.34, -2.21). There was evidence from larger diet and physical activity meta-analyses for a significant reduction in postnatal weight retention, caesarean delivery, preeclampsia, hypertension, GDM and preterm delivery, and for smoking interventions to significantly increase birth weight. There was no statistically significant evidence of interventions having an effect on low or high birthweight, neonatal intensive care unit admission, Apgar score or mortality outcomes. Priority areas for future research to capitalise on pregnancy as an opportunity to improve the lifelong wellbeing of women and their children are highlighted.
BACKGROUND: Reviews of qualitative studies allow for deeper understanding of concepts and findings beyond the single qualitative studies. Concerns on study reporting quality led to the publication of the COREQ-guidelines for qualitative studies in 2007, followed by the ENTREQ-guidelines for qualitative reviews in 2012. The aim of this meta-review is to: 1) investigate the uptake of the COREQ- and ENTREQ- checklists in qualitative reviews; and 2) compare the quality of reporting of the primary qualitative studies included within these reviews prior- and post COREQ-publication.
METHODS: Reviews were searched on 02-Sept-2020 and categorized as (1) COREQ- or (2) ENTREQ-using, (3) using both, or (4) non-COREQ/ENTREQ. Proportions of usage were calculated over time. COREQ-scores of the primary studies included in these reviews were compared prior- and post COREQ-publication using T-test with Bonferroni correction.
RESULTS: 1.695 qualitative reviews were included (222 COREQ, 369 ENTREQ, 62 both COREQ/ENTREQ and 1.042 non-COREQ/ENTREQ), spanning 12 years (2007-2019) demonstrating an exponential publication rate. The uptake of the ENTREQ in reviews is higher than the COREQ (respectively 28% and 17%), and increases over time. COREQ-scores could be extracted from 139 reviews (including 2.775 appraisals). Reporting quality improved following the COREQ-publication with 13 of the 32 signalling questions showing improvement; the average total score increased from 15.15 to 17.74 (p-value < 0.001).
CONCLUSION: The number of qualitative reviews increased exponentially, but the uptake of the COREQ and ENTREQ was modest overall. Primary qualitative studies show a positive trend in reporting quality, which may have been facilitated by the publication of the COREQ.
BACKGROUND: Systematic reviews (SRs) have shown that clinical decision support systems (CDSSs) have the potential to improve diabetes care. However, methods of measuring and presenting outcomes are varied, and conclusions have been inconsistent. In addition, the reporting and methodological quality in this field is unknown, which could affect the integrity and accuracy of research. Therefore, it is difficult to confirm whether CDSSs are effective in improving diabetes care. OBJECTIVE: To comprehensively evaluate the effects of CDSS on diabetes care and to examine the methodological and reporting qualities. METHODS: We searched PubMed, EMBASE, and Cochrane Library from their inception to February 2017. Systematic reviews investigating the effects of CDSS on diabetes care were included. Outcomes were determined in advance and assessed separately for process of care and patient outcomes. Methodological and reporting qualities were assessed by AMSTAR and PRISMA, respectively. RESULTS: Seventeen SRs, consisting of 222 unique randomized controlled trials and 102 nonrandomized controlled trials, were included. Evidence that CDDS significantly impacted patient outcomes was found in 32 of 102 unique studies of the 15 SRs that examined this effect (31%). A significant impact of CDSS on process of care was found in 117 out of 143 unique studies of the 11 SRs that examined this effect (82%). Ratings for overall scores of AMSTAR resulted in a mean score of 6.5 with a range of scores from 3.5 to 10.0. Reporting quality related to methodological domains was particularly incomplete. CONCLUSIONS: Clinical decision support systems improved the quality of diabetes care by inconsistently improving process of care or patient outcomes. There is evidence that CDSS for providing alerts, reminders, or feedback to participants were most likely to impact diabetes care. Poor reporting of methodological domains, together with qualitative or narrative methods to combine findings, may limit the confidence in research evidence.
BACKGROUND: Current interventions to support medication adherence in people with type 2 diabetes are generally resource-intensive and ineffective. Brief messages, such as those delivered via short message service (SMS) systems, are increasingly used in digital health interventions to support adherence because they can be delivered on a wide scale and at low cost. The content of SMS text messages is a crucial intervention feature for promoting behavior change, but it is often unclear what the rationale is for chosen wording or any underlying mechanisms targeted for behavioral change. There is little guidance for developing and optimizing brief message content for use in mobile device-delivered interventions.
OBJECTIVE: This review aimed to (1) identify theoretical constructs (ie, the targets that interventions aim to change) and behavioral strategies (ie, features of intervention content) found to be associated with medication adherence in patients with type 2 diabetes and (2) map these onto a standard taxonomy for behavior change techniques (BCTs, that is, active ingredients of interventions used to promote behavioral change, to produce an evidence-based set of approaches that have shown promise of improving adherence in previous studies and which could be further tested in digital health interventions.
METHODS: A rapid systematic review of existing relevant systematic reviews was conducted. MEDLINE and PsycINFO databases were searched from inception to April 10, 2017. Inclusion criteria were (1) systematic reviews of quantitative data if the studies reviewed identified predictors of or correlates with medication adherence or evaluated medication adherence-enhancing interventions and included adult participants taking medication to manage a chronic physical health condition, and (2) systematic reviews of qualitative studies of experiences of medication adherence for adult participants with type 2 diabetes. Data were extracted on review characteristics and BCTs, theoretical constructs, or behavioral strategies associated with improved adherence. Constructs and strategies were mapped onto the BCT version 1 taxonomy.
RESULTS: A total of 1701 references were identified; 25 systematic reviews (19 quantitative reviews, 3 qualitative reviews, and 3 mixed-method reviews) were included. Moreover, 20 theoretical constructs (eg, self-efficacy) and 19 behavioral strategies (eg, habit analysis) were identified in the included reviews. In total, 46 BCTs were identified as being related to medication adherence in type 2 diabetes (eg, habit formation, prompts or cues, and information about health consequences).
CONCLUSIONS: We identified 46 promising BCTs related to medication adherence in type 2 diabetes on which the content of brief messages delivered through mobile devices to improve adherence could be based. By using explicit systematic review methods and linking our findings to a standardized taxonomy of BCTs, we have described a novel approach for the development of digital message content. Future brief message interventions that aim to support medication adherence could incorporate the identified BCTs.
BACKGROUND: Delivery arrangements include changes in who receives care and when, who provides care, the working conditions of those who provide care, coordination of care amongst different providers, where care is provided, the use of information and communication technology to deliver care, and quality and safety systems. How services are delivered can have impacts on the effectiveness, efficiency and equity of health systems. This broad overview of the findings of systematic reviews can help policymakers and other stakeholders identify strategies for addressing problems and improve the delivery of services.
OBJECTIVES: To provide an overview of the available evidence from up-to-date systematic reviews about the effects of delivery arrangements for health systems in low-income countries. Secondary objectives include identifying needs and priorities for future evaluations and systematic reviews on delivery arrangements and informing refinements of the framework for delivery arrangements outlined in the review.
METHODS: We searched Health Systems Evidence in November 2010 and PDQ-Evidence up to 17 December 2016 for systematic reviews. We did not apply any date, language or publication status limitations in the searches. We included well-conducted systematic reviews of studies that assessed the effects of delivery arrangements on patient outcomes (health and health behaviours), the quality or utilisation of healthcare services, resource use, healthcare provider outcomes (such as sick leave), or social outcomes (such as poverty or employment) and that were published after April 2005. We excluded reviews with limitations important enough to compromise the reliability of the findings. Two overview authors independently screened reviews, extracted data, and assessed the certainty of evidence using GRADE. We prepared SUPPORT Summaries for eligible reviews, including key messages, 'Summary of findings' tables (using GRADE to assess the certainty of the evidence), and assessments of the relevance of findings to low-income countries.
MAIN RESULTS: We identified 7272 systematic reviews and included 51 of them in this overview. We judged 6 of the 51 reviews to have important methodological limitations and the other 45 to have only minor limitations. We grouped delivery arrangements into eight categories. Some reviews provided more than one comparison and were in more than one category. Across these categories, the following intervention were effective; that is, they have desirable effects on at least one outcome with moderate- or high-certainty evidence and no moderate- or high-certainty evidence of undesirable effects. Who receives care and when: queuing strategies and antenatal care to groups of mothers. Who provides care: lay health workers for caring for people with hypertension, lay health workers to deliver care for mothers and children or infectious diseases, lay health workers to deliver community-based neonatal care packages, midlevel health professionals for abortion care, social support to pregnant women at risk, midwife-led care for childbearing women, non-specialist providers in mental health and neurology, and physician-nurse substitution. Coordination of care: hospital clinical pathways, case management for people living with HIV and AIDS, interactive communication between primary care doctors and specialists, hospital discharge planning, adding a service to an existing service and integrating delivery models, referral from primary to secondary care, physician-led versus nurse-led triage in emergency departments, and team midwifery. Where care is provided: high-volume institutions, home-based care (with or without multidisciplinary team) for people living with HIV and AIDS, home-based management of malaria, home care for children with acute physical conditions, community-based interventions for childhood diarrhoea and pneumonia, out-of-facility HIV and reproductive health services for youth, and decentralised HIV care. Information and communication technology: mobile phone messaging for patients with long-term illnesses, mobile phone messaging reminders for attendance at healthcare appointments, mobile phone messaging to promote adherence to antiretroviral therapy, women carrying their own case notes in pregnancy, interventions to improve childhood vaccination. Quality and safety systems: decision support with clinical information systems for people living with HIV/AIDS. Complex interventions (cutting across delivery categories and other health system arrangements): emergency obstetric referral interventions.
AUTHORS' CONCLUSIONS: A wide range of strategies have been evaluated for improving delivery arrangements in low-income countries, using sound systematic review methods in both Cochrane and non-Cochrane reviews. These reviews have assessed a range of outcomes. Most of the available evidence focuses on who provides care, where care is provided and coordination of care. For all the main categories of delivery arrangements, we identified gaps in primary research related to uncertainty about the applicability of the evidence to low-income countries, low- or very low-certainty evidence or a lack of studies.
OBJECTIVES: This umbrella review aimed to identify the current evidence on health education-related interventions for patients with acute coronary syndrome (ACS) or type two diabetes mellitus (T2DM); identify the educational content, delivery methods, intensity, duration and setting required. The purpose was to provide recommendations for educational interventions for high-risk patients with both ACS and T2DM.
DESIGN: Umbrella review of systematic reviews and meta-analyses.
SETTING: Inpatient and postdischarge settings.
PARTICIPANTS: Patients with ACS and T2DM.
DATA SOURCES: CINAHL, Cochrane Library, Joanna Briggs Institute, Journals@Ovid, EMBase, Medline, PubMed and Web of Science databases from January 2000 through May 2016.
OUTCOMES MEASURES: Clinical outcomes (such as glycated haemoglobin), behavioural outcomes (such as smoking), psychosocial outcomes (such as anxiety) and medical service use.
RESULTS: Fifty-one eligible reviews (15 for ACS and 36 for T2DM) consisting of 1324 relevant studies involving 2 88 057 patients (15 papers did not provide the total sample); 30 (58.8%) reviews were rated as high quality. Nurses only and multidisciplinary teams were the most frequent professionals to provide education, and most educational interventions were delivered postdischarge. Face-to-face sessions were the most common delivery formats, and many education sessions were also delivered by telephone or via web contact. The frequency of educational sessions was weekly or monthly, and an average of 3.7 topics was covered per education session. Psychoeducational interventions were generally effective at reducing smoking and admissions for patients with ACS. Culturally appropriate health education, self-management educational interventions, group medical visits and psychoeducational interventions were generally effective for patients with T2DM.
CONCLUSIONS: Results indicate that there is a body of current evidence about the efficacy of health education, its content and delivery methods for patients with ACS or T2DM. These results provide recommendations about the content for, and approach to, health education intervention for these high-risk patients.
BACKGROUND: A key function of health systems is implementing interventions to improve health, but coverage of essential health interventions remains low in low-income countries. Implementing interventions can be challenging, particularly if it entails complex changes in clinical routines; in collaborative patterns among different healthcare providers and disciplines; in the behaviour of providers, patients or other stakeholders; or in the organisation of care. Decision-makers may use a range of strategies to implement health interventions, and these choices should be based on evidence of the strategies' effectiveness.
OBJECTIVES: To provide an overview of the available evidence from up-to-date systematic reviews about the effects of implementation strategies for health systems in low-income countries. Secondary objectives include identifying needs and priorities for future evaluations and systematic reviews on alternative implementation strategies and informing refinements of the framework for implementation strategies presented in the overview.
METHODS: We searched Health Systems Evidence in November 2010 and PDQ-Evidence up to December 2016 for systematic reviews. We did not apply any date, language or publication status limitations in the searches. We included well-conducted systematic reviews of studies that assessed the effects of implementation strategies on professional practice and patient outcomes and that were published after April 2005. We excluded reviews with limitations important enough to compromise the reliability of the review findings. Two overview authors independently screened reviews, extracted data and assessed the certainty of evidence using GRADE. We prepared SUPPORT Summaries for eligible reviews, including key messages, 'Summary of findings' tables (using GRADE to assess the certainty of the evidence) and assessments of the relevance of findings to low-income countries.
MAIN RESULTS: We identified 7272 systematic reviews and included 39 of them in this overview. An additional four reviews provided supplementary information. Of the 39 reviews, 32 had only minor limitations and 7 had important methodological limitations. Most studies in the reviews were from high-income countries. There were no studies from low-income countries in eight reviews.Implementation strategies addressed in the reviews were grouped into four categories – strategies targeting:1. healthcare organisations (e.g. strategies to change organisational culture; 1 review);2. healthcare workers by type of intervention (e.g. printed educational materials; 14 reviews);3. healthcare workers to address a specific problem (e.g. unnecessary antibiotic prescription; 9 reviews);4. healthcare recipients (e.g. medication adherence; 15 reviews).Overall, we found the following interventions to have desirable effects on at least one outcome with moderate- or high-certainty evidence and no moderate- or high-certainty evidence of undesirable effects.1.Strategies targeted at healthcare workers: educational meetings, nutrition training of health workers, educational outreach, practice facilitation, local opinion leaders, audit and feedback, and tailored interventions.2.Strategies targeted at healthcare workers for specific types of problems: training healthcare workers to be more patient-centred in clinical consultations, use of birth kits, strategies such as clinician education and patient education to reduce antibiotic prescribing in ambulatory care settings, and in-service neonatal emergency care training.3. Strategies targeted at healthcare recipients: mass media interventions to increase uptake of HIV testing; intensive self-management and adherence, intensive disease management programmes to improve health literacy; behavioural interventions and mobile phone text messages for adherence to antiretroviral therapy; a one time incentive to start or continue tuberculosis prophylaxis; default reminders for patients being treated for active tuberculosis; use of sectioned polythene bags for adherence to malaria medication; community-based health education, and reminders and recall strategies to increase vaccination uptake; interventions to increase uptake of cervical screening (invitations, education, counselling, access to health promotion nurse and intensive recruitment); health insurance information and application support.
AUTHORS' CONCLUSIONS: Reliable systematic reviews have evaluated a wide range of strategies for implementing evidence-based interventions in low-income countries. Most of the available evidence is focused on strategies targeted at healthcare workers and healthcare recipients and relates to process-based outcomes. Evidence of the effects of strategies targeting healthcare organisations is scarce.
An umbrella review providing a comprehensive synthesis of the interventions that are effective in providing routine immunisation outcomes for children in low and middle-income countries (L&MICs).
DESIGN:
A systematic review of systematic reviews, or an umbrella review.
DATA SOURCES:
We comprehensively searched 11 academic databases and 23 grey literature sources. The search was adopted from an evidence gap map on routine child immunisation sector in L&MICs, which was done on 5 May 2020. We updated the search in October 2021.
ELIGIBILITY CRITERIA:
We included systematic reviews assessing the effectiveness of any intervention on routine childhood immunisation outcomes in L&MICs.
DATA EXTRACTION AND SYNTHESIS:
Search results were screened by two reviewers independently applying predefined inclusion and exclusion criteria. Data were extracted by two researchers independently. The Specialist Unit for Review Evidence checklist was used to assess review quality. A mixed-methods synthesis was employed focusing on meta-analytical and narrative elements to accommodate both the quantitative and qualitative information available from the included reviews.
RESULTS:
62 systematic reviews are included in this umbrella review. We find caregiver-oriented interventions have large positive and statistically significant effects, especially those focusing on short-term sensitisation and education campaigns as well as written messages to caregivers. For health system-oriented interventions the evidence base is thin and derived from narrative synthesis suggesting positive effects for home visits, mixed effects for pay-for-performance schemes and inconclusive effects for contracting out services to non-governmental providers. For all other interventions under this category, the evidence is either limited or not available. For community-oriented interventions, a recent high-quality mixed-methods review suggests positive but small effects. Overall, the evidence base is highly heterogenous in terms of scope, intervention types and outcomes.
CONCLUSION:
Interventions oriented towards caregivers and communities are effective in improving routine child immunisation outcomes. The evidence base on health system-oriented interventions is scant not allowing us to reach firm conclusions, except for home visits. Large evidence gaps exist and need to be addressed. For example, more high-quality evidence is needed for specific caregiver-oriented interventions (eg, monetary incentives) as well as health system-oriented (eg, health workers and data systems) and community-oriented interventions. We also need to better understand complementarity of different intervention types.
