BACKGROUND: Reviews of qualitative studies allow for deeper understanding of concepts and findings beyond the single qualitative studies. Concerns on study reporting quality led to the publication of the COREQ-guidelines for qualitative studies in 2007, followed by the ENTREQ-guidelines for qualitative reviews in 2012. The aim of this meta-review is to: 1) investigate the uptake of the COREQ- and ENTREQ- checklists in qualitative reviews; and 2) compare the quality of reporting of the primary qualitative studies included within these reviews prior- and post COREQ-publication.
METHODS: Reviews were searched on 02-Sept-2020 and categorized as (1) COREQ- or (2) ENTREQ-using, (3) using both, or (4) non-COREQ/ENTREQ. Proportions of usage were calculated over time. COREQ-scores of the primary studies included in these reviews were compared prior- and post COREQ-publication using T-test with Bonferroni correction.
RESULTS: 1.695 qualitative reviews were included (222 COREQ, 369 ENTREQ, 62 both COREQ/ENTREQ and 1.042 non-COREQ/ENTREQ), spanning 12 years (2007-2019) demonstrating an exponential publication rate. The uptake of the ENTREQ in reviews is higher than the COREQ (respectively 28% and 17%), and increases over time. COREQ-scores could be extracted from 139 reviews (including 2.775 appraisals). Reporting quality improved following the COREQ-publication with 13 of the 32 signalling questions showing improvement; the average total score increased from 15.15 to 17.74 (p-value < 0.001).
CONCLUSION: The number of qualitative reviews increased exponentially, but the uptake of the COREQ and ENTREQ was modest overall. Primary qualitative studies show a positive trend in reporting quality, which may have been facilitated by the publication of the COREQ.
BACKGROUND: Antenatal care (ANC) and postnatal care (PNC) are critical opportunities for women, babies and parents/families to receive quality care and support from health services. Community-based interventions may improve the accessibility, availability, and acceptance of this vital care. For example, community mobilization strategies have been used to involve and collaborate with women, families and communities to improve maternal and newborn health.
OBJECTIVE: To synthesize existing reviews of evidence on community mobilization strategies that strengthen support for appropriate and timely use of ANC and PNC.
METHODS: Six databases (MEDLINE, Embase, CINAHL, PsychINFO, Cochrane Library, PROSPERO) were searched for published reviews that describe community mobilization related strategies for ANC and/or PNC. Reviews were eligible for inclusion if they described any initiatives or strategies targeting the promotion of ANC and/or PNC uptake that included an element of community mobilization in a low- or middle-income country (LMIC), published after 2000. Included reviews were critically appraised according to the Joanna Briggs Institute (JBI) Checklist for Systematic Reviews and Evidence Syntheses. This review of reviews was conducted following JBI guidelines for undertaking and reporting umbrella reviews.
RESULTS: In total 23 papers, representing 22 reviews were included. While all 22 reviews contained some description of community mobilization and ANC/PNC, 13 presented more in-depth details on the community mobilization processes and relevant outcomes. Seventeen reviews focused on ANC, four considered both ANC and PNC, and only one focused on PNC. Overall, 16 reviews reported at least one positive association between community mobilization activities and ANC/PNC uptake, while five reviews presented primary studies with no statistically significant change in ANC uptake and one included a primary study with a decrease in use of antenatal facilities. The community mobilization activities described by the reviews ranged from informative, passive communication to more active, participatory approaches that included engaging individuals or consulting local leaders and community members to develop priorities and action plans.
CONCLUSIONS: While there is considerable momentum around incorporating community mobilization activities in maternal and newborn health programs, such as improving community support for the uptake of ANC and PNC, there is limited evidence on the processes used. Furthermore, the spectrum of terminology and variation in definitions should be harmonized to guide the implementation and evaluation efforts.
Around 200 million people were affected by conflict and natural disasters in 2015. Whereas those populations are at a particular high risk of death, optimal breastfeeding and complementary feeding practices could prevent almost 20% of deaths amongst children less than 5 years old. Yet, coverage of interventions for improving infant and young child feeding (IYCF) practices in emergencies is low, partly due to lack of evidence. Considering the paucity of data generated in emergencies to inform programming, we conducted an evidence map from reviews that included low- and middle-income countries and looked at several interventions: (a) social and behavioural change interpersonal and mass communication for promoting breastfeeding and adequate complementary feeding; (b) provision of donated complementary food; (c) home-based fortification with multiple micronutrient powder; (d) capacity building; (e) cash transfers; (f) agricultural or fresh food supply interventions; and (g) psychological support to caretakers. We looked for availability of evidence of these interventions to improve IYCF practices and nutritional status of infants and young children. We identified 1,376 records and included 28 reviews meeting the inclusion criteria. The highest number of reviews identified was for behavioural change interpersonal communication for promoting breastfeeding, whereas no review was identified for psychological support to caretakers. We conclude that any further research should focus on the mechanisms and delivery models through which effectiveness of interventions can be achieved and on the influence of contextual factors. Efforts should be renewed to generate evidence of effectiveness of IYCF interventions during humanitarian emergencies despite the challenges.
BACKGROUND: Delivery arrangements include changes in who receives care and when, who provides care, the working conditions of those who provide care, coordination of care amongst different providers, where care is provided, the use of information and communication technology to deliver care, and quality and safety systems. How services are delivered can have impacts on the effectiveness, efficiency and equity of health systems. This broad overview of the findings of systematic reviews can help policymakers and other stakeholders identify strategies for addressing problems and improve the delivery of services.
OBJECTIVES: To provide an overview of the available evidence from up-to-date systematic reviews about the effects of delivery arrangements for health systems in low-income countries. Secondary objectives include identifying needs and priorities for future evaluations and systematic reviews on delivery arrangements and informing refinements of the framework for delivery arrangements outlined in the review.
METHODS: We searched Health Systems Evidence in November 2010 and PDQ-Evidence up to 17 December 2016 for systematic reviews. We did not apply any date, language or publication status limitations in the searches. We included well-conducted systematic reviews of studies that assessed the effects of delivery arrangements on patient outcomes (health and health behaviours), the quality or utilisation of healthcare services, resource use, healthcare provider outcomes (such as sick leave), or social outcomes (such as poverty or employment) and that were published after April 2005. We excluded reviews with limitations important enough to compromise the reliability of the findings. Two overview authors independently screened reviews, extracted data, and assessed the certainty of evidence using GRADE. We prepared SUPPORT Summaries for eligible reviews, including key messages, 'Summary of findings' tables (using GRADE to assess the certainty of the evidence), and assessments of the relevance of findings to low-income countries.
MAIN RESULTS: We identified 7272 systematic reviews and included 51 of them in this overview. We judged 6 of the 51 reviews to have important methodological limitations and the other 45 to have only minor limitations. We grouped delivery arrangements into eight categories. Some reviews provided more than one comparison and were in more than one category. Across these categories, the following intervention were effective; that is, they have desirable effects on at least one outcome with moderate- or high-certainty evidence and no moderate- or high-certainty evidence of undesirable effects. Who receives care and when: queuing strategies and antenatal care to groups of mothers. Who provides care: lay health workers for caring for people with hypertension, lay health workers to deliver care for mothers and children or infectious diseases, lay health workers to deliver community-based neonatal care packages, midlevel health professionals for abortion care, social support to pregnant women at risk, midwife-led care for childbearing women, non-specialist providers in mental health and neurology, and physician-nurse substitution. Coordination of care: hospital clinical pathways, case management for people living with HIV and AIDS, interactive communication between primary care doctors and specialists, hospital discharge planning, adding a service to an existing service and integrating delivery models, referral from primary to secondary care, physician-led versus nurse-led triage in emergency departments, and team midwifery. Where care is provided: high-volume institutions, home-based care (with or without multidisciplinary team) for people living with HIV and AIDS, home-based management of malaria, home care for children with acute physical conditions, community-based interventions for childhood diarrhoea and pneumonia, out-of-facility HIV and reproductive health services for youth, and decentralised HIV care. Information and communication technology: mobile phone messaging for patients with long-term illnesses, mobile phone messaging reminders for attendance at healthcare appointments, mobile phone messaging to promote adherence to antiretroviral therapy, women carrying their own case notes in pregnancy, interventions to improve childhood vaccination. Quality and safety systems: decision support with clinical information systems for people living with HIV/AIDS. Complex interventions (cutting across delivery categories and other health system arrangements): emergency obstetric referral interventions.
AUTHORS' CONCLUSIONS: A wide range of strategies have been evaluated for improving delivery arrangements in low-income countries, using sound systematic review methods in both Cochrane and non-Cochrane reviews. These reviews have assessed a range of outcomes. Most of the available evidence focuses on who provides care, where care is provided and coordination of care. For all the main categories of delivery arrangements, we identified gaps in primary research related to uncertainty about the applicability of the evidence to low-income countries, low- or very low-certainty evidence or a lack of studies.
BACKGROUND: A key function of health systems is implementing interventions to improve health, but coverage of essential health interventions remains low in low-income countries. Implementing interventions can be challenging, particularly if it entails complex changes in clinical routines; in collaborative patterns among different healthcare providers and disciplines; in the behaviour of providers, patients or other stakeholders; or in the organisation of care. Decision-makers may use a range of strategies to implement health interventions, and these choices should be based on evidence of the strategies' effectiveness.
OBJECTIVES: To provide an overview of the available evidence from up-to-date systematic reviews about the effects of implementation strategies for health systems in low-income countries. Secondary objectives include identifying needs and priorities for future evaluations and systematic reviews on alternative implementation strategies and informing refinements of the framework for implementation strategies presented in the overview.
METHODS: We searched Health Systems Evidence in November 2010 and PDQ-Evidence up to December 2016 for systematic reviews. We did not apply any date, language or publication status limitations in the searches. We included well-conducted systematic reviews of studies that assessed the effects of implementation strategies on professional practice and patient outcomes and that were published after April 2005. We excluded reviews with limitations important enough to compromise the reliability of the review findings. Two overview authors independently screened reviews, extracted data and assessed the certainty of evidence using GRADE. We prepared SUPPORT Summaries for eligible reviews, including key messages, 'Summary of findings' tables (using GRADE to assess the certainty of the evidence) and assessments of the relevance of findings to low-income countries.
MAIN RESULTS: We identified 7272 systematic reviews and included 39 of them in this overview. An additional four reviews provided supplementary information. Of the 39 reviews, 32 had only minor limitations and 7 had important methodological limitations. Most studies in the reviews were from high-income countries. There were no studies from low-income countries in eight reviews.Implementation strategies addressed in the reviews were grouped into four categories – strategies targeting:1. healthcare organisations (e.g. strategies to change organisational culture; 1 review);2. healthcare workers by type of intervention (e.g. printed educational materials; 14 reviews);3. healthcare workers to address a specific problem (e.g. unnecessary antibiotic prescription; 9 reviews);4. healthcare recipients (e.g. medication adherence; 15 reviews).Overall, we found the following interventions to have desirable effects on at least one outcome with moderate- or high-certainty evidence and no moderate- or high-certainty evidence of undesirable effects.1.Strategies targeted at healthcare workers: educational meetings, nutrition training of health workers, educational outreach, practice facilitation, local opinion leaders, audit and feedback, and tailored interventions.2.Strategies targeted at healthcare workers for specific types of problems: training healthcare workers to be more patient-centred in clinical consultations, use of birth kits, strategies such as clinician education and patient education to reduce antibiotic prescribing in ambulatory care settings, and in-service neonatal emergency care training.3. Strategies targeted at healthcare recipients: mass media interventions to increase uptake of HIV testing; intensive self-management and adherence, intensive disease management programmes to improve health literacy; behavioural interventions and mobile phone text messages for adherence to antiretroviral therapy; a one time incentive to start or continue tuberculosis prophylaxis; default reminders for patients being treated for active tuberculosis; use of sectioned polythene bags for adherence to malaria medication; community-based health education, and reminders and recall strategies to increase vaccination uptake; interventions to increase uptake of cervical screening (invitations, education, counselling, access to health promotion nurse and intensive recruitment); health insurance information and application support.
AUTHORS' CONCLUSIONS: Reliable systematic reviews have evaluated a wide range of strategies for implementing evidence-based interventions in low-income countries. Most of the available evidence is focused on strategies targeted at healthcare workers and healthcare recipients and relates to process-based outcomes. Evidence of the effects of strategies targeting healthcare organisations is scarce.
BACKGROUND: One target of the Sustainable Development Goals is to achieve "universal health coverage, including financial risk protection, access to quality essential health-care services and access to safe, effective, quality and affordable essential medicines and vaccines for all". A fundamental concern of governments in striving for this goal is how to finance such a health system. This concern is very relevant for low-income countries.
OBJECTIVES: To provide an overview of the evidence from up-to-date systematic reviews about the effects of financial arrangements for health systems in low-income countries. Secondary objectives include identifying needs and priorities for future evaluations and systematic reviews on financial arrangements, and informing refinements in the framework for financial arrangements presented in the overview.
METHODS: We searched Health Systems Evidence in November 2010 and PDQ-Evidence up to 17 December 2016 for systematic reviews. We did not apply any date, language, or publication status limitations in the searches. We included well-conducted systematic reviews of studies that assessed the effects of financial arrangements on patient outcomes (health and health behaviours), the quality or utilisation of healthcare services, resource use, healthcare provider outcomes (such as sick leave), or social outcomes (such as poverty, employment, or financial burden of patients, e.g. out-of-pocket payment, catastrophic disease expenditure) and that were published after April 2005. We excluded reviews with limitations important enough to compromise the reliability of the findings. Two overview authors independently screened reviews, extracted data, and assessed the certainty of evidence using GRADE. We prepared SUPPORT Summaries for eligible reviews, including key messages, 'Summary of findings' tables (using GRADE to assess the certainty of the evidence), and assessments of the relevance of findings to low-income countries.
MAIN RESULTS: We identified 7272 reviews and included 15 in this overview, on: collection of funds (2 reviews), insurance schemes (1 review), purchasing of services (1 review), recipient incentives (6 reviews), and provider incentives (5 reviews). The reviews were published between 2008 and 2015; focused on 13 subcategories; and reported results from 276 studies: 115 (42%) randomised trials, 11 (4%) non-randomised trials, 23 (8%) controlled before-after studies, 51 (19%) interrupted time series, 9 (3%) repeated measures, and 67 (24%) other non-randomised studies. Forty-three per cent (119/276) of the studies included in the reviews took place in low- and middle-income countries. Collection of funds: the effects of changes in user fees on utilisation and equity are uncertain (very low-certainty evidence). It is also uncertain whether aid delivered under the Paris Principles (ownership, alignment, harmonisation, managing for results, and mutual accountability) improves health outcomes compared to aid delivered without conforming to those principles (very low-certainty evidence). Insurance schemes: community-based health insurance may increase service utilisation (low-certainty evidence), but the effects on health outcomes are uncertain (very low-certainty evidence). It is uncertain whether social health insurance improves utilisation of health services or health outcomes (very low-certainty evidence). Purchasing of services: it is uncertain whether increasing salaries of public sector healthcare workers improves the quantity or quality of their work (very low-certainty evidence). Recipient incentives: recipient incentives may improve adherence to long-term treatments (low-certainty evidence), but it is uncertain whether they improve patient outcomes. One-time recipient incentives probably improve patient return for start or continuation of treatment (moderate-certainty evidence) and may improve return for tuberculosis test readings (low-certainty evidence). However, incentives may not improve completion of tuberculosis prophylaxis, and it is uncertain whether they improve completion of treatment for active tuberculosis. Conditional cash transfer programmes probably lead to an increase in service utilisation (moderate-certainty evidence), but their effects on health outcomes are uncertain. Vouchers may improve health service utilisation (low-certainty evidence), but the effects on health outcomes are uncertain (very low-certainty evidence). Introducing a restrictive cap may decrease use of medicines for symptomatic conditions and overall use of medicines, may decrease insurers' expenditures on medicines (low-certainty evidence), and has uncertain effects on emergency department use, hospitalisations, and use of outpatient care (very low-certainty evidence). Reference pricing, maximum pricing, and index pricing for drugs have mixed effects on drug expenditures by patients and insurers as well as the use of brand and generic drugs. Provider incentives: the effects of provider incentives are uncertain (very low-certainty evidence), including: the effects of provider incentives on the quality of care provided by primary care physicians or outpatient referrals from primary to secondary care, incentives for recruiting and retaining health professionals to serve in remote areas, and the effects of pay-for-performance on provider performance, the utilisation of services, patient outcomes, or resource use in low-income countries.
AUTHORS' CONCLUSIONS: Research based on sound systematic review methods has evaluated numerous financial arrangements relevant to low-income countries, targeting different levels of the health systems and assessing diverse outcomes. However, included reviews rarely reported social outcomes, resource use, equity impacts, or undesirable effects. We also identified gaps in primary research because of uncertainty about applicability of the evidence to low-income countries. Financial arrangements for which the effects are uncertain include external funding (aid), caps and co-payments, pay-for-performance, and provider incentives. Further studies evaluating the effects of these arrangements are needed in low-income countries. Systematic reviews should include all outcomes that are relevant to decision-makers and to people affected by changes in financial arrangements.
BACKGROUND: There is growing recognition of the importance of the active involvement of consumers and community members in health care. Despite the long history of consumer and community engagement (CCE) research and practice, there is no consensus on the best strategies for CCE. In this paper, we identify various dimensions of CCE-related strategies and offer a practical model to assist policy-makers, practitioners and researchers.
METHODS: We undertook a large-scale, scoping meta-review and searched six databases using a list of nine medical subject headings (MeSH) and a comprehensive list of 47 phrases. We identified and examined a total of 90 relevant systematic reviews.
RESULTS: Identified reviews show that although there is a significant body of research on CCE, the development of the field is hindered by a lack of evidence relating to specific elements of CCE. They also indicate a diverse and growing enterprise, drawing on a wide range of disciplinary, political and philosophical perspectives and a mix of definitions, targets, approaches, strategies and mechanisms. CCE interventions and strategies aim to involve consumers, community members and the public in general, as well as specific sub-groups, including children and people from culturally and linguistically diverse backgrounds. Strategies for CCE vary in terms of their aim and type of proposed activity, as do the methods and tools which have been developed to support them. Methods and tools include shared decision making, use of decision aids, consumer representation, application of electronic and internet-based facilities, and peer support. The success of CCE is dependent on both the approach taken and contextual factors, including structural facilitators such as governmental support, as well as barriers such as costs, organisational culture and population-specific limitations.
CONCLUSIONS: The diversity of the field indicates the need to measure each component of CCE. This meta-review provides the basis for development of a new eight stage model of consumer and community engagement. This model emphasises the importance of clarity and focus, as well as an extensive evaluation of contextual factors within specific settings, before the implementation of CCE strategies, enabling those involved in CCE to determine potential facilitators and barriers to the process.
Evidence-based behavior change interventions addressing health systems must be identified and disseminated to improve child health outcomes. Studies of the efficacy of such interventions were identified from systematic searches of the published literature. Two hundred twenty-nine of the initially identified references were judged to be relevant and were further reviewed for the quality and strength of the evidence. Studies were eligible if an intervention addressed policy or health systems interventions, measured relevant behavioral or health outcomes (e.g., nutrition, childhood immunization, malaria prevention and treatment), used at least a moderate quality research design, and were implemented in low- or middle-income countries. Policy or systems interventions able to produce behavior change reviewed included media (e.g., mass media, social media), community mobilization, educational programs (for caregivers, communities, or providers), social marketing, opinion leadership, economic incentives (for both caregiver and provider), health systems strengthening/policy/legislation, and others. Recommendations for policy, practice, and research are given based on fairly strong data across the areas of health service delivery, health workforce, health financing, governance and leadership, and research.
BACKGROUND: Low-cost mobile devices, such as mobile phones, tablets, and personal digital assistants, which can access voice and data services, have revolutionised access to information and communication technology worldwide. These devices have a major impact on many aspects of people's lives, from business and education to health. This paper reviews the current evidence on the specific impacts of mobile technologies on tangible health outcomes (mHealth) in low- and middle-income countries (LMICs), from the perspectives of various stakeholders.
DESIGN: Comprehensive literature searches were undertaken using key medical subject heading search terms on PubMed, Google Scholar, and grey literature sources. Analysis of 676 publications retrieved from the search was undertaken based on key inclusion criteria, resulting in a set of 76 papers for detailed review. The impacts of mHealth interventions reported in these papers were categorised into common mHealth applications.
RESULTS: There is a growing evidence base for the efficacy of mHealth interventions in LMICs, particularly in improving treatment adherence, appointment compliance, data gathering, and developing support networks for health workers. However, the quantity and quality of the evidence is still limited in many respects.
CONCLUSIONS: Over all application areas, there remains a need to take small pilot studies to full scale, enabling more rigorous experimental and quasi-experimental studies to be undertaken in order to strengthen the evidence base.
BACKGROUND: The impact of unmet eye care needs in sub-Saharan Africa is compounded by barriers to accessing eye care, limited engagement with communities, a shortage of appropriately skilled health personnel, and inadequate support from health systems. The renewed focus on primary health care has led to support for greater integration of eye health into national health systems. The aim of this paper is to demonstrate available evidence of integration of eye health into primary health care in sub-Saharan Africa from a health systems strengthening perspective.
METHODS: A scoping review method was used to gather and assess information from published literature, reviews, WHO policy documents and examples of eye and health care interventions in sub-Saharan Africa. Findings were compiled using a health systems strengthening framework.
RESULTS: Limited information is available about eye health from a health systems strengthening approach. Particular components of the health systems framework lacking evidence are service delivery, equipment and supplies, financing, leadership and governance. There is some information to support interventions to strengthen human resources at all levels, partnerships and community participation; but little evidence showing their successful application to improve quality of care and access to comprehensive eye health services at the primary health level, and referral to other levels for specialist eye care.
CONCLUSION: Evidence of integration of eye health into primary health care is currently weak, particularly when applying a health systems framework. A realignment of eye health in the primary health care agenda will require context specific planning and a holistic approach, with careful attention to each of the health system components and to the public health system as a whole. Documentation and evaluation of existing projects are required, as are pilot projects of systematic approaches to interventions and application of best practices. Multi-national research may provide guidance about how to scale up eye health interventions that are integrated into primary health systems.
Reviews of qualitative studies allow for deeper understanding of concepts and findings beyond the single qualitative studies. Concerns on study reporting quality led to the publication of the COREQ-guidelines for qualitative studies in 2007, followed by the ENTREQ-guidelines for qualitative reviews in 2012. The aim of this meta-review is to: 1) investigate the uptake of the COREQ- and ENTREQ- checklists in qualitative reviews; and 2) compare the quality of reporting of the primary qualitative studies included within these reviews prior- and post COREQ-publication.
METHODS:
Reviews were searched on 02-Sept-2020 and categorized as (1) COREQ- or (2) ENTREQ-using, (3) using both, or (4) non-COREQ/ENTREQ. Proportions of usage were calculated over time. COREQ-scores of the primary studies included in these reviews were compared prior- and post COREQ-publication using T-test with Bonferroni correction.
RESULTS:
1.695 qualitative reviews were included (222 COREQ, 369 ENTREQ, 62 both COREQ/ENTREQ and 1.042 non-COREQ/ENTREQ), spanning 12 years (2007-2019) demonstrating an exponential publication rate. The uptake of the ENTREQ in reviews is higher than the COREQ (respectively 28% and 17%), and increases over time. COREQ-scores could be extracted from 139 reviews (including 2.775 appraisals). Reporting quality improved following the COREQ-publication with 13 of the 32 signalling questions showing improvement; the average total score increased from 15.15 to 17.74 (p-value < 0.001).
CONCLUSION:
The number of qualitative reviews increased exponentially, but the uptake of the COREQ and ENTREQ was modest overall. Primary qualitative studies show a positive trend in reporting quality, which may have been facilitated by the publication of the COREQ.
