Pay-for-performance (P4P) has been widely used around the world seeking to improve health outcomes, and in Brazil it is the basis of the National Program for Improving Access and Quality (PMAQ). The literature published between 1998 and January 2013 that evaluated the effectiveness of P4P to produce results or patterns of access and quality in health was scrutinized. A total of 138 studies, with the inclusion of a further 41 studies (14 systematic reviews, 07 clinical trials and 20 observational studies) were retrieved and analyzed Among the more rigorous studies, favorable conclusions for P4P were less frequent, whereas observational studies were more favorable to positive effects of P4P on the quality of, and access to, health services. Methodological limitations of observational studies may have contributed to these results, but the range of results is more linked to the conceptual and contextual aspects of the use of the P4P schemes reviewed, the heterogeneity of P4P models and results. P4P can be helpful in promoting the achievement of objectives in health care systems, especially in the short term and for specific actions requiring less effort of health care providers, but should be used with caution and with a rigorous planning model, also considering undesirable or adverse effects.
BACKGROUND: Many systematic reviews exist on interventions to improve safe and effective medicines use by consumers, but research is distributed across diseases, populations and settings. The scope and focus of such reviews also vary widely, creating challenges for decision-makers seeking to inform decisions by using the evidence on consumers’ medicines use.
This is an update of a 2011 overview of systematic reviews, which synthesises the evidence, irrespective of disease, medicine type, population or setting, on the effectiveness of interventions to improve consumers' medicines use.
OBJECTIVES: To assess the effects of interventions which target healthcare consumers to promote safe and effective medicines use, by synthesising review-level evidence.
SEARCH METHODS: We included systematic reviews published on the Cochrane Database of Systematic Reviews and the Database of Abstracts of Reviews of Effects. We identified relevant reviews by handsearching databases from their start dates to March 2012.
SELECTION CRITERIA: We screened and ranked reviews based on relevance to consumers’ medicines use, using criteria developed for this overview.
DATA COLLECTION AND ANALYSIS: We used standardised forms to extract data, and assessed reviews for methodological quality using the AMSTAR tool. We used standardised language to summarise results within and across reviews; and gave bottom-line statements about intervention effectiveness. Two review authors screened and selected reviews, and extracted and analysed data. We used a taxonomy of interventions to categorise reviews and guide syntheses.
MAIN RESULTS: We included 75 systematic reviews of varied methodological quality. Reviews assessed interventions with diverse aims including support for behaviour change, risk minimisation and skills acquisition. No reviews aimed to promote systems-level consumer participation in medicines-related activities. Medicines adherence was the most frequently-reported outcome, but others such as knowledge, clinical and service-use outcomes were also reported. Adverse events were less commonly identified, while those associated with the interventions themselves, or costs, were rarely reported.
Looking across reviews, for most outcomes, medicines self-monitoring and self-management programmes appear generally effective to improve medicines use, adherence, adverse events and clinical outcomes; and to reduce mortality in people self-managing antithrombotic therapy. However, some participants were unable to complete these interventions, suggesting they may not be suitable for everyone.
Other promising interventions to improve adherence and other key medicines-use outcomes, which require further investigation to be more certain of their effects, include:
· simplified dosing regimens: with positive effects on adherence;
· interventions involving pharmacists in medicines management, such as medicines reviews (with positive effects on adherence and use, medicines problems and clinical outcomes) and pharmaceutical care services (consultation between pharmacist and patient to resolve medicines problems, develop a care plan and provide follow-up; with positive effects on adherence and knowledge).
Several other strategies showed some positive effects, particularly relating to adherence, and other outcomes, but their effects were less consistent overall and so need further study. These included:
· delayed antibiotic prescriptions: effective to decrease antibiotic use but with mixed effects on clinical outcomes, adverse effects and satisfaction;
· practical strategies like reminders, cues and/or organisers, reminder packaging and material incentives: with positive, although somewhat mixed effects on adherence;
· education delivered with self-management skills training, counselling, support, training or enhanced follow-up; information and counselling delivered together; or education/information as part of pharmacist-delivered packages of care: with positive effects on adherence, medicines use, clinical outcomes and knowledge, but with mixed effects in some studies;
· financial incentives: with positive, but mixed, effects on adherence.
Several strategies also showed promise in promoting immunisation uptake, but require further study to be more certain of their effects. These included organisational interventions; reminders and recall; financial incentives; home visits; free vaccination; lay health worker interventions; and facilitators working with physicians to promote immunisation uptake. Education and/or information strategies also showed some positive but even less consistent effects on immunisation uptake, and need further assessment of effectiveness and investigation of heterogeneity.
There are many different potential pathways through which consumers' use of medicines could be targeted to improve outcomes, and simple interventions may be as effective as complex strategies. However, no single intervention assessed was effective to improve all medicines-use outcomes across all diseases, medicines, populations or settings.
Even where interventions showed promise, the assembled evidence often only provided part of the picture: for example, simplified dosing regimens seem effective for improving adherence, but there is not yet sufficient information to identify an optimal regimen.
In some instances interventions appear ineffective: for example, the evidence suggests that directly observed therapy may be generally ineffective for improving treatment completion, adherence or clinical outcomes.
In other cases, interventions may have variable effects across outcomes. As an example, strategies providing information or education as single interventions appear ineffective to improve medicines adherence or clinical outcomes, but may be effective to improve knowledge; an important outcome for promoting consumers' informed medicines choices.
Despite a doubling in the number of reviews included in this updated overview, uncertainty still exists about the effectiveness of many interventions, and the evidence on what works remains sparse for several populations, including children and young people, carers, and people with multimorbidity.
AUTHORS' CONCLUSIONS: This overview presents evidence from 75 reviews that have synthesised trials and other studies evaluating the effects of interventions to improve consumers' medicines use.
Systematically assembling the evidence across reviews allows identification of effective or promising interventions to improve consumers’ medicines use, as well as those for which the evidence indicates ineffectiveness or uncertainty.
Decision makers faced with implementing interventions to improve consumers' medicines use can use this overview to inform decisions about which interventions may be most promising to improve particular outcomes. The intervention taxonomy may also assist people to consider the strategies available in relation to specific purposes, for example, gaining skills or being involved in decision making. Researchers and funders can use this overview to identify where more research is needed and assess its priority. The limitations of the available literature due to the lack of evidence for important outcomes and important populations, such as people with multimorbidity, should also be considered in practice and policy decisions.
CONTEXT: Screening reduces mortality from breast, cervical, and colorectal cancers. The Guide to Community Preventive Services previously conducted systematic reviews on the effectiveness of 11 interventions to increase screening for these cancers. This article presents results of updated systematic reviews for nine of these interventions.
EVIDENCE ACQUISITION: Five databases were searched for studies published during January 2004-October 2008. Studies had to (1) be a primary investigation of one or more intervention category; (2) be conducted in a country with a high-income economy; (3) provide information on at least one cancer screening outcome of interest; and (4) include screening use prior to intervention implementation or a concurrent group unexposed to the intervention category of interest. Forty-five studies were included in the reviews.
EVIDENCE SYNTHESIS: Recommendations were added for one-on-one education to increase screening with fecal occult blood testing (FOBT) and group education to increase mammography screening. Strength of evidence for client reminder interventions to increase FOBT screening was upgraded from sufficient to strong. Previous findings and recommendations for reducing out-of-pocket costs (breast cancer screening); provider assessment and feedback (breast, cervical, and FOBT screening); one-on-one education and client reminders (breast and cervical cancer screening); and reducing structural barriers (breast cancer and FOBT screening) were reaffirmed or unchanged. Evidence remains insufficient to determine effectiveness for the remaining screening tests and intervention categories.
CONCLUSIONS: Findings indicate new and reaffirmed interventions effective in promoting recommended cancer screening, including colorectal cancer screening. Findings can be used in community and healthcare settings to promote recommended care. Important research gaps also are described.
KEY MESSAGES: - There is now extensive evidence demonstrating that there is a gap between the health care that patients receive and the practice that is recommended. In both primary and secondary care there are unwarranted variations in practice and in resulting outcomes that cannot be explained by the characteristics of patients.
- While it is difficult to find examples of measures for addressing this issue from all 53 countries of the World Health Organization’s European Region, there are interventions that can be identified in the 27 Member States of the European Union. However, the nature of these measures and the extent to which they are implemented vary considerably.
- Audit and feedback defined as “any summary of clinical performance of health care over a specified period of time aimed at providing information to health professionals to allow them to assess and adjust their performance” is an overarching term used to describe some of the measures that are used to improve professional practice.
- Audit and feedback can be used in all health care settings, involving all health professionals, either as individual professions or in multiprofessional teams.
- In practical terms, health professionals can receive feedback on their performance based on data derived from their routine practice. Health professionals involved in audit and feedback may work either in a team or individually and in primary, secondary or tertiary care.
- While it seems intuitive that health care professionals would be prompted to modify their clinical practice if receiving feedback that it was inconsistent with that of their peers or accepted guidelines, this is in fact not always the case.
- The available evidence suggests that audit and feedback may be effective in improving professional practice but that the effects are generally small to moderate. Nonetheless, depending on the context, such small effects, particularly if shown to be cost-effective, may still be regarded as worthwhile.
- The benefits of audit and feedback measures are most likely to occur where existing practice is furthest away from what is desired, and when feedback is more intensive.
- Even on the basis of the best evidence available, no strong recommendations can be given regarding the best way to introduce audit and feedback into routine practice. However, decisions about if, and how, this approach can Policy summary be used to improve professional practice must be guided by pragmatism and the consideration of local circumstances. The following scenarios, for example, might indicate suitability for such an approach: the known (or anticipated) level of initial adherence to guidelines or desired practice is low; it is feasible to conduct an audit and the associated costs of collecting the data are low; routinely collected data are reliable and appropriate for use in an audit; and small to moderate improvements in quality would be worthwhile.
- The cost of audit and feedback is highly variable and is determined by local conditions, including the availability of reliable routinely collected data and personnel costs.
- The impact of audit and feedback, with or without additional interventions, should be monitored routinely by auditing practice after the intervention.
BACKGROUND: Policy makers face challenges to ensure an appropriate supply and distribution of trained health workers and to manage their performance in delivery of services, especially in countries with low and middle incomes. We aimed to identify all available policy options to address human resources for health in such countries, and to assess the effectiveness of these policy options. METHODS: We searched Medline and Embase from 1979 to September, 2006, the Cochrane Library, and the Human Resources for Health Global Resource Center database. We also searched up to 10 years of archives from five relevant journals, and consulted experts. We included systematic reviews in English which assessed the effects of policy options that could affect the training, distribution, regulation, financing, management, organisation, or performance of health workers. Two reviewers independently assessed each review for eligibility and quality, and systematically extracted data about main effects. We also assessed whether the policy options were equitable in their effects; suitable for scaling up; and applicable to countries with low and middle incomes. FINDINGS: 28 of the 759 systematic reviews of effects that we identified were eligible according to our criteria. Of these, only a few included studies from countries with low and middle incomes, and some reviews were of low quality. Most evidence focused on organisational mechanisms for human resources, such as substitution or shifting tasks between different types of health workers, or extension of their roles; performance-enhancing strategies such as quality improvement or continuing education strategies; promotion of teamwork; and changes to workflow. Of all policy options, the use of lay health workers had the greatest proportion of reviews in countries with a range of incomes, from high to low. INTERPRETATION: We have identified a need for more systematic reviews on the effects of policy options to improve human resources for health in countries with low and middle incomes, for assessments of any interventions that policy makers introduce to plan and manage human resources for health, and for other research to aid policy makers in these countries.
OBJECTIVES: An evidence report was prepared to assess the evidence base regarding benefits and costs of health information technology (HIT) systems, that is, the value of discrete HIT functions and systems in various healthcare settings, particularly those providing pediatric care.
DATA SOURCES: PubMed, the Cochrane Controlled Clinical Trials Register, and the Cochrane Database of Reviews of Effectiveness (DARE) were electronically searched for articles published since 1995. Several reports prepared by private industry were also reviewed.
REVIEW METHODS: Of 855 studies screened, 256 were included in the final analyses. These included systematic reviews, meta-analyses, studies that tested a hypothesis, and predictive analyses. Each article was reviewed independently by two reviewers; disagreement was resolved by consensus.
RESULTS: Of the 256 studies, 156 concerned decision support, 84 assessed the electronic medical record, and 30 were about computerized physician order entry (categories are not mutually exclusive). One hundred twenty four of the studies assessed the effect of the HIT system in the outpatient or ambulatory setting; 82 assessed its use in the hospital or inpatient setting. Ninety-seven studies used a randomized design. There were 11 other controlled clinical trials, 33 studies using a pre-post design, and 20 studies using a time series. Another 17 were case studies with a concurrent control. Of the 211 hypothesis-testing studies, 82 contained at least some cost data. We identified no study or collection of studies, outside of those from a handful of HIT leaders, that would allow a reader to make a determination about the generalizable knowledge of the study's reported benefit. Beside these studies from HIT leaders, no other research assessed HIT systems that had comprehensive functionality and included data on costs, relevant information on organizational context and process change, and data on implementation. A small body of literature supports a role for HIT in improving the quality of pediatric care. Insufficient data were available on the costs or cost-effectiveness of implementing such systems. The ability of Electronic Health Records (EHRs) to improve the quality of care in ambulatory care settings was demonstrated in a small series of studies conducted at four sites (three U.S. medical centers and one in the Netherlands). The studies demonstrated improvements in provider performance when clinical information management and decision support tools were made available within an EHR system, particularly when the EHRs had the capacity to store data with high fidelity, to make those data readily accessible, and to help translate them into context-specific information that can empower providers in their work. Despite the heterogeneity in the analytic methods used, all cost-benefit analyses predicted substantial savings from EHR (and health care information exchange and interoperability) implementation: The quantifiable benefits are projected to outweigh the investment costs. However, the predicted time needed to break even varied from three to as many as 13 years.
CONCLUSIONS: HIT has the potential to enable a dramatic transformation in the delivery of health care, making it safer, more effective, and more efficient. Some organizations have already realized major gains through the implementation of multifunctional, interoperable HIT systems built around an EHR. However, widespread implementation of HIT has been limited by a lack of generalizable knowledge about what types of HIT and implementation methods will improve care and manage costs for specific health organizations. The reporting of HIT development and implementation requires fuller descriptions of both the intervention and the organizational/economic environment in which it is implemented.
BACKGROUND: Changing the organization of patient care should contribute to improved patient outcomes as functioning of clinical teams and organizational structures are important enablers for improvement. OBJECTIVE: To provide an overview of the research evidence on effects of organizational strategies to implement improvements in patient care. DESIGN: Structured review of published reviews of rigorous evaluations. DATA SOURCES: Published reviews of studies on organizational interventions. REVIEW METHODS: Searches were conducted in two data-bases (Pubmed, Cochrane Library) and in selected journals. Reviews were included, if these were based on a systematic search, focused on rigorous evaluations of organizational changes, and were published between 1995 and 2003. Two investigators independently extracted information from the reviews regarding their clinical focus, methodological quality and main quantitative findings. RESULTS: A total of 36 reviews were included, but not all were high-quality reviews. The reviews were too heterogeneous for quantitative synthesis. None of the strategies produced consistent effects. Professional performance was generally improved by revision of professional roles and computer systems for knowledge management. Patient outcomes was generally improved by multidisciplinary teams, integrated care services, and computer systems. Cost savings were reported from integrated care services. The benefits of quality management remained uncertain. CONCLUSION: There is a growing evidence base of rigorous evaluations of organizational strategies, but the evidence underlying some strategies is limited and for no strategy can the effects be predicted with high certainty.
Pay-for-performance (P4P) has been widely used around the world seeking to improve health outcomes, and in Brazil it is the basis of the National Program for Improving Access and Quality (PMAQ). The literature published between 1998 and January 2013 that evaluated the effectiveness of P4P to produce results or patterns of access and quality in health was scrutinized. A total of 138 studies, with the inclusion of a further 41 studies (14 systematic reviews, 07 clinical trials and 20 observational studies) were retrieved and analyzed Among the more rigorous studies, favorable conclusions for P4P were less frequent, whereas observational studies were more favorable to positive effects of P4P on the quality of, and access to, health services. Methodological limitations of observational studies may have contributed to these results, but the range of results is more linked to the conceptual and contextual aspects of the use of the P4P schemes reviewed, the heterogeneity of P4P models and results. P4P can be helpful in promoting the achievement of objectives in health care systems, especially in the short term and for specific actions requiring less effort of health care providers, but should be used with caution and with a rigorous planning model, also considering undesirable or adverse effects.
