Pay-for-performance (P4P) has been widely used around the world seeking to improve health outcomes, and in Brazil it is the basis of the National Program for Improving Access and Quality (PMAQ). The literature published between 1998 and January 2013 that evaluated the effectiveness of P4P to produce results or patterns of access and quality in health was scrutinized. A total of 138 studies, with the inclusion of a further 41 studies (14 systematic reviews, 07 clinical trials and 20 observational studies) were retrieved and analyzed Among the more rigorous studies, favorable conclusions for P4P were less frequent, whereas observational studies were more favorable to positive effects of P4P on the quality of, and access to, health services. Methodological limitations of observational studies may have contributed to these results, but the range of results is more linked to the conceptual and contextual aspects of the use of the P4P schemes reviewed, the heterogeneity of P4P models and results. P4P can be helpful in promoting the achievement of objectives in health care systems, especially in the short term and for specific actions requiring less effort of health care providers, but should be used with caution and with a rigorous planning model, also considering undesirable or adverse effects.
BACKGROUND: Many systematic reviews exist on interventions to improve safe and effective medicines use by consumers, but research is distributed across diseases, populations and settings. The scope and focus of such reviews also vary widely, creating challenges for decision-makers seeking to inform decisions by using the evidence on consumers’ medicines use.
This is an update of a 2011 overview of systematic reviews, which synthesises the evidence, irrespective of disease, medicine type, population or setting, on the effectiveness of interventions to improve consumers' medicines use.
OBJECTIVES: To assess the effects of interventions which target healthcare consumers to promote safe and effective medicines use, by synthesising review-level evidence.
SEARCH METHODS: We included systematic reviews published on the Cochrane Database of Systematic Reviews and the Database of Abstracts of Reviews of Effects. We identified relevant reviews by handsearching databases from their start dates to March 2012.
SELECTION CRITERIA: We screened and ranked reviews based on relevance to consumers’ medicines use, using criteria developed for this overview.
DATA COLLECTION AND ANALYSIS: We used standardised forms to extract data, and assessed reviews for methodological quality using the AMSTAR tool. We used standardised language to summarise results within and across reviews; and gave bottom-line statements about intervention effectiveness. Two review authors screened and selected reviews, and extracted and analysed data. We used a taxonomy of interventions to categorise reviews and guide syntheses.
MAIN RESULTS: We included 75 systematic reviews of varied methodological quality. Reviews assessed interventions with diverse aims including support for behaviour change, risk minimisation and skills acquisition. No reviews aimed to promote systems-level consumer participation in medicines-related activities. Medicines adherence was the most frequently-reported outcome, but others such as knowledge, clinical and service-use outcomes were also reported. Adverse events were less commonly identified, while those associated with the interventions themselves, or costs, were rarely reported.
Looking across reviews, for most outcomes, medicines self-monitoring and self-management programmes appear generally effective to improve medicines use, adherence, adverse events and clinical outcomes; and to reduce mortality in people self-managing antithrombotic therapy. However, some participants were unable to complete these interventions, suggesting they may not be suitable for everyone.
Other promising interventions to improve adherence and other key medicines-use outcomes, which require further investigation to be more certain of their effects, include:
· simplified dosing regimens: with positive effects on adherence;
· interventions involving pharmacists in medicines management, such as medicines reviews (with positive effects on adherence and use, medicines problems and clinical outcomes) and pharmaceutical care services (consultation between pharmacist and patient to resolve medicines problems, develop a care plan and provide follow-up; with positive effects on adherence and knowledge).
Several other strategies showed some positive effects, particularly relating to adherence, and other outcomes, but their effects were less consistent overall and so need further study. These included:
· delayed antibiotic prescriptions: effective to decrease antibiotic use but with mixed effects on clinical outcomes, adverse effects and satisfaction;
· practical strategies like reminders, cues and/or organisers, reminder packaging and material incentives: with positive, although somewhat mixed effects on adherence;
· education delivered with self-management skills training, counselling, support, training or enhanced follow-up; information and counselling delivered together; or education/information as part of pharmacist-delivered packages of care: with positive effects on adherence, medicines use, clinical outcomes and knowledge, but with mixed effects in some studies;
· financial incentives: with positive, but mixed, effects on adherence.
Several strategies also showed promise in promoting immunisation uptake, but require further study to be more certain of their effects. These included organisational interventions; reminders and recall; financial incentives; home visits; free vaccination; lay health worker interventions; and facilitators working with physicians to promote immunisation uptake. Education and/or information strategies also showed some positive but even less consistent effects on immunisation uptake, and need further assessment of effectiveness and investigation of heterogeneity.
There are many different potential pathways through which consumers' use of medicines could be targeted to improve outcomes, and simple interventions may be as effective as complex strategies. However, no single intervention assessed was effective to improve all medicines-use outcomes across all diseases, medicines, populations or settings.
Even where interventions showed promise, the assembled evidence often only provided part of the picture: for example, simplified dosing regimens seem effective for improving adherence, but there is not yet sufficient information to identify an optimal regimen.
In some instances interventions appear ineffective: for example, the evidence suggests that directly observed therapy may be generally ineffective for improving treatment completion, adherence or clinical outcomes.
In other cases, interventions may have variable effects across outcomes. As an example, strategies providing information or education as single interventions appear ineffective to improve medicines adherence or clinical outcomes, but may be effective to improve knowledge; an important outcome for promoting consumers' informed medicines choices.
Despite a doubling in the number of reviews included in this updated overview, uncertainty still exists about the effectiveness of many interventions, and the evidence on what works remains sparse for several populations, including children and young people, carers, and people with multimorbidity.
AUTHORS' CONCLUSIONS: This overview presents evidence from 75 reviews that have synthesised trials and other studies evaluating the effects of interventions to improve consumers' medicines use.
Systematically assembling the evidence across reviews allows identification of effective or promising interventions to improve consumers’ medicines use, as well as those for which the evidence indicates ineffectiveness or uncertainty.
Decision makers faced with implementing interventions to improve consumers' medicines use can use this overview to inform decisions about which interventions may be most promising to improve particular outcomes. The intervention taxonomy may also assist people to consider the strategies available in relation to specific purposes, for example, gaining skills or being involved in decision making. Researchers and funders can use this overview to identify where more research is needed and assess its priority. The limitations of the available literature due to the lack of evidence for important outcomes and important populations, such as people with multimorbidity, should also be considered in practice and policy decisions.
KEY MESSAGES: - There is now extensive evidence demonstrating that there is a gap between the health care that patients receive and the practice that is recommended. In both primary and secondary care there are unwarranted variations in practice and in resulting outcomes that cannot be explained by the characteristics of patients.
- While it is difficult to find examples of measures for addressing this issue from all 53 countries of the World Health Organization’s European Region, there are interventions that can be identified in the 27 Member States of the European Union. However, the nature of these measures and the extent to which they are implemented vary considerably.
- Audit and feedback defined as “any summary of clinical performance of health care over a specified period of time aimed at providing information to health professionals to allow them to assess and adjust their performance” is an overarching term used to describe some of the measures that are used to improve professional practice.
- Audit and feedback can be used in all health care settings, involving all health professionals, either as individual professions or in multiprofessional teams.
- In practical terms, health professionals can receive feedback on their performance based on data derived from their routine practice. Health professionals involved in audit and feedback may work either in a team or individually and in primary, secondary or tertiary care.
- While it seems intuitive that health care professionals would be prompted to modify their clinical practice if receiving feedback that it was inconsistent with that of their peers or accepted guidelines, this is in fact not always the case.
- The available evidence suggests that audit and feedback may be effective in improving professional practice but that the effects are generally small to moderate. Nonetheless, depending on the context, such small effects, particularly if shown to be cost-effective, may still be regarded as worthwhile.
- The benefits of audit and feedback measures are most likely to occur where existing practice is furthest away from what is desired, and when feedback is more intensive.
- Even on the basis of the best evidence available, no strong recommendations can be given regarding the best way to introduce audit and feedback into routine practice. However, decisions about if, and how, this approach can Policy summary be used to improve professional practice must be guided by pragmatism and the consideration of local circumstances. The following scenarios, for example, might indicate suitability for such an approach: the known (or anticipated) level of initial adherence to guidelines or desired practice is low; it is feasible to conduct an audit and the associated costs of collecting the data are low; routinely collected data are reliable and appropriate for use in an audit; and small to moderate improvements in quality would be worthwhile.
- The cost of audit and feedback is highly variable and is determined by local conditions, including the availability of reliable routinely collected data and personnel costs.
- The impact of audit and feedback, with or without additional interventions, should be monitored routinely by auditing practice after the intervention.
BACKGROUND: Policy makers face challenges to ensure an appropriate supply and distribution of trained health workers and to manage their performance in delivery of services, especially in countries with low and middle incomes. We aimed to identify all available policy options to address human resources for health in such countries, and to assess the effectiveness of these policy options. METHODS: We searched Medline and Embase from 1979 to September, 2006, the Cochrane Library, and the Human Resources for Health Global Resource Center database. We also searched up to 10 years of archives from five relevant journals, and consulted experts. We included systematic reviews in English which assessed the effects of policy options that could affect the training, distribution, regulation, financing, management, organisation, or performance of health workers. Two reviewers independently assessed each review for eligibility and quality, and systematically extracted data about main effects. We also assessed whether the policy options were equitable in their effects; suitable for scaling up; and applicable to countries with low and middle incomes. FINDINGS: 28 of the 759 systematic reviews of effects that we identified were eligible according to our criteria. Of these, only a few included studies from countries with low and middle incomes, and some reviews were of low quality. Most evidence focused on organisational mechanisms for human resources, such as substitution or shifting tasks between different types of health workers, or extension of their roles; performance-enhancing strategies such as quality improvement or continuing education strategies; promotion of teamwork; and changes to workflow. Of all policy options, the use of lay health workers had the greatest proportion of reviews in countries with a range of incomes, from high to low. INTERPRETATION: We have identified a need for more systematic reviews on the effects of policy options to improve human resources for health in countries with low and middle incomes, for assessments of any interventions that policy makers introduce to plan and manage human resources for health, and for other research to aid policy makers in these countries.
BACKGROUND: Changing the organization of patient care should contribute to improved patient outcomes as functioning of clinical teams and organizational structures are important enablers for improvement. OBJECTIVE: To provide an overview of the research evidence on effects of organizational strategies to implement improvements in patient care. DESIGN: Structured review of published reviews of rigorous evaluations. DATA SOURCES: Published reviews of studies on organizational interventions. REVIEW METHODS: Searches were conducted in two data-bases (Pubmed, Cochrane Library) and in selected journals. Reviews were included, if these were based on a systematic search, focused on rigorous evaluations of organizational changes, and were published between 1995 and 2003. Two investigators independently extracted information from the reviews regarding their clinical focus, methodological quality and main quantitative findings. RESULTS: A total of 36 reviews were included, but not all were high-quality reviews. The reviews were too heterogeneous for quantitative synthesis. None of the strategies produced consistent effects. Professional performance was generally improved by revision of professional roles and computer systems for knowledge management. Patient outcomes was generally improved by multidisciplinary teams, integrated care services, and computer systems. Cost savings were reported from integrated care services. The benefits of quality management remained uncertain. CONCLUSION: There is a growing evidence base of rigorous evaluations of organizational strategies, but the evidence underlying some strategies is limited and for no strategy can the effects be predicted with high certainty.
Pay-for-performance (P4P) has been widely used around the world seeking to improve health outcomes, and in Brazil it is the basis of the National Program for Improving Access and Quality (PMAQ). The literature published between 1998 and January 2013 that evaluated the effectiveness of P4P to produce results or patterns of access and quality in health was scrutinized. A total of 138 studies, with the inclusion of a further 41 studies (14 systematic reviews, 07 clinical trials and 20 observational studies) were retrieved and analyzed Among the more rigorous studies, favorable conclusions for P4P were less frequent, whereas observational studies were more favorable to positive effects of P4P on the quality of, and access to, health services. Methodological limitations of observational studies may have contributed to these results, but the range of results is more linked to the conceptual and contextual aspects of the use of the P4P schemes reviewed, the heterogeneity of P4P models and results. P4P can be helpful in promoting the achievement of objectives in health care systems, especially in the short term and for specific actions requiring less effort of health care providers, but should be used with caution and with a rigorous planning model, also considering undesirable or adverse effects.
