BACKGROUND: Pay-for-performance (P4P) intents to stimulate both more effective and more efficient health care delivery. To date, evidence on whether P4P itself is an efficient method has not been systematically analyzed.
OBJECTIVE: To identify and analyze the existing literature regarding economic evaluation of P4P.
DATA SOURCES: English, German, Spanish, and Turkish language literature were searched in the following databases: Business Source Complete, the Cochrane Library, Econlit, ISI web of knowledge, Medline (via PubMed), and PsycInfo (January 2000-April 2010).
STUDY SELECTION: Articles published in peer-reviewed journals and describing economic evaluations of P4P initiatives. Full economic evaluations, considering costs and consequences of the P4P intervention simultaneously, were the prime focus. Additionally, comparative partial evaluations were included if costs were described and the study allows for an assessment of consequences. Both experimental and observational studies were considered.
RESULTS: In total, nine studies could be identified. Three studies could be regarded as full economic evaluations, and six studies were classified as partial economic evaluations. Based on the full economic evaluations, P4P efficiency could not be demonstrated. Partial economic evaluations showed mixed results, but several flaws limit their significance. Ranges of costs and consequences were typically narrow, and programs differed considerably in design. Methodological quality assessment showed scores between 32% and 65%.
CONCLUSION: The results show that evidence on the efficiency of P4P is scarce and inconclusive. P4P efficiency could not be demonstrated. The small number and variability of included studies limit the strength of our conclusions. More research addressing P4P efficiency is needed.
BACKGROUND: Pay-for-performance (P4P) is one of the primary tools used to support healthcare delivery reform. Substantial heterogeneity exists in the development and implementation of P4P in health care and its effects. This paper summarizes evidence, obtained from studies published between January 1990 and July 2009, concerning P4P effects, as well as evidence on the impact of design choices and contextual mediators on these effects. Effect domains include clinical effectiveness, access and equity, coordination and continuity, patient-centeredness, and cost-effectiveness.
METHODS: The systematic review made use of electronic database searching, reference screening, forward citation tracking and expert consultation. The following databases were searched: Cochrane Library, EconLit, Embase, Medline, PsychINFO, and Web of Science. Studies that evaluate P4P effects in primary care or acute hospital care medicine were included. Papers concerning other target groups or settings, having no empirical evaluation design or not complying with the P4P definition were excluded. According to study design nine validated quality appraisal tools and reporting statements were applied. Data were extracted and summarized into evidence tables independently by two reviewers.
RESULTS: One hundred twenty-eight evaluation studies provide a large body of evidence -to be interpreted with caution- concerning the effects of P4P on clinical effectiveness and equity of care. However, less evidence on the impact on coordination, continuity, patient-centeredness and cost-effectiveness was found. P4P effects can be judged to be encouraging or disappointing, depending on the primary mission of the P4P program: supporting minimal quality standards and/or boosting quality improvement. Moreover, the effects of P4P interventions varied according to design choices and characteristics of the context in which it was introduced.Future P4P programs should (1) select and define P4P targets on the basis of baseline room for improvement, (2) make use of process and (intermediary) outcome indicators as target measures, (3) involve stakeholders and communicate information about the programs thoroughly and directly, (4) implement a uniform P4P design across payers, (5) focus on both quality improvement and achievement, and (6) distribute incentives to the individual and/or team level.
CONCLUSIONS: P4P programs result in the full spectrum of possible effects for specific targets, from absent or negligible to strongly beneficial. Based on the evidence the review has provided further indications on how effect findings are likely to relate to P4P design choices and context. The provided best practice hypotheses should be tested in future research.
More than 40 private sector hospital pay-for-performance (P4P) programs now exist, and Congress is considering initiating a Medicare hospital P4P program. Given the growing interest in hospital P4P, this systematic review of the literature examines the current state of knowledge about the effect of P4P on clinical process measures, patient outcomes and experience, safety, and resource utilization. Little formal evaluation of hospital P4P has occurred, and most of the 8 published studies have methodological flaws. The most rigorous studies focus on clinical process measures and demonstrate that hospitals participating in the Centers for Medicare and Medicaid Services-Premier Hospital Quality Incentive Demonstration, a P4P program, had a 2- to 4-percentage point greater improvement than the improvement observed in control hospitals. There is a need for more systematic evaluation of hospital P4P to understand its effect and whether the benefits of investing in P4P outweigh the associated costs.
Pay-for-performance (P4P) intents to stimulate both more effective and more efficient health care delivery. To date, evidence on whether P4P itself is an efficient method has not been systematically analyzed.
OBJECTIVE:
To identify and analyze the existing literature regarding economic evaluation of P4P.
DATA SOURCES:
English, German, Spanish, and Turkish language literature were searched in the following databases: Business Source Complete, the Cochrane Library, Econlit, ISI web of knowledge, Medline (via PubMed), and PsycInfo (January 2000-April 2010).
STUDY SELECTION:
Articles published in peer-reviewed journals and describing economic evaluations of P4P initiatives. Full economic evaluations, considering costs and consequences of the P4P intervention simultaneously, were the prime focus. Additionally, comparative partial evaluations were included if costs were described and the study allows for an assessment of consequences. Both experimental and observational studies were considered.
RESULTS:
In total, nine studies could be identified. Three studies could be regarded as full economic evaluations, and six studies were classified as partial economic evaluations. Based on the full economic evaluations, P4P efficiency could not be demonstrated. Partial economic evaluations showed mixed results, but several flaws limit their significance. Ranges of costs and consequences were typically narrow, and programs differed considerably in design. Methodological quality assessment showed scores between 32% and 65%.
CONCLUSION:
The results show that evidence on the efficiency of P4P is scarce and inconclusive. P4P efficiency could not be demonstrated. The small number and variability of included studies limit the strength of our conclusions. More research addressing P4P efficiency is needed.
