Primary studies included in this broad synthesis

loading
32 articles (32 References) Revert Studify

Primary study

Unclassified

Effects of pay for performance on the quality of primary care in England.

Journal The New England journal of medicine
Year 2009
Links Pubmed DOI

This article is included in 7 Systematic reviews Systematic reviews (7 references) 1 Broad synthesis Broad syntheses (1 reference)

Loading references information
BACKGROUND: A pay-for-performance scheme based on meeting targets for the quality of clinical care was introduced to family practice in England in 2004. METHODS: We conducted an interrupted time-series analysis of the quality of care in 42 representative family practices, with data collected at two time points before implementation of the scheme (1998 and 2003) and at two time points after implementation (2005 and 2007). At each time point, data on the care of patients with asthma, diabetes, or coronary heart disease were extracted from medical records; data on patients' perceptions of access to care, continuity of care, and interpersonal aspects of care were collected from questionnaires. The analysis included aspects of care that were and those that were not associated with incentives. RESULTS: Between 2003 and 2005, the rate of improvement in the quality of care increased for asthma and diabetes (P<0.001) but not for heart disease. By 2007, the rate of improvement had slowed for all three conditions (P<0.001), and the quality of those aspects of care that were not associated with an incentive had declined for patients with asthma or heart disease. As compared with the period before the pay-for-performance scheme was introduced, the improvement rate after 2005 was unchanged for asthma or diabetes and was reduced for heart disease (P=0.02). No significant changes were seen in patients' reports on access to care or on interpersonal aspects of care. The level of the continuity of care, which had been constant, showed a reduction immediately after the introduction of the pay-for-performance scheme (P<0.001) and then continued at that reduced level. CONCLUSIONS: Against a background of increases in the quality of care before the pay-for-performance scheme was introduced, the scheme accelerated improvements in quality for two of three chronic conditions in the short term. However, once targets were reached, the improvement in the quality of care for patients with these conditions slowed, and the quality of care declined for two conditions that had not been linked to incentives. Continuity of care was reduced after the introduction of the scheme.

Primary study

Unclassified

Doctors' perceptions of why 360-degree feedback does (not) work: a qualitative study.

Journal Medical education
Year 2009
Links Pubmed DOI

This article is included in 1 Broad synthesis Broad syntheses (1 reference) 1 Systematic review Systematic reviews (1 reference)

Loading references information
OBJECTIVES: Delivery of 360-degree feedback is widely used in revalidation programmes. However, little has been done to systematically identify the variables that influence whether or not performance improvement is actually achieved after such assessments. This study aims to explore which factors represent incentives, or disincentives, for consultants to implement suggestions for improvement from 360-degree feedback. METHODS: In 2007, 109 consultants in the Netherlands were assessed using 360-degree feedback and portfolio learning. We carried out a qualitative study using semi-structured interviews with 23 of these consultants, purposively sampled based on gender, hospital, work experience, specialty and views expressed in a previous questionnaire. A grounded theory approach was used to analyse the transcribed tape-recordings. RESULTS: We identified four groups of factors that can influence consultants' practice improvement after 360-degree feedback: (i) contextual factors related to workload, lack of openness and social support, lack of commitment from hospital management, free-market principles and public distrust; (ii) factors related to feedback; (iii) characteristics of the assessment system, such as facilitators and a portfolio to encourage reflection, concrete improvement goals and annual follow-up interviews, and (iv) individual factors, such as self-efficacy and motivation. CONCLUSIONS: It appears that 360-degree feedback can be a positive force for practice improvement provided certain conditions are met, such as that skilled facilitators are available to encourage reflection, concrete goals are set and follow-up interviews are carried out. This study underscores the fact that hospitals and consultant groups should be aware of the existing lack of openness and absence of constructive feedback. Consultants indicated that sharing personal reflections with colleagues could improve the quality of collegial relationships and heighten the chance of real performance improvement.

Primary study

Unclassified

Effect of financial incentives on inequalities in the delivery of primary clinical care in England: analysis of clinical activity indicators for the quality and outcomes framework.

Journal Lancet
Year 2008
Links Pubmed DOI

This article is included in 3 Systematic reviews Systematic reviews (3 references) 1 Broad synthesis Broad syntheses (1 reference)

Loading references information
BACKGROUND: The quality and outcomes framework is a financial incentive scheme that remunerates general practices in the UK for their performance against a set of quality indicators. Incentive schemes can increase inequalities in the delivery of care if practices in affluent areas are more able to respond to the incentives than are those in deprived areas. We examined the relation between socioeconomic inequalities and delivered quality of clinical care in the first 3 years of this scheme. METHODS: We analysed data extracted automatically from clinical computing systems for 7637 general practices in England, data from the UK census, and data for characteristics of practices and patients from the 2006 general medical statistics database. Practices were grouped into equal-sized quintiles on the basis of area deprivation in their locality. We calculated overall levels of achievement, defined as the proportion of patients who were deemed eligible by the practices for whom the targets were achieved, for 48 clinical activity indicators during the first 3 years of the incentive scheme (from 2004-05 to 2006-07). FINDINGS: Median overall reported achievement was 85.1% (IQR 79.0-89.1) in year 1, 89.3% (86.0-91.5) in year 2, and 90.8% (88.5-92.6) in year 3. In year 1, area deprivation was associated with lower levels of achievement, with median achievement ranging from 86.8% (82.2-89.6) for quintile 1 (least deprived) to 82.8% (75.2-87.8) for quintile 5 (most deprived). Between years 1 and 3, median achievement increased by 4.4% for quintile 1 and by 7.6% for quintile 5, and the gap in median achievement narrowed from 4.0% to 0.8% during this period. Increase in achievement during this time was inversely associated with practice performance in previous years (p<0.0001), but was not associated with area deprivation (p=0.062). INTERPRETATION: Our results suggest that financial incentive schemes have the potential to make a substantial contribution to the reduction of inequalities in the delivery of clinical care related to area deprivation.

Primary study

Unclassified

Audit and feedback and clinical practice guideline adherence: making feedback actionable.

Authors Hysong SJ , Best RG , Pugh JA
Journal Implementation science : IS
Year 2006
Links Pubmed DOI

This article is included in 1 Broad synthesis Broad syntheses (1 reference)

Loading references information
BACKGROUND: As a strategy for improving clinical practice guideline (CPG) adherence, audit and feedback (A&F) has been found to be variably effective, yet A&F research has not investigated the impact of feedback characteristics on its effectiveness. This paper explores how high performing facilities (HPF) and low performing facilities (LPF) differ in the way they use clinical audit data for feedback purposes. METHOD: Descriptive, qualitative, cross-sectional study of a purposeful sample of six Veterans Affairs Medical Centers (VAMCs) with high and low adherence to six CPGs, as measured by external chart review audits. One-hundred and two employees involved with outpatient CPG implementation across the six facilities participated in one-hour semi-structured interviews where they discussed strategies, facilitators and barriers to implementing CPGs. Interviews were analyzed using techniques from the grounded theory method. RESULTS: High performers provided timely, individualized, non-punitive feedback to providers, whereas low performers were more variable in their timeliness and non-punitiveness and relied on more standardized, facility-level reports. The concept of actionable feedback emerged as the core category from the data, around which timeliness, individualization, non-punitiveness, and customizability can be hierarchically ordered. CONCLUSION: Facilities with a successful record of guideline adherence tend to deliver more timely, individualized and non-punitive feedback to providers about their adherence than facilities with a poor record of guideline adherence. Consistent with findings from organizational research, feedback intervention characteristics may influence the feedback's effectiveness at changing desired behaviors.

Primary study

Unclassified

Exploring family physicians' reactions to multisource feedback: perceptions of credibility and usefulness.

Authors Sargeant J , Mann K , Ferrier S
Journal Medical education
Year 2005
Links Pubmed DOI

This article is included in 3 Systematic reviews Systematic reviews (3 references) 1 Broad synthesis Broad syntheses (1 reference)

Loading references information
PURPOSE: Physician performance is comprised of several domains of professional competence. Multisource feedback (MSF) or 360-degree feedback is an approach used to assess these, particularly the humanistic and relational competencies. Research studying responses to performance assessment shows that reactions vary and can influence how performance feedback is used. Improvement does not always result, especially when feedback is perceived as negative. This small qualitative study undertook preliminary exploration of physicians' reactions to MSF, and perceptions influencing these and the acceptance and use of their feedback. METHODS: We held focus groups with 15 family physicians participating in an MSF pilot study. Qualitative analyses included content and constant comparative analyses. RESULTS: Participants agreed that the purpose of MSF assessment should be to enhance practice and generally agreed with their patients' feedback. However, responses to medical colleague and co-worker feedback ranged from positive to negative. Several participants who responded negatively did not agree with their feedback nor were inclined to use it for practice improvement. Reactions were influenced by perceptions of accuracy, credibility and usefulness of feedback. Factors shaping these perceptions included: recruiting credible reviewers, ability of reviewers to make objective assessments, use of the assessment tool and specificity of the feedback. CONCLUSION: Physicians' perceptions of the MSF process and feedback can influence how and if they use the feedback for practice improvement. These findings are important, raising the concern that feedback perceived as negative and not useful will have no or negative results, and highlight questions for further study.

Primary study

Unclassified

Improving physician coverage of pneumococcal vaccine: a randomized trial of a telephone intervention.

blocked
Authors Quinley JC , Shih A
Journal Journal of community health
Year 2004
Links Pubmed DOI

This article is included in 1 Broad synthesis Broad syntheses (1 reference) 3 Systematic reviews Systematic reviews (3 references)

Loading references information
Improved pneumococcal vaccine (PPV) immunization for seniors is a national goal of the Medicare program. This study examined whether adding a simple telephone follow-up to an existing mailed physician performance feedback under the Medicare program would increase the impact on billed pneumococcal immunizations. Medicare fee-for-service claims data were used to select New York primary care physicians with high volume (n = 732) or African-American serving (n = 329) practices. All practices received mailed feedback on their 1999 Medicare practice specific PPV coverage rates, along with educational materials and offers of assistance. Practices were also randomized to receive telephone calls directing attention to the mailing and further promoting improvements in PPV coverage or no active follow-up. Physicians randomized to telephone follow-up showed significantly higher rates of practice specific PPV coverage in 2000 than those receiving the routine mailing only, and 27% vs. 17% (p = 0.01) of high volume physicians and 34% vs. 22% (p = .052) of African American serving physicians achieved at least a 5% increase in their cumulative PPV claims coverage. This study concludes that telephone follow-up is an effective and straightforward method to enhance the impact of practice specific feedback to promote improvements in Medicare PPV immunization. However, improved methods may be needed to induce a large percentage of physicians to change.

Primary study

Unclassified

Mailed prescriber feedback in addition to a clinical guideline has no impact: a randomised, controlled trial.

blocked
Journal Scandinavian journal of primary health care
Year 2003
Links Pubmed DOI

This article is included in 2 Broad syntheses Broad syntheses (2 references) 6 Systematic reviews Systematic reviews (6 references)

Loading references information
OBJECTIVE: To evaluate the impact of feedback on the prescribing of antibiotics supplementary to clinical guidelines in the treatment of respiratory tract infections. DESIGN: Randomised, controlled trial with GPs allocated to one of two groups. The first group received clinical guidelines on the treatment of respiratory tract infections plus postal feedback with aggregated data on their prescribing patterns for antibiotics. The second group served as controls for the first group and received the guidelines only. SETTING: 299 GPs representing 181 practices with 455,843 listed patients in the County of Funen, Denmark. MAIN OUTCOME MEASURES: Effects on GP prescribing patterns were measured by means of a prescription database and followed for a period of 2 years with 2 outcome measures: 1) the antibiotic prescription rate and 2) the fraction of prescriptions for narrow-spectrum antibiotics. RESULTS: The addition of feedback had no impact on GP prescribing patterns. CONCLUSION: Postal disseminated prescriber feedback in addition to a clinical guideline on the diagnosis and treatment of respiratory tract infections does not influence GP prescribing patterns. Interventions aimed at improving performance in general practice should go beyond just giving GPs information on whether they are living up to standards.

Primary study

Unclassified

General practitioners' use of magnetic resonance imaging: an open randomized trial comparing telephone and written requests and an open randomized controlled trial of different methods of local guideline dissemination.

blocked
Journal Clinical radiology
Year 2002
Links Pubmed Health Technology Assessment (HTA) DOI crd.york.ac.uk

This article is included in 6 Systematic reviews Systematic reviews (6 references) 1 Broad synthesis Broad syntheses (1 reference)

Loading references information
AIM: To determine the impact and cost-effectiveness of telephone versus written access to magnetic resonance imaging (MRI), and of different strategies for disseminating locally produced guidelines, upon requests by general practitioners (GPs) for knee and lumbar spine investigation. MATERIAL AND METHODS: Two sequential pragmatic open cluster-randomized trials were conducted within 39 general practices. The outcome measure in each trial was concordance of request with local guidelines. Trial 1: practices requested MRI by telephone or in writing. Trial 2: all practices received guidelines, plus either: a practice-based seminar, practice-specific audit feedback, both seminar and feedback, or neither. RESULTS: A total of 414 requests were assessed in the two trials. Trial 1: telephone access cost pound4.86 more per request but rates of concordant requests were equivalent (65%/64%: telephone/written). Trial 2: compared to the control group, costs per practice were pound1911 higher in seminar group, pound1543 higher in feedback group and pound3578 higher for those receiving both. Concordance was greater following the intervention (74% vs 65%; P < 0.05), but there was no difference between the four study groups. CONCLUSIONS: Method of access did not affect concordance. Written access was more cost-effective. Seminars and feedback were no more effective in modifying practice than guidelines alone, which was thus the most cost-effective option.

Primary study

Unclassified

Cluster randomised controlled trial of an educational outreach visit to improve influenza and pneumococcal immunisation rates in primary care.

blocked
Journal The British journal of general practice : the journal of the Royal College of General Practitioners
Year 2002
Links Pubmed PubMed Central

This article is included in 7 Systematic reviews Systematic reviews (7 references) 1 Broad synthesis Broad syntheses (1 reference)

Loading references information
BACKGROUND: Improvement in the delivery of influenza and pneumococcal vaccinations to high-risk groups is an important aspect of preventive care for primary healthcare teams. AIM: To investigate the effect of an educational outreach visit to primary healthcare teams on influenza and pneumococcal vaccination uptake in high-risk patients. DESIGN: Cluster randomised controlled trial. SETTING: Thirty general practices in the Trent region, UK. METHODS: Fifteen practices were randomised to intervention and 15 to the control group after stratifying for baseline vaccination rate. All intervention practices were offered and received an educational outreach visit to primary healthcare teams, in addition to audit and feedback directed at improving influenza and pneumococcal vaccination rates in high-risk groups. Control practices received audit and feedback alone. All practices measured influenza and pneumococcal vaccination rates in high-risk groups. Primary outcomes were improvements in vaccination rates in patients aged 65 years and over, and patients with coronary heart disease (CHD), diabetes and a history of splenectomy. RESULTS: Improvements in pneumococcal vaccination rates in the intervention practices were significantly greater compared with controls in patients with CHD, 14.8% versus 6.5% (odds ratio [OR] = 1.23, 95% confidence interval [CI] = 1.13 to 1.34) and diabetes, 15.5% versus 6.8% (OR = 1.18, 95% CI = 1.08 to 1.29) but not splenectomy, 6.5% versus 4.7% (OR = 0.96, 95% CI = 0.65 to 1.42). Improvements for influenza vaccination were also usually greater in intervention practices but did not reach statistical significance. The increases for influenza vaccination in intervention versus control practices were for CHD, 18.1% versus 13.1% (OR = 1.06, 95% CI = 0.99 to 1.12); diabetes, 15.5% versus 12.0% (OR = 1.07, 95% CI = 0.99 to 1.16), splenectomy 16.1% versus 2.9% (OR = 1.22, 95% CI = 0.78 to 1.93); and those over 65 years 20.7% versus 25.4% (OR = 0.99, 95% CI = 0.96 to 1.02). CONCLUSION: Practices where primary care teams received an educational outreach visit demonstrated a significantly greater improvement in uptake in high-risk groups for pneumococcal but not influenza vaccine.

Primary study

Unclassified

Improving performance in diabetes care: a multicomponent intervention.

Journal Effective clinical practice : ECP
Year 2001
Links Pubmed

This article is included in 1 Broad synthesis Broad syntheses (1 reference)

Loading references information
CONTEXT: Compliance with recommendations from the American Diabetes Association for management of patients with diabetes is not optimal. Changing physician practice patterns with provider-focused interventions can be difficult. We report results after implementation of a type 2 diabetes mellitus guideline. OBJECTIVE: To increase the annual rate of microalbumin/urine protein testing, dilated eye examinations, and foot examinations for patients with diabetes and to reduce overall levels of hemoglobin A1c (Hb A1c). DESIGN: Before-after study. INTERVENTION: From April 1996 to June 1998, a guideline on type 2 diabetes mellitus was implemented with multicomponent interventions. These included small group educational sessions led by opinion leaders, an electronic version of the guideline, audit with feedback, and enhanced clinical orders support. Medical records of random samples of patients with diabetes were audited for specific diabetes performance measures on a monthly basis. Baseline data were compared with results at the end of the implementation effort. SETTING: Southeastern Minnesota, excluding Olmsted County. PARTICIPANTS: Adult patients seen at one practice of 18 general internists. OUTCOME MEASURES: Outcome measures included Hb A1c values and annual performance of a urine protein test, foot examination, and dilated eye examination. RESULTS: Gradual, sustained; and statistically significant improvements in the three annual performance measures were observed. Urine protein testing increased from 24% to 66% (P = 0.001), dilated eye examinations increased from 63% to 84% (P = 0.001), and foot examinations increased from 86% to 97% (P = 0.001). Mean Hb A1c values +/- SD also improved from 7.8% +/- 1.0% to 7.1% +/- 0.7% (P < 0.001) in patients who received continuing care for diabetes. CONCLUSIONS: Statistically significant improvements were observed after continuous improvement efforts were focused on providers in an individual group practice. When used to implement a diabetes guideline, such interventions may improve delivery of services and reduce Hb A1c levels in patients with diabetes.