The electronic health record (EHR) may be an effective tool to help clinicians address tobacco use more consistently. To evaluate the impact of EHR-generated practice feedback on rates of referral to a state-level tobacco quitline, we conducted a cluster randomized clinical trial (feedback versus no feedback) within 19 primary care clinics in Oregon. Intervention clinics received provider-specific monthly feedback reports generated from EHR data. The reports rated provider performance in asking, advising, assessing, and assisting with tobacco cessation compared with a clinic average and an achievable benchmark of care. During 12 months of follow-up, EHR-documented rates of advising, assessing, and assisting were significantly improved in the intervention clinics compared with the control clinics (p<.001). A higher case-mix index and presence of a clinic champion were associated with higher rates of referral to a state-level quitline. EHR-generated provider feedback improved documentation of assistance with tobacco cessation. Connecting physician offices to a state-level quitline was feasible and well accepted.
PURPOSE: Because limited audit/feedback of health status information has yielded mixed results, we evaluated the effects of a sustained program of audit/feedback on patient health and satisfaction.
METHODS: We conducted a group-randomized effectiveness trial in which firms within Veterans Administration general internal medicine clinics served as units of randomization, intervention, and analysis. Respondents to a baseline health inventory were regularly mailed the 36-Item Short Form (SF-36) and, as relevant, questionnaires about six chronic conditions (ischemic heart disease, diabetes, chronic obstructive pulmonary disease, depression, alcohol use, and hypertension) and satisfaction with care. Data were reported to primary providers at individual patient visits and in aggregate during a 2-year period.
RESULTS: Baseline forms were mailed to 34,050 patients; of the 22,413 respondents, 15,346 completed and returned follow-up surveys. Over the 2-year study, the difference between intervention and control groups (as measured by difference in average slope) was -0.26 (95% confidence interval [CI]: -0.79 to 0.27; P=0.28) for the SF-36 Physical Component Summary score and -0.53 (95% CI: -1.09 to 0.03; P=0.06) for the SF-36 Mental Component Summary score. No significant differences emerged after adjusting for deaths. There were no significant differences in condition-specific measures or satisfaction between groups after adjustment for provider type, panel size, and number of intervention visits, or after analysis of patients who completed all forms.
CONCLUSION: An elaborate, sustained audit/feedback program of general and condition-specific measures of health/satisfaction did not improve outcomes. To be effective, such data probably should be incorporated into a comprehensive chronic disease management program.
BACKGROUND: Standard Treatment Guidelines were introduced to all prescribers at provincial hospitals in Lao PDR and treatment indicators were developed within the National Drug Policy programme to monitor compliance. OBJECTIVES: To evaluate the effects of an educational intervention to improve treatment practices of malaria, diarrhoea and pneumonia. METHODS: Randomized controlled trial with prescribers at 24 departments at eight provincial hospitals, matched into four pairs. The three departments of internal medicine, paediatrics and out-patients in each pair were randomized into intervention or control group. The 6-month intervention was conducted by members of the Drug and Therapeutics Committees, and comprised monthly audit sessions in the form of outcome feedback using indicator scores on recorded treatment of malaria, diarrhoea and pneumonia. We measured treatment indicator scores 6 months after the end of the intervention compared with baseline. RESULTS: The aggregated mean scores for all diseases, and for malaria and diarrhoea, improved significantly. For pneumonia, improvement was seen in both the intervention and control groups. Record keeping was improved for all three diseases. For malaria, there were improvements in recording patients' history, and in frequency of microscope testing; for diarrhoea, regarding weight measurements, palpation of the fontanel for children under 2 years, and reduction of irrational use of anti-diarrhoeals and antibiotics; for pneumonia, in recording respiratory count, and reducing irrational use of anti-histamines and anti-cough medications. CONCLUSIONS: Audit-feedback systems to improve quality of care are feasible and effective also in hospital settings in low-income countries.
AIM: To determine the impact and cost-effectiveness of telephone versus written access to magnetic resonance imaging (MRI), and of different strategies for disseminating locally produced guidelines, upon requests by general practitioners (GPs) for knee and lumbar spine investigation.
MATERIAL AND METHODS: Two sequential pragmatic open cluster-randomized trials were conducted within 39 general practices. The outcome measure in each trial was concordance of request with local guidelines. Trial 1: practices requested MRI by telephone or in writing. Trial 2: all practices received guidelines, plus either: a practice-based seminar, practice-specific audit feedback, both seminar and feedback, or neither.
RESULTS: A total of 414 requests were assessed in the two trials. Trial 1: telephone access cost pound4.86 more per request but rates of concordant requests were equivalent (65%/64%: telephone/written). Trial 2: compared to the control group, costs per practice were pound1911 higher in seminar group, pound1543 higher in feedback group and pound3578 higher for those receiving both. Concordance was greater following the intervention (74% vs 65%; P < 0.05), but there was no difference between the four study groups.
CONCLUSIONS: Method of access did not affect concordance. Written access was more cost-effective. Seminars and feedback were no more effective in modifying practice than guidelines alone, which was thus the most cost-effective option.
OBJECTIVES: To examine the benefits of a guideline-based educational program to improve management of unstable angina pectoris (UAP) in hospital patients. DESIGN: Randomised controlled trial. SETTING: 37 public hospitals across New South Wales. PATIENTS: 1,872 patients admitted with a diagnosis of UAP between 1 February and 30 June 1996 (baseline survey), and 1,368 patients with the same diagnosis admitted between 1 July and 31 December 1998 (follow-up survey). INTERVENTION: Educational sessions run by local opinion leaders, presenting guidelines on management of UAP from the National Health and Medical Research Council and feedback on local practice using data from the baseline survey. Sessions were run between March and June 1998. MAIN OUTCOME MEASURES: Use of evidence-based practice, identified by review of medical records. RESULTS: Use of beta-blockers increased in intervention and control hospitals, although the increase was significant only in the former. Use of calcium-channel blockers decreased significantly in both intervention and control hospitals. However, the change in drug use between baseline and follow-up did not differ significantly between intervention and control hospitals. CONCLUSIONS: Despite some appropriate changes in drug use for UAP management between 1996 and 1998, there was no evidence that a guideline-based educational program was of benefit in changing management. This reaffirms the difficulty of changing doctors' behaviour through practice guidelines. Alternative methods of encouraging evidence-based practice should be considered.
BACKGROUND: Radiological tests are often used by general practitioners (GPs). These tests can be overused and contribute little to clinical management. We aimed to assess two methods of reducing GP requests for radiological tests in accordance with the UK Royal College of Radiologists' guidelines on lumbar spine and knee radiographs.
METHODS: We assessed audit and feedback, and educational reminder messages in six radiology departments and 244 general practices that they served. The study was a before-and-after, pragmatic, cluster randomised controlled trial with a 232 factorial design. A random subset of GP patients' records were examined for concordance with the guidelines. The main outcome measure was number of radiograph requests per 1000 patients per year. Analysis was by intention to treat.
FINDINGS: The effect of educational reminder messages (ie, the change in request rate after intervention) was an absolute change of -1.53 (95% CI -2.5 to -0.57) for lumbar spine and of -1.61 (-2.6 to -0.62) for knee radiographs, both relative reductions of about 20%. The effect of audit and feedback was an absolute change of -0.07 (-1.3 to 0.9) for lumbar spine of 0.04 (-0.95 to 1.03) for knee radiograph requests, both relative reductions of about 1%. Concordance between groups did not differ significantly.
INTERPRETATION: 6-monthly feedback of audit data is ineffective but the routine attachment of educational reminder messages to radiographs is effective and does not affect quality of referrals. Any department of radiology that handles referrals from primary care could deliver this intervention to good effect.
BACKGROUND: Without protective practices such as Universal Precautions, health care workers are at substantial risk for bloodborne infection, especially in areas such as Thailand with high prevalence of HIV infection. The purpose of this study was to evaluate the effectiveness of a peer feedback program (PFP) on handwashing and glove wearing (HW/GW) among Thai health care workers. METHODS: Subjects (N = 91) were randomly assigned to receive PFP versus no treatment. By using a checklist, peer observers rated HW/GW compliance in their coworkers during patient care. For 1 month, the investigator posted a report of compliance behaviors from each 3 days of observations. HW/GW was also assessed by the investigator by direct observation at 1 month before the intervention, during the intervention period, and 1 month after the intervention. RESULTS: Baseline HW/GW rates for the PFP and control groups were 49.2% and 61.5%, respectively. The PFP group had a significantly higher adjusted compliance rate than the control group during the intervention period (P =.0001). However, there was no significant difference in the compliance scores obtained 1 month after the intervention. CONCLUSIONS: The PFP was effective during the intervention period, but there was no retention of effect. Therefore, adjunct methods should be sought to promote retention of effect.
BACKGROUND: The rapid increase of antibiotic resistance poses a significant threat to human health. Overuse of antibiotics has been linked to rates of antibiotic resistance. This study assessed the utility of two common interventions--1) practice profiling and feedback and 2) patient education materials--implemented to decrease antibiotic prescribing for pediatric upper respiratory infections (URIs). METHODS: Based on Medicaid regions in Kentucky, primary care physicians managing pediatric respiratory infections in Medicaid were randomized into four groups. Groups received either 1) performance feedback only, 2) patient education materials only, 3) both feedback and education materials, or 4) no intervention. Participating physicians had their antibiotic prescribing assessed for the period of July 1, 1996, to November 30, 1997, with an intervention in June 1997. The study included 216 physicians and 124,092 episodes of care. RESULTS: All groups increased in proportion of episodes with antibiotics between the pre-intervention and post-intervention periods. Prescribing in the patient education group and the patient education and feedback group increased at a significantly lower rate than in the control group. Physicians did not change their coding of illness to justify antibiotics after the intervention, and there was no significant generalization of effect of the pediatric intervention on prescribing for adult URIs. CONCLUSIONS: These interventions demonstrate little if any impact on promoting appropriate antibiotic prescribing. Antibiotic prescribing for viral respiratory infections continues to increase, suggesting concomitant increases in antibiotic resistance.
BACKGROUND: Family physicians have an important clinical role in assessment and management of suspicious skin lesions. As a result of a previous needs assessment study, an educational intervention based on audit and feedback with opportunity for reflection on practice was introduced to 46 family physicians randomly allocated to either an intervention (23) or control group (23). As an educational tool, audit allows doctors to systematically review their practice and establish the quality of care they provide. When combined with feedback and comparison of clinical performance with peers or standards, it has been shown to increase learning and change behavior. METHODS: Data based on their own patients, on the correlation between clinical and histologic diagnosis, and excisions of skin lesions were collated and reported to the intervention group. RESULTS: Despite randomization of the doctors, the patient population of doctors in the intervention and control groups were significantly different in key characteristics, including the types of skin lesions treated. The intervention group of doctors showed improved performance in providing clinical information on pathology requests and in adequate surgical excision of skin lesions. Diagnostic performance did not improve significantly, but physicians' certainty of diagnosis did. IMPLICATIONS: This study design has highlighted the difficulty in balancing the use of evidence-based educational strategies in an equivalent setting to normal practice with evaluation of performance using measures that include characteristics of practitioners' patients that cannot be controlled.
BACKGROUND: Previous interventions targeting primary care practitioners with the aim of increasing preventive care delivery have demonstrated limited effectiveness. The primary aim of this study was to assess the effectiveness of a computerized continuing medical education program to increase rates of three screening behaviors (cholesterol, blood pressure, and cervical screening) and to identify three risk behaviors (smoking, alcohol consumption, benzodiazepine use) in general practice. METHODS: Nineteen general practitioners were randomly allocated to intervention or control conditions. Those given the intervention received a computerized feedback system. The intervention was delivered using a touch-screen computer located in the surgery waiting area. The preventive behaviors of interest were patient smoking, alcohol use, benzodiazepine use, and blood pressure, cholesterol and cervical screening using the Papanicolou test. Differences in performance by group in each of the outcomes was measured at baseline and 3-month follow-up. Logistic regression analyses with generalized estimating equations were conducted as the main analyses. RESULT: At 3-month follow-up, statistically significant differences were evident in the following outcome measures: accurate classification of benzodiazepine users (z = 2.8540, P < 0.05); accurate classification of non-benzodiazepine users (z = 2.7339, P < 0.05); accurate classification of hazardous or harmful alcohol drinkers (z = 2.3079, P < 0.02); blood pressure screening (z = 3.4136, P < 0.001); and cholesterol screening (z = 6.6313, P < 0.001). CONCLUSION: A computerized system of performance-specific feedback was effective at increasing some preventive care services in general practice.
The electronic health record (EHR) may be an effective tool to help clinicians address tobacco use more consistently. To evaluate the impact of EHR-generated practice feedback on rates of referral to a state-level tobacco quitline, we conducted a cluster randomized clinical trial (feedback versus no feedback) within 19 primary care clinics in Oregon. Intervention clinics received provider-specific monthly feedback reports generated from EHR data. The reports rated provider performance in asking, advising, assessing, and assisting with tobacco cessation compared with a clinic average and an achievable benchmark of care. During 12 months of follow-up, EHR-documented rates of advising, assessing, and assisting were significantly improved in the intervention clinics compared with the control clinics (p<.001). A higher case-mix index and presence of a clinic champion were associated with higher rates of referral to a state-level quitline. EHR-generated provider feedback improved documentation of assistance with tobacco cessation. Connecting physician offices to a state-level quitline was feasible and well accepted.
