Caution advised when considering patient and colleague feedback on doctors

ScienceDaily (Oct. 27, 2011) — Official assessments of a doctor's professionalism should be considered carefully before being accepted due to the tendency for some doctors to receive lower scores than others, and the tendency of some groups of patient or colleague assessors to provide lower scores, claims new research published online in the British Medical Journal.

Researchers from the Peninsula College of Medicine and Dentistry in Exeter investigated whether there were any potential patient, colleague and doctor-related sources of bias evident in the assessment of doctors' professionalism.

Doctors' regulator the General Medical Council (GMC) is working on a new system of revalidation for all UK doctors that could be introduced next year as a way of ensuring doctors are fit to continue to practise. This is likely to involve the use of multi-source feedback from patients, peers and supervisors as part of the evidence used to judge a clinician's performance.

The researchers used data from two questionnaires completed by patients and colleagues. A group of 1,065 doctors from 11 different settings, including mostly NHS sites and one independent sector organisation, took part in the study.

They were asked to nominate up to 20 medical and non-medically trained colleagues to take part in an online secure survey about their professionalism, as well as passing on a post-consultation questionnaire to 45 patients each. Collectively, the doctors returned completed questionnaires from 17,031 colleagues and 30,333 patients.

Analysis of the results that allowed for characteristics of the doctor and the patient to be taken into account, showed that doctors were less likely to receive favourable patient feedback if their primary medical degree was from any non-European country.

Several other factors also tended to mean doctors got less positive feedback from patients, such as that they practised as a psychiatrist, the responding patient was not white, and the responding patient reported that they were not seeing their "usual doctor."

From colleagues, there was likely to be less positive feedback if the doctor in question had received their degree from any country other than the UK or South Asia. Other factors that predicted a less favourable review from colleagues included that the doctor was working in a locum capacity, the doctor was working as a GP or psychiatrist, or the colleague did not have daily or weekly professional contact with the doctor.

The researchers say they have identified possible "systematic bias" in the assessment of doctors' professionalism.

They conclude: "Systematic bias may exist in the assessment of doctors' professionalism arising from the characteristics of the assessors giving feedback, and from the personal characteristics of the doctor being assessed. In the absence of a standardised measure of professionalism, doctor's assessment scores from multisource feedback should be interpreted carefully, and, at least initially, be used primarily to help inform doctor's professional development."

Recommend this story on Facebook, Twitter,
and Google +1:

Other bookmarking and sharing tools:

Story Source:

The above story is reprinted from materials provided by BMJ-British Medical Journal.

Note: Materials may be edited for content and length. For further information, please contact the source cited above.

Journal Reference:

John L. Campbell, Martin Roberts, Christine Wright, Jacqueline Hill, Michael Greco, Matthew Taylor, Suzanne Richards. Factors associated with variability in the assessment of UK doctors’ professionalism: analysis of survey results. BMJ, 2011; 343: d6212 DOI: 10.1136/bmj.d6212

Note: If no author is given, the source is cited instead.

Disclaimer: This article is not intended to provide medical advice, diagnosis or treatment. Views expressed here do not necessarily reflect those of ScienceDaily or its staff.

View the original article here