Pilot Study of Explicit Grading Criteria in the American Board of Psychiatry and Neurology Part II Examination

McDermott, John F. Jr. MD
Streltzer, Jon MD
Lum, Kwong Yen MD
Nordquist, Carol R. MA
Danko, George PhD

Received Aug. 2, 1995; revision received Feb. 26, 1996; accepted April 12, 1996. Dr. McDermott is Director Emeritus of the American Board of Psychiatry and Neurology (ABPN), Inc., and Drs. Streltzer and Lum are Senior Examiners. From the Department of Psychiatry, University of Hawaii School of Medicine. Address reprint requests to Dr. McDermott, Department of Psychiatry, University of Hawaii School of Medicine, 1319 Punahou St., Number 638, Honolulu, HI 96826. E-mail: [email protected]
This work does not necessarily reflect the views or opinions of the ABPN.

American Journal of Psychiatry 153(8):p 1097-1099, August 1996.

Objective

The purpose of this study was to identify specific competencies that differentiated passing from failing performance on the American Board of Psychiatry and Neurology Part II oral board certification examination. Method: A total of 363 candidates were rated in 18 areas of competence defined by behavioral criteria. Data were analyzed to determine which areas best discriminated between passing and failing candidates. Results: In both parts of the examination, the ability to develop a comprehensive treatment plan was most influential. After that, specific interview and observational skills discriminated best. Failing candidates had most difficulty detecting and following informational and affective cues in their interview of a patient and presenting a biopsychosocial formulation and comprehensive treatment plan. Conclusions: Specific candidate competencies related to passing and failing performance can be identified and assessed by a rating scale of observable behaviors on the board certification examination in psychiatry.

(Am J Psychiatry 1996; 153:1097-1099)