ASSESSMENTS OF CLERKS IN PHASE IV CLERKSHIPS


Preamble

While the policies and procedures enumerated below are the ideal standards that each clerkship should endeavor to meet, due to existing resource limitations (e.g., the availability of clinical teaching units, human resources, patient populations), it may be difficult or impossible for all clerkships to achieve the letter of all standards. However, all clinical departments have agreed to attempt to attain these policies and procedures to the best of their abilities.

 

Types of Assessments

Central tenets of the assessment process in clerkships are that ongoing and detailed dialogue with clerks on their progress is an integral part of the learning process, and that early detection of clerk problems will enable more effective help to be provided. Both formative and summative assessments will be provided to each clerk. The following lists the types of assessments that may be included in each category.

Formative (To provide clerks with information about their skills and achievements and how to improve them, and to enable clerks to practice self- assessment skills):


Summative (To record formal judgements about clerks' progress):

 

Principles Guiding the Design and Implementation of the Assessment System

  1. The process of assessing clerks will be co-ordinated and governed by a committee established by the Associate Dean, Undergraduate Medical Education - Curriculum
  2. The assessment process will provide a reliable and valid basis for judging clerks' achievement (summative assessment), and will be effective in providing feedback to clerks on their strengths and weaknesses (formative assessment).
  3. The assessment of clerks will include self-assessments, which are elements of the professional development of clerks.
  4. The assessments will be tied directly to program goals and specific course objectives.
  5. Relevant cumulative content/competencies will be evaluated in the context of current courses.
  6. Assessment methods will be chosen which provide direct, valid evaluations of specific competencies of interest.
  7. A structured process of appeal and remedial instruction will be available (see Phase IV Appeal Process within the body of this manual).
  8. All formative and summative assessment data for a clerk will be entered into an "Assessment Portfolio" which is the property of the clerk. The Dean's Office will retain a copy of all summative assessment data.
  9. A system of "academic advisors" will exist to help clerks review their progress and achievement. The clerk's assessment portfolio will provide the basis for discussion between the clerks and their academic advisors.
  10. The development, administration and scoring of assessments and remedial instruction for clerks will be the responsibility of those faculty members involved in each course.
  11. Assessment of clerks will be accomplished through a variety of means, which may include written and oral examinations, objective structured clinical examinations, clinical preceptor ratings, as well as any other methods that effectively assess achievement of program objectives.
  12. Assessments of knowledge will focus on the clerk's skill in applying and integrating knowledge to understand biological and clinical phenomena.
  13. Assessment of clinical performance will focus on the clerk's ability to competently function in clinical settings.
  14. Clerkship assessments will present an emphasis on competencies in clinical disciplines, but may also include professional, biological, behavioural and population issues as outlined in the Statements of Competencies for medical graduates, as ratified in the spring, 1997 by the Faculty of Medicine.
  15. The system of evaluating clerks will evolve with the ongoing development and review.

 

Grading System

An 'honours' (H), 'pass' (P), or 'fail' (F) grading system has been adopted for all courses in the curriculum. While an 'H', 'P', or 'F' will be recorded on the clerk's University transcript, the full range of percentage grades and/or a reduced number of grades (does not meet requirements, requires improvement, meets requirements, exceeds requirements) may be used within each department to help arrive at the 'H', 'P', and 'F' designation. The Faculty Senate has approved that the 'honours' designation appearing on a clerk's transcript will be determined by the respective course director at each year's Promotions Committee meeting at the end of each academic year.

 

Grades for the Orientation to Phase IV

This course will be graded on the equivalent of a pass/fail basis. A grade of "P" will be assigned to all passing clerks; a grade of "F" assigned a failing clerk. The criteria of "pass" will be attendance at all sessions, active participation, and the completion of assignments from the various components of this course.

 

Clerkship Grades

Clerks' grades for a course will be derived from course components, usually:

  1. supervisor assessments of clinical performance and in-course assignments,
  2. written examinations conducted at the end of the clerkship, and
  3. oral (and/or internal OSCE) examinations conducted within clerkships.

It is recommended that each department assign equal weights to each of the clerkship grading components.

There will also be a comprehensive OSCE conducted after the conclusion of the year.

Clerks must pass (grade = 60%) all of the components of each clerkship as well as the OSCE to pass the course.

 

A. Supervisor Assessments

Role of the Clerkship Supervisor. At each CTU clerkship site, a clerkship supervisor will be identified who is (ideally) a faculty member. (Depending on the clerkship, the clerkship supervisor may be a site coordinator or the course director.) For clerkships of 6 or more weeks duration, the clerkship supervisor will endeavor to meet with each clerk at the rotation's mid-point to discuss the clerk's self-evaluation, clinical performance based on direct observations and/or preceptor reports, and to provide feedback. In all clerkships, the clerkship supervisor will endeavor to meet with each clerk at the end of the clerkship to review the clerk's progress. If available, the clerk will be provided with a copy of the clinical clerk evaluation form that the supervisor has completed based on the direct observations and preceptors' evaluation observations.

Role of Preceptor. It is recognized that a clerk will be supervised by a variety of clinical preceptors. After spending enough contact hours with a clerk to form judgments of a clerk's performance, each clinical preceptor should complete a brief evaluation form. Preceptor evaluation forms will be developed and distributed by each department. Departments are encouraged to adapt the preceptor evaluation form from the clinical clerk evaluation form that is attached to this Manual. Preceptor evaluation forms are to be distributed to clerks at the start of each clerkship. Clerks are instructed to provide preceptors with these forms following 'meaningful' teaching encounters (ideally, at least 5-10 teaching contact hours) and request the preceptor to complete the form and submit it to the clerkship supervisor assigned to the clerk. Clerks are to provide the names of preceptors who have been given forms to their clerkship supervisor. (Clerkships may specify a minimum number of preceptor forms to be distributed by clerks.) The clinical supervisor will use forms collected from preceptors to discuss each clerk's progress at the mid-point and to determine clerks' summative assessment at the end of the clerkship.

 

B. Written and C. Oral Assessments

The main purposes of the written and oral examinations administered at the conclusion of each clerkship are to provide a sound basis for judging (grading) clerks' progress and to provide clerks with detailed feedback on their progress. These examinations will present a balanced assessment of the full range of competencies expected of clerks at the time of the examination. Each type of examination will focus on the objectives of the clerkships, but implicit within this context is the testing of cumulative program objectives up to the point at which the examination is administered. That is, material from courses from previous phases (e.g., Principles of Human Biology, organ system blocks, or interviewing strategies from clinical skills) will be tested, but will be done so in the context of the content of the Phase IV clerkship. The examinations will also serve, as necessary, to identify clerks who are candidates requiring improvement and offer a remedial examination for these clerks.

A remedial exam refers to an intra-departmental decision to offer a clerk who requires improvement a second written or oral assessment to measure a clerk's competency in identified area(s) of weakness before formal action by the Student Promotions Committee, Years 3 & 4. Note that remedial programs are offered at the discretion of each department: a department may elect to fail a clerk and not offer a remediation program. If a remediation program is offered:

Clerks with a pending remedial examination will have a CIP (currently in progress) mark recorded in their transcript until the course has been completed successfully. Unsuccessful completion of an intra-department remediation program will result in a failure ('F') for that course and the need for a supplemental program (See 'Advancement' below). A supplemental program and assessment for failing clerks will be discussed at the next scheduled Student Promotions Committee, Years 3 & 4.

 

Practice Exams

For participating clerkships, formative practice examination(s) will be presented using the WWW MEDICOL (Medical Integrated Curriculum On-line) site.

If clinical departments participate in the on-line practice exam program, the practice exams will be:

Practice exam(s) may be taken at any time: before, during, at the end, or after the conclusion of the clerkship. The co-ordinator of the practice exam program is Ms Charlene Walsh (cwalsh@unixg.ubc.ca). Charlene would welcome your questions/comments about the practice exams.

 

OSCE Assessment

An objective structured clinical examination (OSCE) using standardized patients will be administered after the end of the Phase IV year to assess clinical skills objectives. Failure in the OSCE will result in required supplemental work during the Phase 6 elective.