Educational Policy Council/Information Management Policy Committee

Information Technology Subcommittee  

October 2, 2001 Meeting Notes

Present:  David S.  Resch, MD, Chair; Terri Cameron, MA, Staff; Michael Bass, Class of 2004; George Dunaway, PhD; Rhona Kelley,  MSLS; Regina Kovach,  MD; Scott MacGilvray, MD; Claudia McIntyre MS; Dean Naritoku, MD; Michael Shanahan, PhD; Akshay Sood, MD;

Absent:  Rafath Baig, Class of 2003; Rodney Curtis, MD; Ryan Diedrich, Class of 2005; Gary Dunnington, MD; Jeffrey Suzewits, MD

Guest:  Hurley Myers, PhD

• Hurley Myers explained the Online Self Assessment Software System was developed by DxR Group as part of Curriculum 2000 to ensure that students had a mechanism for a means of assessment to keep them on track between the three major exams in Years 1 and 2 and as a tool for United States Medical Licensing Examination (USMLE) practice and preparation. Faculty-generated questions in National Board of Medical Examiner (NBME)-format (4 or 5 item multiple choice with one best answer) are linked to curriculum cases, organ systems, and/or disciplines, as well as being automatically linked to departments based on question author.  Students use the system to generate exams that randomly pull questions from the bank based on the criteria students choose (case, organ system, and/or discipline).  They can choose the number of questions per exam and whether they should have one or two chances to enter the correct response before it is provided by the system.  There is a “reference” option, where faculty can provide explanations for the correct and incorrect responses, but that has been used only minimally by faculty.  The software is set up to emulate the USMLE computer-based exam, with item marking and review options.  Each student’s exam statistics are retained for their review.  A report generator that will allow faculty to review aggregate student performance by case, organ system, or discipline is nearing completion.  While the initial plan for the system was student self-assessment, the system can be used for both formative and summative assessment.  The biggest challenge has been to get case-specific questions for the system.  Functionality continues to be added as requested.  Students are also being given access to another DxR USMLE preparation software that contains about 1,500 questions that DxR purchased from authors across the country.

In the discussion that followed, the lack of questions in the Online Self Assessment System was discussed.  It was recommended that Year 1 questions, which are currently distributed on paper, be obtained for use by students in Years 2, 3, and 4, via the online self-assessment system.  This would provide a mechanism for faculty to review student performance on key curriculum content over time and another means of integrating basic science into Years 3 and 4.  It was also suggested that multidisciplinary teams be developed to work together to develop cases, tutor guides, and questions that can be used across the curriculum.  Dr. Resch will take these two recommendations to the EPC.

• In response to a request for regular updates of the tools and training options available to faculty, Ms. Kelley explained that e-mail announcements of the monthly training sessions are currently distributed via e-mail to all faculty, staff, and students, and that a link to the Library website is included in the e-mail. 
• The preliminary results of the Information Technology Needs Assessment Survey were briefly reviewed.  Seventy-four faculty and 35 student responses had been received to date.  Students will be sent an e-mail reminder about the survey to try to increase the response rate so that the data can be the major discussion item at the next meeting and provide the basis for planning the Technology Fair.
• The next meeting of the subcommittee is scheduled for Tuesday, November 6, from 9:30 to 10:30 a.m.