Minutes

Educational Policy Council Meeting

November 12, 2001

Carbondale:  Lindegren 310/Springfield:  Lincoln Conference Room


Present:

Peter T. Borgia, PhD

Terri Cameron, Staff

Donald A. Caspary, PhD

Phillip V. Davis, PhD

Linda H. Distlehorst, PhD

Sharon K. Hull, MD

Jerry A. Kruse, MD

Matthew Lavery, Class of 2003

Theodore R. LeBlang, JD

Joelle Lipcamon, Class of 2004

Tracy K. Lower, MD

Chris McDowell, Class of 2005

David S. Resch, MD

Michael F. Shanahan, PhD

Sandra L. Shea, PhD

David R Wade, PhD

Reed G. Williams, PhD


Absent:

Amber Barnhart, MD

Erik J. Constance, MD

Clint Farris, Class of 2002

Regina A. Kovach, MD

Dean K. Naritoku, MD


Guests:

Catherine Holloway


 

Discussion Items

1.         Minutes

Dr. Davis made a motion, seconded by Dr. Resch, to approve the October 8 minutes with the following change to the Year 1 Curriculum Report:  the word plastinated should replace the word clastidated.  The motion was unanimously approved.

 

Dr. Caspary suggested that a formal mechanism be established to follow up on issues brought up in the minutes.

2.         Announcements

Dr. Distlehorst announced that the Department of Medical Education would be presenting a Grand Rounds on at 4 pm November 27 in the Pearson Museum, with Dr. David Rogers from the Department of Surgery discussing “Can the Teacher Be a Machine:  Using Computer-Assisted Learning to Teach Surgical Skills.”  She also announced that an advisory panel had been formed to review the future directions of the Department of Medical Education and the institution related to research and development.

 

Dr. Williams announced that Dr. David Davis would be presenting his research on CME outcomes at the Surgery Grand Rounds at 7 am Thursday, November 29, in the Wedeberg Conference Center at Memorial Medical Center.

3.         USMLE Step 2

Dr. Distlehorst distributed an updated version of the USMLE Step 2 data, which included results for the Class of 2001.  This information was also distributed to the Year 3 Curriculum Committee for discussion.

4.         Human Subjects Approval for Educational Research

Dr. Williams provided a brief summary of two articles discussing whether program evaluation data should be considered human subjects research.  (Henry, Rebecca C., and Wright, David E.  “When do Medical Students Become Human Subjects of Research?  The Case of Program Evaluation.”  Academic Medicine (76) 9:871-875 and Roberts; Laura Weiss; Geppert, Cynthia; Connor, Renee; Nguyen, Khanh; and Warner, Teddy.  “An Invitation for Medical Educators to Focus on Ethical and Policy Issues in Research and Scholarly Practice.” Academic Medicine (76) 9:876-885.)  He explained that this issue will come under closer scrutiny in the future.  One analogy used in the articles is that program evaluation data is often used by faculty in the same way that physicians use case studies, e.g., the intent of the project changes after IRB approval has been received.  Rebecca Henry’s article points out that Michigan State now requires that program evaluation results be discussed with students when they matriculate, describing how results will be used and the limits of the usage.  The topic is presented under the umbrella of professionalism, and students are allowed to refuse to allow their data to be included in research, but are not allowed to excuse themselves from program evaluation.  Laura Roberts’s article provides a set of scenarios for review as to where IRB approval data is required.

 

It was suggested that a policy regarding program evaluation and curriculum data should be delineated, codified and promulgated.  Two methods were suggested:  1) guidelines should be developed by the Institutional Review Board and/or the Office of the Associate Dean for Faculty Affairs and Research, or 2) a subcommittee consisting of members of the EPC, RPC, and SCRIHS should be established to develop a proposal. 

 

Dr. Davis made a motion, seconded by Dr. Williams, to ask Dr. Edward Moticka, as Associate Dean for Research and Faculty Affairs, to empanel a subcommittee with membership from the Educational Policy Council (EPC), Research Policy Committee (RPC) and Springfield Committee for Research Involving Human Subjects (SCRIHS) to delineate, codify, and promulgate a policy regarding program evaluation and curriculum data.  The motion passed unanimously.

5.         Vertical Integration

Mr. Lavery provided a report to Dr. Kruse in follow-up to the EPC’s discussion regarding vertical integration.  This issue was tabled until the next meeting.

6.         Educational Products Conflict of Interest

Dr. Kruse explained that there had been much discussion regarding potential educational products conflict of interest in the past few months and said that it had been suggested that this topic be placed on the EPC agenda.  Dr. Caspary explained that he had brought this issue to the EPC due to the fact that he felt that CCX software was pushed heavily in the curriculum by individuals who appeared to have a financial interest in the software. 

 

Dr. Kruse explained that he had investigated the issue and learned that Dr. Hurley Myers developed CCX software in response to a request from the former Post-Clerkship Exam (PCX) Committee when the mainframe PCX software developed at SIU ceased to function.  Dr. Myers provides both the CCX and DxR software to SIUSOM at no charge and works with staff on a regular basis to update programs as necessary to meet SIUSOM curriculum needs and changes.  Names of faculty who played a major role in the development of the software are listed on the opening screens as acknowledgement of their efforts.  There was discussion as to whether the DxR Group (which develops the software under Dr. Myers’ direction) is benefiting from SIU’s use of the software as it sells the software to other institutions.  It was noted that SIU also receives much recognition regionally and nationally for development of the software and the assessment methods the software supports.  It was also stressed that no CCX cases developed by SIU faculty and staff are sold with the software, and that, although some SIU faculty were paid for case development in the past, the practice of contracting with SIU DxR case authors to sell their cases with DxR software has been discontinued.

 

Dr. Lower explained that she had chaired the Curriculum 2000 Assessment Study Group, which had spent months performing a comprehensive literature review and discussing all options for assessment and their potential value as assessment methods for the curriculum being developed.  The results of this study were developed into a set of recommendations, the main one being that a consistent approach be used that emphasized performance-based demonstration of knowledge.  Since the CCX was already being used in Years 3 and 4, it was chosen as a comprehensive tool for evaluating student interactions with patients that could be tracked across all four years of the curriculum.  This method also allows evaluation of basic science knowledge to be integrated into the assessment process.  It was noted that, although the software is currently being used for a function for which it was not initially designed, it is constantly being revised to meet new needs.  It is currently being revised to allow longer stems and responses, as faculty have requested.  A major enhancement currently being discussed is an import/export feature that could be used in conjunction with other assessment software for item analysis and item banking.

 

There was discussion as to whether the EPC should develop a policy to prevent potential problems in the future.  The policy might cover financial disclosure statements and conflict of interest scenarios that deal with situations such as this.  For instance, while it is documented that students cannot be required to purchase textbooks and software written/developed by faculty, if there is a policy prohibiting use of textbooks/software developed by faculty at no charge, it is not documented.

 

It was suggested that the current Conflict of Interest and Commitment Policy should be reviewed to determine if it covers this situation. 

7.         Class of 2001 Graduation Questionnaire

Dr. Distlehorst distributed two documents that summarize the AAMC Graduation Questionnaire.  The entire questionnaire and the comments will be distributed electronically prior to the next meeting.  Two options were offered for reviewing the data:  by student number or by strengths and weaknesses.  EPC members requested the strengths and weaknesses version.  It was noted that there are multiple comments regarding Curriculum 2000 from these students, although this group of students had no direct contact with the new curriculum.  In addition, clerkships that have historically been noted as having deficiencies are showing improvement over the past three years.  In many areas, SIU students have rated the curriculum more highly than their counterparts at other US and Canadian medical schools.

8.         Committee Reports

8.1      Year 1 Curriculum Committee

Dr. Wade reported that students are about to complete the first of the three Year 1 segments and that they are beginning to feel some anxiety as the date for the first exam gets closer (week of November 19).  The Year 1 Curriculum Committee is preparing a recommendation for increasing the length of the year by three weeks.  The recommendation will be forwarded to Dr. Kruse prior to the December meeting. 

 

Mr. McDowell reported that students are noticing the steepening of the learning curve and getting ready for exams.

8.2      Year 2 Curriculum Committee

Dr. Borgia reported that he had been named the Year 2 Director.  The first exam in Year 2 is also scheduled for the week of November 19.  A subcommittee has been working steadily to plan for Year 2 in the 2001-2002 academic year (organization of the year, issue of rotation, balance between basic science and clinical activities, and objectives for clinical activities).  Discussions by this group have been somewhat contentious, but the group is working diligently to prepare a set of recommendations for the December EPC meeting.  The Exam subcommittee continues to discuss guidelines for assessment in Year 2 and implementation of those guidelines.  As soon as the first exam has been administered, the efforts of this group will turn toward evaluation of the assessment software and will be discussing the needs of the curriculum with the EPC/IMPC IT Subcommittee.  The Student Progress Subcommittee has distributed a draft of a revised Student Progress System document for Year 2.  The Faculty Evaluation subcommittee distributed a set of draft recommendations at the last meeting.  The recommendations were briefly discussed, but no action was taken.

 

Ms. Lipcamon reported that students were getting ready for exams.

8.3      Year 3 Curriculum Committee

Dr. Kruse reported that the Year 3 Calendar Subcommittee continues to evaluate potential calendars for the 2002-2003 Academic Year and to document basic science integration in Year 3.

8.4      Year 4 Curriculum Committee

Dr. Lower reported that the Year 4 Curriculum Committee has completed its review of elective course feedback and is now sending out the Call for Electives, with emphasis on increasing the number of Basic Science Electives. 

8.5      Four-Year Doctoring Streamer

Ms. Cameron reported that Dr. Barnhart would be bringing an overview for the four-year Geriatrics experience to the EPC for discussion as a component of the Doctoring Streamer.  The Year 3 Curriculum Committee voted to forward a recommendation to the EPC that the Doctoring Director be given authority to provide student performance data regarding the four-year experience to the Student Progress Committee.  This issue will be on the December EPC agenda.

9.         EPC Subcommittees:

9.1      Educational Value Unit Task Force

Dr. Kruse reported that he would be meeting with Dean Dorsey to discuss this subcommittee.  Dr. Steward has compiled a report based on the previous questionnaires and has prepared a follow-up questionnaire for distribution, based on discussions with Dean Dorsey.

9.2      Genetics

Dr. Kruse reported that he would be meeting with Dr. Steward to discuss this subcommittee and that the group would be meeting this month.

9.3      Faculty Development

Dr. Caspary asked for clarification regarding how this group would interact with faculty education efforts by the Office of Education and Curriculum and commended OEC for their efforts to date.  Dr. Kruse responded that the Faculty Development Subcommittee should address this issue and delegate responsibilities as the group felt appropriate.

9.4      Information Technology

Dr. Resch reported that the group continues to meet and has been reviewing the Information Technology Needs Assessment Survey and the concept of a monthly Technology Fair, with content such as assessment software, database issues, etc.  A list of specifications for assessment software is being developed for distribution to vendors for demos, etc.  Curriculum committees will be contacted regarding assessment specifications from a test design and reporting format.

9.5      Program Evaluation

Dr. Distlehorst reported that the subcommittee met at the end of October and that Dr. Dawson would be assuming the role of chair.  All data collection methods will be reviewed in comparison with the initial report by the C2000 Program Evaluation Study Group.  Dr. Scott Obenshein from New Mexico will be conducting an external review after the first of the year.  New Mexico combined their curricula approximately 10 years ago.  Program evaluation data from all four years of the curriculum is being prepared for distribution to the library.

10.      Next Educational Policy Council Meeting:  Monday, December 10, 2001, 1:30 to 3 pm.