About Saint Mary's
Course Evaluations (ICE)
Student evaluation of teaching at Saint Mary's is the full responsibility of the Senate Office. During the evaluation cycle each term, the Senate Office communicates with faculty, prepares the evaluation packages, distributes collects, and acts as a repository for the data collected.
The CAID provides support to faculty related to ICE through this website, and in other ways requested by faculty relating to the developmental/formative aspects of the ICE system. The Centre for Academic and Instructional Development is not involved in any way in the receipt or analysis of data for evaluation purposes.
The optical read machine used to scan the ICE forms is located in a secure room in the CAT, AT 107 (part of the CAID). The data from the scanned forms is received on an ITSS server where the data is compiled into ICE Reports, sent to the Print Centre for printing and delivered back to the Senate Office for distribution to faculty.
The Instructor/Course Evaluation system is designed to provide faculty with student feedback on teaching. Its underlying philosophy is formative (developmental) – the primary function is intended to provide feedback from students that identify teaching practices that contribute to student learning and aid in the further development of those practices. This feedback contributes to teaching quality when it is used by faculty as an opportunity for self-reflection.
The ICE instrument is based on the Student's Evaluation of Educational Quality (SEEQ) developed by Dr. Herbert Marsh, University of Western Australia (currently at Oxford University), and is used in classrooms worldwide. It is a form used to obtain student feedback on teaching for both formative and summative purposes.
When to Use it
At the end of each term, the Senate Office will create an evaluation package for every course being offered in that semester based on information provided by the Registrar's Office (Banner). Packages contain ICE forms equivalent to the number of students registered for the course, a Statement of Procedures for faculty and student administrators, and an Instructor's Acknowledgement Form.
Dates for Evaluation Week are posted on the Senate Office website. Faculty, who intend to evaluate their course(s), would do so within the dates provided.
Why Use ICE?
- ICE is an easy way to get feedback on your teaching.
- It is based on an instrument (SEEQ) developed from years of research on teaching in higher education, and recognized in the research literature for the validity and reliability of the data generated from it.
- It provides formative information which can be used by faculty to reflect on and improve teaching.
- It provides summative information which can be included in documents (Annual Report, Teaching Dossier) developed by faculty to apply for tenure, promotion or review.
- The process developed at Saint Mary's guarantees confidentiality of the data collected.
- Use of ICE each semester increases student involvement in the process.
This form is based on the student form, however the questions are reframed as reflective statements to be considered by faculty in relation to the course being evaluated. It is useful to begin by reflecting on how you expected students will respond to the questions. This form is purely for your use, and you can compare your with the student data/report. It is helpful to download and complete a Self-Rating Form for each course prior to viewing the final reports generated from the student evaluations.
The ICE form is a double sided, pre-printed, bubble sheet containing:
- 29 closed response questions related to eight functional areas of teaching. These areas – learning, individual rapport, enthusiasm, examinations, organization, breadth, group interaction and assignments – have been recognized in the research literature as time-tested, recognized functions of good teaching which contribute to student learning,
- 2 overall (global) questions,
- 9 questions related to course characteristics and student data,
- 12 supplemental questions (optional), and
- 2 open ended questions
Faculty should allow approximately 15 minutes of class time for students to complete the evaluation form.
The ICE system at Saint Mary's recognizes that not all teaching modes are covered by the 29 core questions. Teaching has changed in recent years with the introduction of technology in the classroom and with increased emphasis on pedagogical innovations such as service learning, cooperative education, etc. The Supplemental Questions option provides an opportunity to add twelve questions customized to your particular evaluation needs.
You can write your own ‘supplemental questions', or select questions from the Data Bank to download into the Supplemental Questions Template.
To use the Supplemental Questions option, bring the completed template to class as a PowerPoint slide and display for the class before the evaluation process begins. Instructors should ensure that a copy of their Supplemental Questions template is included in the envelope to be returned to the Senate Office.
- The Senate Office section provides dates for Evaluation Week for the current academic year.
- Instructors should allow 15 minutes of class time for administration of the ICE.
- It is not possible to alter any of the individual items on the ICE form.
- Instructors may develop a Supplemental Questions sheet and either write their own supplemental questions or select them from categories/questions provided in the Data Bank.
- Instructors should identify a student to be the Student Evaluation Administrator prior to evaluation day
- After the instructor has left the classroom, the Student Evaluation Administrator will read the Statement of Purpose and Procedures to students (provided in the evaluation package) and administer the evaluation.
- The Student Evaluation Administrator must return the package to the Senate Office immediately following the evaluation, or immediately following the end of class. Envelopes not returned within that timeframe may not be processed by the Senate Office.
- Original ICE forms will be returned to instructors as they contain student responses to the two open-ended questions. These comments will not be transcribed or centrally kept. These forms will be returned at the same time as the reports generated from the closed response questions.
- Individual faculty should retain paper copies of their Reports and original (or transcribed) copies of student responses to the open-ended questions.
- Research on student evaluations suggest that they are quite reliable when based on the responses of ten or more students. Ratings based on fewer than ten student responses should be interpreted carefully.
Directions for Administering
- Directions for the Instructor
- Directions for the Student Evaluation Administrator
- Statement of Purpose and Procedures - to be read by the Student Evaluation Administrator after the instructor has left the classroom
- Chair of Senate: Dr. Don Naulls, Department of Political Science
- Secretary to Senate: Barbara Bell, Sobey 202, 902-420-5412
- Instructor/Course Evaluation Form
- Supplemental Questions Template
- Supplemental Questions Databank
- Sample Instructors Report
- Sample Summative Report
- September 2012 - August 2013
- September 2011 - August 2012
- September 2010 - August 2011
- September, 2009 - August, 2010
- September, 2008 - August, 2009
- September, 2007 – August, 2008
- September, 2006 - August, 2007
All reports generated each term are kept electronically on a server maintained by ITSS.
Student responses to open-ended questions will not be centrally transcribed but will be returned to faculty on the original ICE forms completed by students during the evaluation. These forms will be returned at the same time as the Reports – after all grades for the term have been submitted to the Registrar's Office.
The ICE system at Saint Mary's is used for both formative and summative evaluation purposes.
- Formative Evaluation
- Summative Evaluation
- Reflecting on Student Feedback – A Developmental Framework
The primary role of the ICE system is to provide data that can be used by faculty to make improvements in teaching. Improvements might eventually affect tenure and promotion decisions, but the primary intent in formative evaluation is faculty development. For this reason, the data generated by ICE on the Instructor's Report will be seen by individual faculty only and will allow instructors the opportunity to review student data and open-ended comments, compare this with their own self-rating for the course, and interpret the data in an attempt to understand the feedback given by students, and how that feedback could inform individual teaching improvement.
Based on recommendations in research literature, the ICE system at Saint Mary's provides academic administrators the results of the two overall or global questions only for summative decision making purposes on both the Summative Report and the Annual Summary.
To help instructors reflect on the feedback provided by students, the following framework is recommended.
- Download and complete the Self-Rating Form
Think about what happened in this course this term? Was the class a positive experience for you? For students? Why? Did things go as planned? Why not? What will students say about the course, about their learning experience?
- Analyze the Student Data section of the Instructor's Report
What special or unique features are there in regard to the subject, the students or other contextual factors?
- Analyze the Instructor's Report.
What are the main strengths of your teaching? What are the main weaknesses? Do these findings differ from your Self-Rating Survey responses? How?
- Analyze Students' Comments to the Open-Ended Questions
The original ICE forms completed by students will be returned to instructors because they contain student responses to the open-ended questions, as they were written. You might wish to record them in a Word document or Excel file for future reference. Read through all comments carefully and categorize them in order to identify common themes. Students often use this opportunity to include comments on teaching methods, learning activities or assessment items that worked well for them in other courses - use this information to your advantage. What characteristics of instructor/course did students find most valuable to their learning? What characteristics of instructor/course did students suggest needed improvement? How do the comments compare to the ratings on the Instructor's Report? On your Self-rating survey?
- Select Key Areas for Improvement
Which are the one or two areas that received the lowest ratings? Check the Instructor's Report for specific responses and the open-ended comments to supplement information. What strategies for improvement could you use that would be appropriate to your particular situation?
- Take Some Follow-Up Actions
After reflecting on the responses to the above questions, consider referring to the Targeted Teaching Strategies booklets or other resource materials held in the CAID to help increase your knowledge. Engage in further reflective practice by conducting some form of classroom-based research into different teaching and learning approaches and techniques, such as asking your students about their needs, their perceptions of teaching and learning, or what constitutes successful practice in the classroom. Invite a colleague to act as a mentor, to review your Instructor's Report and students' comments and to discuss possible strategies for achieving improvement. Ask for a meeting with the Director, CAID or Instructional Development Associate, to discuss your students' feedback and strategies for improvement. A colleague or the CAID need not have expertise in your subject area or even know what is "best". Their role can be that of facilitator, discussing the feedback with you and helping you to think of some strategies in areas you have identified for development.
- Closing the Loop
Through the evaluation process, students have provided important feedback to help you identify your teaching strengths and areas for improvement. To acknowledge their part in the I/CE process, you could tell students in a following course or students enrolled in the same course when it is running again, about the changes you have made based on the feedback/comments from previous students. By doing this, students will feel that their opinions are valued and they have made constructive input into how they are being taught. Keep a record of what you have learned, how you have responded to student feedback – and use this information to develop your Annual Report and, over a longer period of time, your Teaching Dossier.
In developing the Student Evaluation of Educational Quality (SEEQ) instrument, Dr. Herbert Marsh also wrote a series of instructional development booklets related to each of the key factors of the SEEQ – the same key factors which comprise Saint Mary's ICE form.
In more recent years, the teaching strategies booklets were reviewed and revised for the Canadian context by Dr. Beverley Cameron, University of Manitoba. They are reproduced here with the permission of Dr. Marsh and Dr. Cameron.
- Learning & Academic Value
- Instructor Enthusiasm
- Organization & Clarity
- Group Interaction
- Individual Rapport
- Breadth of Coverage
- Exams & Graded Material
- Assignments & Readings