• Introduction
• Designing faculty evaluation questionnaires
• Answer Form
• Student Instructions
• Final Preparation of the Forms
• Completing the Teaching Evaluation Survey Sheet
• Interpreting the Faculty Evaluation Program Report
• Sample Evaluation Program Output
  

INTRODUCTION

This handout discusses the correct procedure for submitting faculty evaluations for computer processing at the University of South Carolina. University Technology Services processes faculty evaluations at the end of the Fall, Spring, and Summer I or Summer II sessions. If the guidelines presented in this handout are followed, University Technology Services will process faculty evaluations for any department on the Columbia campus of the University of South Carolina. University Technology Services will also process evaluations for other USC campuses.

This handout was produced by University Technology Services of USC. Questions about submitting evaluations for processing should be directed to 777-1800.
 

For information on our newest Evaluation software, please visit our website at: http://uts.sc.edu/scanningservices/classclimate.shtml

   ----------------------------------------------------------------------

  |                                                                      |

  |                              Charges                                 |

  |                                                                      |

  |    Charges  for scanning  the optical  forms  used for  faculty      |

  |    evaluations are real-money charges:   $.03/sheet,  a minimum      |

  |    $3.00 charge per request.                                         |

  |                                                                      |

   ----------------------------------------------------------------------

 

DESIGNING FACULTY EVALUATION QUESTIONNAIRES

The design of faculty evaluation questionnaires is the responsibility of the individual department. Any set of questions may be used. The only requirements are:

1. All classes within the department must use the same questionnaire.

2. No questionnaire may contain more than 200 questions.

ANSWER FORM

The University of South Carolina Testing Form F327-USC (pdf), available from the Forms and Supply, must be used as an answer sheet for the questionnaire. The testing form is red; it allows up to five possible responses per question, and provides spaces for two keys and a Social Security Number (SSN) at the top right.

STUDENT INSTRUCTIONS

In coding their answers to a questionnaire on the forms, students should be instructed as follows:

1. Use a no. 2 pencil, black or blue ink.
    
2. Do not mark more than one response to any question.
    
3. Do not code any information in the fields labeled SSN, KEY1, and KEY2. Neither your name nor your Social Security Number should be coded on the answer form -- this is a confidential evaluation.
    
4. Only your responses to the multiple choice sections of the questionnaire should be coded on the answer sheets; your comments should be written on the questionnaire itself.
    

Be sure the envelope for the evaluation forms is labeled indicating the instructor, class code, and section number (if applicable). When the forms have been completed, ask a student to collect both questionnaires and forms, to place them (unfolded) in the envelope, and to turn them in at the departmental office.

FINAL PREPARATION OF THE FORMS

Before submitting the forms to University Technology Services to be processed, these steps should be taken:

1. Separate the forms from questionnaires and place only the scanner forms for the class inside an envelope. The envelope must be at least 10 by 13 inches. Do not bind the forms in any manner (no rubber bands, paperclips, or staples, please). Any forms that have been damaged or wrinkled will be rejected by University Technology Services' optical mark reader, so damaged or wrinkled forms should not be included in the envelope.
2. All forms must be face-up and aligned in the same direction. If the forms are not so aligned, some will not be read by the optical mark reader. Your office may be contacted to correct this problem.
3. On a separate testing form, using the KEY1, KEY2, and SSN fields, code information to uniquely identify the class. The following example represents one way (not the only way) this sheet can be coded:

       KEY 1       ==>  Department code

       KEY 2       ==>  Instructor code

 
             | First 3 positions    ==> Course Number

       SSN   | Next 2 positions     ==> Course Suffix

             | Last 4 positions     ==> Section number

The results generated by the evaluation program will be sorted in ascending order based on these class identification fields: first by key1, then by key2, and then by the SSN field.
 

4. The identification form must be placed on top of the other forms for the class when placed in the envelope (any information in the SSN, KEY1, and KEY2 fields on any following forms is ignored by the evaluation program).

5. After all the envelopes for the department have been collected, and processed as discussed thus far, they should be placed in a box and taken to the Information Desk (University Technology Services lobby, 1244 Blossom Street). Upon delivery of the evaluations for processing, a Teaching Evaluation Request Sheet (pdf) must be completed. Instructions for completing this form are outlined in the following section.

NOTE: If forms for different groups of classes are to be processed separately (if for example, graduate classes are to be processed separately from undergraduate classes), the envelopes for each group should be placed in separate boxes and a form filled out for each box.

  
   ---------------------------------------------------------------------- 
    | | | Evaluation forms for all classes in a department must be 
    | | delivered at the same time. | | | 
   ---------------------------------------------------------------------- 
                  

COMPLETING THE TEACHING EVALUATION SURVEY SHEET

The following information must be coded on the Teaching Evaluation Survey Information Sheet.

Date - Fill in the current date.

Account Number - Fill in the University Technology Services' manual charge number for your department or campus (NOT Department/Fund number). Please see account listing if you are not sure of your UTS Account number.

Regional Campus - Fill in your USC campus.

Department - Fill in the name of your department.

Semester - Check the appropriate semester for the evaluations being processed.

Number of Envelopes or Classes - Fill in the number of separate envelopes of forms you are submitting.

Number of Questions - Fill in the number of questions on your evaluation questionnaire.

Overall Average on Questions - Check YES if you desire an overall average for a block of questions on the questionnaire (otherwise check NO). If you check YES, you must also specify numbers indicating the range of questions on the questionnaire to be averaged (the number of the first and last questions to be averaged). If you want a second block of questions on the questionnaire averaged, supply a second range. If you need more than two blocks, add additional request sheets.

Ranked Summary - If an overall average on a block of questions was requested, a ranked summary listing can be obtained for either (or both) blocks of questions averaged. Check YES if you want a ranked summary listing of classes based on overall averages.

Number of Copies - Write in the number of copies you desire.

Title I - Supply the first line of the preferred title for the evaluation report. If left blank, Campus/Department will print on each page.

Title II - Supply the second line of the preferred title of the evaluation report. If left blank, Semester will print on each page.

Person to Contact - Indicate the person to contact in case of problems.

Telephone Number - Supply the phone number of the contact person listed above.

Email Address - Please provide a valid email address where the output should be sent.

NOTE: In completing the form do not enter any information in the fields marked "University Technology Services Use Only".

INTERPRETING THE FACULTY EVALUATION PROGRAM REPORT

The following outlines the format of information reported by the faculty evaluation program. Refer to the example report output in Sample Evaluation Program Output for illustrations.

Title

The user-supplied titles (See Title I and Title II above) are printed as the heading of the report. If no user titles were provided, the name of the campus or department submitting the forms and the semester being evaluated are listed as a running title for the report.

Statistics

Statistics for each class evaluated are printed in ascending order by class code. After individual class statistics have been printed, group statistics (i.e., statistics based on all classes evaluated) are printed.

The statistics calculated for each question on the evaluation form are:

Distribution of responses - the number of students who marked 1, 2, 3, 4 or 5 for each question.

Total Number of Responses - the number of students who responded to each question (missing values are not included).

Mean & Standard Deviation - these statistics are calculated for each question on the evaluation form by class and by group (department or campus). These statistics facilitate comparison of evaluation items.

Overall Average - if an overall average to a block (or to two blocks) of questions was requested, this information is reported under the individual results for each class (by class), and on the group summary (by group). An overall average on a block of questions is often useful in evaluating specific aspects of a course, e.g., the textbook, course content, the instructor.

Ranked Summary - if an overall average was requested for one or both blocks of questions, and a ranked summary of classes was requested for either, this information will be printed at the conclusion of the report.

SAMPLE EVALUATION PROGRAM OUTPUT

If problems are encountered in executing an evaluation run, you will be contacted by University Technology Services.

 
     ---------------------------------------------------------------------- 
      | | | University Technology Services retains evaluation data only for the 
      most | | recently completed semester and for the current 
      semester (no | | more than 6 months). | | | 
     ----------------------------------------------------------------------
        

Following is a running example of sample output generated by the faculty evaluation program. It should be noted that evaluation results for each class are printed out on a separate page. These pages are sorted by the class identification code in ascending order, first by key1, then by key2, and then by the SSN field.

                    FACULTY EVALUATION  -  SAMPLE
                 CLASS CODE : 0001  0010  101  0001


  QUESTION   DISTRIBUTION OF RESPONSES   TOTAL      MEAN        STD. DEV.

   NUMBER     1    2    3    4     5     RESP.  CLASS  GROUP  CLASS  GROUP

 
     1     |  1 |  0 |  3 |  4  |  13  |  21    4.33   4.37    1.04   0.88

     2     |  0 |  0 |  4 | 14  |   3  |  21    3.95   4.75    0.58   1.04

     3     |  0 |  1 |  5 | 11  |   4  |  21    3.86   4.12    0.77   0.95

     4     |  0 |  2 |  3 | 13  |   3  |  21    3.81   3.63    0.79   1.08

     5     |  0 |  1 |  5 |  7  |   8  |  21    4.05   4.30    0.90   0.95

     6     |  0 |  1 |  4 |  8  |   8  |  21    4.10   4.45    0.87   0.77

     7     |  0 |  0 |  6 |  9  |   7  |  21    4.05   4.35    0.79   0.89

     8     |  0 |  1 |  3 |  9  |   8  |  21    4.14   4.03    0.83   1.03

     9     |  1 |  1 |  4 |  2  |  13  |  21    4.19   4.13    1.18   1.08

    10     |  0 |  0 |  4 |  9  |   7  |  21    4.05   3.87    0.84   1.04

    11     |  1 |  1 |  2 |  8  |  10  |  21    4.24   4.22    0.97   0.97

    12     |  3 |  3 |  1 |  0  |   0  |  21    1.90   1.95    0.43   0.45

    13     |  1 |  1 |  1 |  0  |   0  |  21    2.00   2.67    0.31   0.94

    14     |  0 |  0 |  7 | 14  |   0  |  21    3.67   3.59    0.47   0.69

    15     |  0 |  0 |  8 | 12  |   1  |  21    3.67   3.80    0.56   0.69

    16     |  0 |  0 |  1 | 11  |   8  |  21    4.35   4.25    0.57   0.80

    17     |  0 |  0 |  7 | 12  |   1  |  21    3.70   3.81    0.56   0.73

 
     OVERALL (BASED ON QUESTIONS  1-10): 210    4.05   4.10    0.88   1.01


     OVERALL (BASED ON QUESTIONS 11-15): 105    3.10   3.27    1.13   1.13


 

                   FACULTY EVALUATION  -  SAMPLE
                 CLASS CODE : 0001  0010  102  0001


  QUESTION   DISTRIBUTION OF RESPONSES   TOTAL      MEAN        STD. DEV.

   NUMBER     1    2    3    4     5     RESP.  CLASS  GROUP  CLASS  GROUP


     1     |  0 |  0 |  0 |  4  |  28  |  32    4.88   4.37    0.33   0.88

     2     |  0 |  2 |  3 |  8  |  19  |  32    4.38   4.75    0.89   1.04

     3     |  0 |  0 |  1 |  6  |  25  |  32    4.75   4.12    0.50   0.95

     4     |  1 |  0 |  4 | 14  |  13  |  32    4.19   3.63    0.88   1.08

     5     |  0 |  0 |  0 |  6  |  26  |  32    4.81   4.30    0.39   0.95

     6     |  0 |  0 |  0 |  2  |  29  |  31    4.94   4.45    0.25   0.77

     7     |  0 |  0 |  0 |  3  |  29  |  32    4.91   4.35    0.29   0.89

     8     |  0 |  1 |  0 |  4  |  27  |  32    4.78   4.03    0.60   1.03

     9     |  0 |  1 |  0 |  5  |  26  |  32    4.75   4.13    0.61   1.08

    10     |  0 |  0 |  4 |  7  |  21  |  32    4.53   3.87    0.71   1.04

    11     |  1 |  0 |  3 |  3  |  23  |  32    4.53   4.22    0.90   0.97

    12     |  0 | 32 |  0 |  0  |   0  |  32    2.00   1.95    0.0    0.45

    13     |  0 |  2 |  7 |  7  |   2  |  32    3.59   2.67    0.78   0.94

    14     |  0 |  3 | 16 | 16  |   5  |  32    3.47   3.59    0.87   0.69

    15     |  0 |  1 |  6 |  6  |  10  |  32    4.06   3.80    0.79   0.69

    16     |  1 |  1 |  9 |  9  |   7  |  32    3.78   4.25    0.93   0.80

    17     |  0 |  2 |  6 |  6  |  10  |  31    4.00   3.81    0.88   0.73

 
     OVERALL (BASED ON QUESTIONS  1-10): 319    4.69   4.10    0.63   1.01


     OVERALL (BASED ON QUESTIONS 11-15): 150    3.53   3.27    1.15   1.13
 

                   FACULTY EVALUATION  -  SAMPLE

                 CLASS CODE : 0001  0020  101  0002

 
  QUESTION   DISTRIBUTION OF RESPONSES   TOTAL      MEAN        STD. DEV.

   NUMBER     1    2    3    4     5     RESP.  CLASS  GROUP  CLASS  GROUP

 
     1     |  0 |  0 |  0 |  3  |  13  |  16    4.81   4.37    0.39   0.88

     2     |  0 |  1 |  2 |  8  |   5  |  16    4.06   4.75    0.83   1.04

     3     |  0 |  0 |  1 |  3  |  12  |  16    4.69   4.12    0.58   0.95

     4     |  0 |  0 |  6 |  5  |  53  |  16    3.94   3.63    0.83   1.08

     5     |  0 |  0 |  0 |  5  |  11  |  16    4.69   4.30    0.46   0.95

     6     |  0 |  0 |  0 |  2  |  14  |  16    4.88   4.45    0.33   0.77

     7     |  0 |  0 |  1 |  3  |  12  |  16    4.69   4.35    0.58   0.89

     8     |  0 |  0 |  1 |  9  |   6  |  16    4.31   4.03    0.58   1.03

     9     |  0 |  0 |  1 |  5  |  10  |  16    4.56   4.13    0.61   1.08

    10     |  0 |  0 |  2 |  8  |   6  |  16    4.25   3.87    0.66   1.04

    11     |  0 |  0 |  1 |  5  |  10  |  16    4.56   4.22    0.61   0.97

    12     |  0 | 16 |  0 |  0  |   0  |  16    2.00   1.95    0.0    0.45

    13     |  1 |  2 |  7 |  4  |   0  |  14    3.00   2.67    0.85   0.94

    14     |  0 |  1 |  7 |  8  |   0  |  16    3.44   3.59    0.61   0.69

    15     |  0 |  1 |  4 | 10  |   1  |  16    4.69   3.80    0.68   0.69

    16     |  0 |  0 |  0 |  7  |   8  |  15    4.53   4.25    0.50   0.80

    17     |  0 |  0 |  6 |  7  |   3  |  16    3.81   3.81    0.73   0.73


     OVERALL (BASED ON QUESTIONS  1-10): 160    4.49   4.10    0.63   1.01

 
     OVERALL (BASED ON QUESTIONS 11-15):  78    3.35   3.27    1.05   1.13

 

                   FACULTY EVALUATION  -  SAMPLE

                 CLASS CODE : 0001  0030  525 01 0001

 
  QUESTION   DISTRIBUTION OF RESPONSES   TOTAL      MEAN        STD. DEV.

   NUMBER     1    2    3    4     5     RESP.  CLASS  GROUP  CLASS  GROUP



     1     |  0 |  2 |  4 | 11  |   6  |  23    3.91   4.37    0.88   0.88

     2     |  2 |  6 | 10 |  4  |   1  |  23    2.83   4.75    0.96   1.04

     3     |  0 |  6 |  7 |  7  |  12  |  23    3.30   4.12    1.00   0.95

     4     |  2 |  6 |  6 |  8  |  51  |  23    3.00   3.63    1.06   1.08

     5     |  0 |  2 |  1 |  9  |  11  |  23    4.26   4.30    0.90   0.95

     6     |  0 |  1 |  2 | 10  |  10  |  23    4.26   4.45    0.79   0.77

     7     |  0 |  1 |  4 |  5  |  12  |  23    4.27   4.35    0.91   0.89

     8     |  1 |  3 |  7 | 11  |   1  |  23    3.35   4.03    0.91   1.03

     9     |  0 |  3 |  9 |  7  |  14  |  23    3.52   4.13    0.93   1.08

    10     |  2 |  2 | 12 |  6  |   1  |  23    3.09   3.87    0.93   1.04

    11     |  0 |  4 |  2 | 10  |  17  |  23    3.87   4.22    1.63   0.97

    12     |  0 | 21 |  1 |  0  |   1  |  23    2.17   1.95    0.64   0.45

    13     |  0 | 20 |  1 |  0  |   1  |  23    2.18   2.67    0.65   0.94

    14     |  0 |  1 |  5 | 15  |   2  |  23    3.78   3.59    0.66   0.69

    15     |  0 |  1 |  7 | 14  |   1  |  23    3.65   3.80    0.63   0.69

    16     |  0 |  1 |  1 |  7  |  14  |  23    4.48   4.25    0.77   0.80

    17     |  0 |  1 |  7 | 13  |   2  |  23    3.70   3.81    0.69   0.73

 
     OVERALL (BASED ON QUESTIONS  1-10): 229    3.58   4.10    1.07   1.01


     OVERALL (BASED ON QUESTIONS 11-15): 114    3.14   3.27    1.08   1.13

                   FACULTY EVALUATION  -  SAMPLE

                 CLASS CODE : 0001  0040  101  0003


  QUESTION   DISTRIBUTION OF RESPONSES   TOTAL      MEAN        STD. DEV.

   NUMBER     1    2    3    4     5     RESP.  CLASS  GROUP  CLASS  GROUP


     1     |  0 |  1 |  6 |  4  |   0  |  11    3.27   4.37    0.62   0.88

     2     |  0 |  3 |  5 |  3  |   0  |  11    3.00   4.75    0.74   1.04

     3     |  0 |  1 |  3 |  6  |   1  |  11    3.64   4.12    0.77   0.95

     4     |  2 |  3 |  4 |  2  |   0  |  11    2.55   3.63    0.99   1.08

     5     |  2 |  2 |  3 |  4  |   0  |  11    2.82   4.30    1.11   0.95

     6     |  0 |  1 |  3 |  7  |   0  |  11    3.55   4.45    0.66   0.77

     7     |  1 |  1 |  6 |  3  |   0  |  11    3.00   4.35    0.85   0.89

     8     |  0 |  6 |  3 | 12  |   0  |  11    2.64   4.03    0.77   1.03

     9     |  0 |  5 |  4 |  1  |   1  |  11    2.82   4.13    0.94   1.08

    10     |  1 |  3 | 15 |  2  |   0  |  11    2.73   3.87    0.86   1.04

    11     |  0 |  1 |  5 |  3  |   2  |  11    3.55   4.22    0.89   0.97

    12     |  7 |  4 |  0 |  0  |   0  |  11    1.36   1.95    0.48   0.45

    13     |  0 |  0 |  0 |  0  |   0  |   0    0.0    2.67    0.0    0.94

    14     |  0 |  0 |  4 |  7  |   0  |  11    3.64   3.59    0.48   0.69

    15     |  0 |  0 |  3 |  8  |   0  |  11    3.73   3.80    0.45   0.69

    16     |  0 |  0 |  0 |  5  |   6  |  11    4.55   4.25    0.50   0.80

    17     |  0 |  0 |  3 |  8  |   0  |  11    3.73   3.81    0.45   0.73


     OVERALL (BASED ON QUESTIONS  1-10): 110    3.00   4.10    0.91   1.01


     OVERALL (BASED ON QUESTIONS 11-15):  44    3.07   3.27    1.16   1.13

 

                    FACULTY EVALUATION  -  SAMPLE

                 CLASS CODE :      ENTIRE GROUP

 
  QUESTION   DISTRIBUTION OF RESPONSES   TOTAL      MEAN        STD. DEV.

   NUMBER     1    2    3    4     5     RESP.  CLASS  GROUP  CLASS  GROUP
 

     1     |  1 |  3 | 13 | 26  |  60  | 103    4.37   4.37    0.88   0.88

     2     |  2 | 12 | 24 | 37  |  28  | 103    3.75   3.75    1.04   1.04

     3     |  0 |  8 | 17 | 33  |  45  | 103    4.12   4.12    0.95   0.95

     4     |  5 | 11 | 23 | 42  |  22  | 103    3.63   3.63    1.08   1.08

     5     |  2 |  5 |  9 | 31  |  56  | 103    4.30   4.30    0.95   0.95

     6     |  0 |  3 |  9 | 29  |  61  | 102    4.45   4.45    0.77   0.77

     7     |  1 |  2 | 17 | 22  |  60  | 102    4.35   4.35    0.89   0.89

     8     |  1 | 11 | 14 | 35  |  42  | 103    4.03   4.03    1.03   1.03

     9     |  1 | 10 | 18 | 20  |  54  | 103    4.13   4.13    1.08   1.08

    10     |  3 |  6 | 27 | 32  |  35  | 103    3.87   3.87    1.04   1.04

    11     |  2 |  5 | 13 | 31  |  52  | 103    4.22   4.22    0.97   0.97

    12     | 10 | 90 |  2 |  0  |   1  | 103    1.95   1.95    0.45   0.45

    13     |  2 | 43 | 16 | 15  |   3  |  79    2.67   2.67    0.97   0.97

    14     |  0 |  5 | 39 | 52  |   7  | 103    3.59   3.59    0.69   0.69

    15     |  0 |  3 | 28 | 59  |  13  | 103    3.80   3.80    0.69   0.69

    16     |  1 |  2 | 11 | 44  |  43  | 101    4.25   4.25    0.80   0.80

    17     |  0 |  3 | 29 | 53  |  16  | 101    3.81   3.81    0.73   0.73

 

     OVERALL (BASED ON QUESTIONS  1-10):1028    4.10   4.10    1.01   1.01

 

     OVERALL (BASED ON QUESTIONS 11-15): 491    3.27   3.27    1.13   1.13

 

                 FACULTY EVALUATION  -  SAMPLE

          THESE AVERAGES ARE BASED ON QUESTIONS  1 - 10

 
      CLASS CODE             OVERALL          OVERALL       NO. RESP.

                              MEAN           STD. DEV.      PER QUES.

 
  0001 0010  102    0001      4.69            0.63            31.9

  0001 0020  101    0002      4.49            0.68            16.0

        ENTIRE GROUP          4.10            1.01           102.0

  0001 0010  101    0001      4.05            0.88            21.0

  0001 0030  525 01 0001      3.58            1.07            22.0

  0001 0040  101    0003      3.00            0.91            11.0

 

                 FACULTY EVALUATION  -  SAMPLE
 
          THESE AVERAGES ARE BASED ON QUESTIONS 11 - 15


      CLASS CODE             OVERALL          OVERALL       NO. RESP.

                              MEAN           STD. DEV.      PER QUES.


  0001 0010  102    0001      3.53            1.15            30.0

  0001 0020  101    0002      3.35            1.05            15.0

        ENTIRE GROUP          3.27            1.13            98.0

  0001 0030  525 01 0001      3.14            1.08            22.0

  0001 0010  101    0001      3.10            1.13            21.0

  0001 0040  101    0003      3.07            1.16             8.8