College of Nursing

Ph.D. in Nursing Science

I. Teaching Evaluation Process

Teaching evaluations for doctoral faculty follow the same procedures as those used for all College programs but with greater expectations in meeting the criteria. The College follows an evaluation plan which includes teaching (TEQ) and course evaluations (CEQ), program assessment by students and faculty (PAQ-S; PAQ-F), and employer and alumnus evaluations (PAQ-E; PAQ-A). In the last two weeks of class, by prearrangement between the Office of Research (OR) and individual faculty members, OR staff visit classrooms to obtain evaluations of courses and teachers from students. College evaluation forms are used, as well as the University mandated questions. TEQs are statistically analyzed and results are returned to the faculty member with copies sent to the Department Chair. CEQs are also sent to the Graduate Director and the Graduate Committee, who use the results in evaluating courses. In addition, faculty obtain peer evaluations from faculty of equal or higher rank and submit both peer and teaching evaluations, to the College Tenure and Promotion Committee and to their Department Chair as a part of the annual review process.

The purpose of the PhD in Nursing Science program is to prepare nurse researchers to influence the quality of local, regional, national, and international health care. To achieve the purpose, the program goals are to prepare graduates for a lifetime of intellectual inquiry that manifests itself in creative scholarship and research. Intended outcomes are that (1) students are successful in completing the program requirements in a reasonable period of time, (2) graduates are adequately prepared to begin their careers, and (3) graduates will be employed in settings appropriate to their educational preparation.

1. Success in Completion of Program
   
   Qualified students are admitted to the PhD program. The average GRE score of admitted students over the past three years was 1055. Since the PhD program was initiated in 1987, the average time to complete the program is 4.75 years. During the past five years, the average time to complete the program was 4.5 years.


2. Program Assessment Plan
   
   The College evaluation plan provides the framework for collection and dissemination of data about all educational programs. Within this plan, data are obtained from students at the completion of each nursing course, at the completion of the program, and as alumni at one, two, or three year intervals after graduation. Input is obtained from faculty at three year intervals (Appendix C, College of Nursing Evaluation Schedule). Students, faculty, and alumni are strongly encouraged to participate in the program evaluation process; however, participation is voluntary. Data are obtained primarily through structured questionnaires, referred to as course evaluation questionnaires (CEQ) or program assessment questionnaires (PAQ). These questionnaires are distributed through the College Office of Research, and the data are computer analyzed. Results are distributed to pre-identified individuals or groups who are responsible for using the results for program improvement. Computer analyzed results for the past several years are available on exhibit in the College.
   
   During the administration of the CEQs, students are provided an opportunity to add written comments. Transcripts of these comments accompany the computer printouts for distribution to appropriate individuals, groups, or committees.
   
   The PAQs include categories of items in the areas of academic support, learning resources, curriculum, and program objectives. For interpretation purposes, a guide has been established and is presented in Table 1. In addition, PAQ items with high and low ratings are reviewed to determine strengths and weaknesses of the program.

Table 1. Guide for Interpreting Program Assessment Data

Criteria for Interpretation of CEQs/PAQs	4-point scale*
Course/Program Satisfaction	At Least 2.5
Course/Program Weakness	2.0 or Below
Course/Program Strength	3.0 or Higher



3. Course Evaluation Results

Course evaluation summary ratings by students are presented in Table 2. Courses must have enrollments of at least 3 students for CEQ data to be reported. A review of these results indicates that students generally rate courses quite high. Only one course (NURS 802) received an average rating less than the 2.5 criterion for satisfaction. This rating was for one semester only; three other offerings of the same course obtained ratings greater than 3.0. Two other courses (NURS 800 and NURS 811) show a single rating less than 3.0 among several offerings with much stronger ratings.

Table 2. Course Evaluation Ratings by Students from 1994 to 1999

Course	1994-1995	1995-1996	1996-1997	1997-1998	1998-1999
800	2.94	3.57	3.65	3.66	4.00
801	3.79	3.85	3.87	*	3.73
802	3.38	2.41	3.86	3.90
803			3.39	3.50	3.90
810	3.19	3.70	3.38	3.42	3.03
811	2.54	3.94	3.52	3.80
812		3.89		3.50
813	3.20	3.15	3.83	3.83	3.92
840				3.87
850
870		3.64		3.94

*less than 3 students

4. Program Assessment Results
   
   Graduating students assess their entire program during their last semester of study. Using a corollary questionnaire, graduate faculty evaluate the program once every three years. Student data are reported for the time period from 1994 to 1999. The faculty three-year assessment point during this time frame is fall 1996. The next assessment point is fall 1999. Faculty and student average ratings on items in the areas of academic support services, learning resources, curriculum components, and program objectives are presented in Table 3. Surveys were not distributed in 1998 and 1999 due to small sample sizes (<2) inadequate in number to achieve anonymity of student responses. Results of the 1998 and 1999 survey results have not been calculated due to small sample sizes. As additional returns are available data from these surveys will be analyzed and reported.
   
   Table 3. Faculty and Student Ratings on the Program Assessment Questionnaire

   	N=9 Fac S96	N=4 Stud S95*	N=3 Stud F96**	N=4 Stud Sp96***	N=3 Stud Sp97***
   Academic Support Service	3.00	3.70	3.46	3.12	3.25
   Learning Resources	3.56	3.56	3.55	3.40	3.00
   Curriculum Summary	3.06	3.76	3.56	3.27	3.40
   Program Objectives
   1. Knowledge and skills to conduct research which is theory-generating and/or theory-testing.	3.56	3.75	3.67	3.75	4.00
   2. Ability to generate and refine nursing science as the basis for nursing practice, education and administration.	3.56	4.00	3.67	3.75	4.00
   Note: *Fall 1994 and Spring 1995 students are included. **Fall 1995 and Spring 1996 students are included. ***Surveys administered one time each year.

   
   In all areas of assessment, student and faculty average ratings were at least 3.00. Faculty average ratings in the area of curriculum were much lower than student average ratings. An examination of responses to individual items reveals that faculty rated items on the research component much higher than they did for items on opportunities for students to engage in scholarly dialogue with peers, nursing faculty or faculty from other disciplines. This distinction in faculty ratings on scholarly dialogue may be due to scheduling of doctoral courses on one day to meet commuting student needs.