Institutional Effectiveness Summary Report

 

August 1, 2001

 

 

 

University of South Carolina Spartanburg

 

Introduction

US News & World Reports (2001) rated USC Spartanburg as one of the top public liberal arts in the South. As this rating and other indicators continue to confirm the path of the institution to become a leading metropolitan university in the Southeast, this summary report reflects the commitment of the University to academic excellence. Selected academic programs (based on a cyclical rotation) in this report have demonstrated significant assessments of learning outcomes with correlated program improvements and modifications.

 

This summary report includes assessment results and outcomes for the following components:

Biology | French | Spanish | Criminal Justice

 

The remaining components will be reported as follows:

 

 

1. General Education

This component was last reported in the 1999 Institutional Effectiveness Report. Based on the schedule of reporting, it will be assessed again in 2003.

 

2. Majors or Concentration

Major/concentration planning and assessment are performed in concert with the University=s mission and strategic plan. The assessment unit coordinator for each major compiles the assessment report under the guidance of department faculty members and submits that document to the university Academic Assessment Committee. The Assessment Committee, in turn, reviews each plan/report and either: (1) approves the reports or (2) returns them to the unit coordinators with suggestions of refining measurements or clarifying goals. Presently for this summary, the following majors have used the corresponding assessment instruments for the approved reports:

 

  Majors

Assessment Instruments

Biology

French

Spanish

Criminal Justice

Alumni Survey

X

X

X

X

Graduating Seniors Survey

X

X

X

X

Capstone Course

X

X

X

X

Exit Interviews

X

X

X

X

Oral Reports

X

X

X

X

Portfolios

 

X

X

 

National Exam

X

 

 

 

Local Exam

X

X

X

X

Employer Survey

 

 

 

X  

Senior Project

X

X

X

X

Course-embedded

X

X

X

X

Student Evaluation Forms

X

X

X

X

Self Assessment Procedures

X

X

X

X

 

Biology

There is a clear relationship between biology course performance and performance on outside measures of knowledge. There are positive, statistically significant relationships between Biology GPA and performance on the Biology Major Field Assessment Test. Biology program graduates expressed a satisfaction level similar to the level of all USCS alumni (93%). The majority (74%) of students successfully completing Biology Senior Seminar demonstrated satisfactory oral communication skills. Biology graduates were weakest in their writing skills. Students are required to rewrite student papers in Biology courses and a standard writing guide is used for Biology courses. Ethics is emphasized in Senior Seminar and has some coverage in at least nine other Biology courses. Information sheets on the major and on pre-professional options are revised yearly. Biology graduates expressed higher satisfaction levels with academic advisement compared to the overall USCS alumni population (78% vs. 72%). Membership is maintained in the National Association of Advisors of Health Professionals and National Academic Advising Association and advising information from both organizations are disseminated to faculty. Biology faculty sponsor four science-related student organizations, including a Health Professionals Club, to increase health career awareness among students. Seven of ten faculty have sponsored internships, and a listing of internship opportunities was created and distributed. Five faculty currently sponsor independent undergraduate research, and significant research experiences occur in at least two senior-level courses. All ten Biology faculty provide public service, and nine have served on the Piedmont Regional Science Fair Committee. Coverage of science achievements by scientists of different cultures and gender is included in several courses and textbooks. Availability of courses that serve Nursing students was increased. General education coursework dependence upon part-time faculty has been reduced, but we continue to request additional new full-time faculty to help in this area. The biology curriculum has been revised to address current and future needs of our majors, with several new courses in development. Implementation of the curriculum revision has been delayed due to a shortage of full-time faculty. Biology 2+2 degree programs are in place with two area Technical Colleges and a local independent junior college, which facilitates transfer between schools. Application for establishing a science honor society to recognize outstanding majors will be made next year.

For additional information concerning this program assessment summary, please contact David Ferris, the assessment unit coordinator.

 

French & Spanish

It is important to note the Foreign language program at USCS is relatively new. In fact, there have been only four graduates of the program since the program began in 1995; currently (Fall 2000), there are 20 students majoring in Spanish or French. With the limited number of graduates to base student learning outcomes, it is inappropriate to reveal those assessment results to the general public due to confidentiality issues. Moreover, outcomes based on a population of four could have serious variations which may or may not reflect on the curriculum. As such, this interim report demonstrates the framework of assessment the faculty employs as the program grows and some programmatic changes resulting in faculty discussions.

The foreign language faculty as a whole conducts assessment of the Spanish and French majors individually, as each faculty member conducting an upper level language or literature course evaluates his or her students' papers and portfolios complied for various courses. Generally, the faculty member places on file papers, reports and/or projects from students with or without corrections or comments. The individual instructor usually retains the corrected versions of such papers with his/her rubric for grading attached to each paper, report or project submitted. The professor conducting the course evaluates the Spanish/French Senior Seminar papers and the oral presentation of the senior seminar project is evaluated in written format by the entire foreign language faculty present during the oral presentation. However, the faculty member conducting the course gives the final grade for the written paper. As a means of improving assessment of the foreign language program as a whole, students are asked to compile a portfolio of papers, projects, and reports that they have submitted during their years of study at USCS. At the close of their studies at USCS, preferably in the last semester, students will be asked to evaluate their portfolio material in line with the goals of the Foreign Language Program. After students' self-evaluation of portfolios, faculty members in the specific language area will also evaluate these portfolios in line with the goals of the foreign language major. Following this evaluation, faculty members will convene to discuss the results and make recommendations for program course revisions or additions. In addition, students are given a survey sheet to be completed at the end of the Senior Seminar course. This survey is also used to assess the Fl program here at USCS.

Because a high level of proficiency is the aim of the Foreign Language Program here at USCS, students' speaking skills are also tested by means of a laboratory oral test. Students are asked to record their responses to various prompts and the pronunciation of a series of short phrases they hear. Foreign language majors will be held to a high standard of pronunciation on all speaking tests. Another type of speaking test, the progress interview, is now being used in some language courses. The questions for this interview are carefully chosen to evaluate control over specific structures, vocabulary, and situational contexts that have been emphasized in the course. The goal is to produce foreign language graduates who can speak, read, write and comprehend the target language at an advanced level of proficiency according to the ACTFL Proficiency Guidelines.

Changes have occurred in the foreign language curriculum in the past two years to reflect the new Performance Guidelines of the American Council on Teaching of Foreign Languages (ACTFL) and the National Standards for Foreign Language Learning. The goals and objectives of the introductory language courses, as well as the textbooks for these courses and some literature courses, reflect current terminology and methodology in foreign language pedagogy. Also, three culture courses taught in English (French 104, Spanish 104, and German 104) have had their numbers raised to 204 so that they would be acceptable as cognate courses. A new courses titled Civilization and Culture of Latin America and the Spanish-Speaking Caribbean will be proposed as a required course for all Spanish majors and education majors concentrating in Spanish.

For additional information concerning this program assessment summary, please contact June Carter, the assessment unit coordinator.

 

Criminal Justice

Criminal justice enrollments for the assessment period are good in the aggregate (1,334) although some courses, especially the evening courses, are under-enrolled. The number of students enrolled in criminal justice courses this academic year is 550, an increase of 14% from the previous academic year. One concern in the assessment findings was that our students did not have a coherent criminal justice perspective(s). During the 1999-2000 academic year faculty restructured the curriculum in order to adapt to the changing academic environment and to the changing market for our graduates. All majors are required to have one course in each of the major components of the criminal justice system: police, courts, and corrections. Previously, students could select any combination of upper-level criminal justice courses to meet the necessary credit hours. The rationale for this change was to ensure that all majors obtained knowledge of the fundamentals of the criminal justice system. Also, part of the curriculum change was motivated by the addition of a full-time faculty member, William Parks, who developed three new courses. The new curriculum provides greater breadth and depth of criminal justice.

One goal of the criminal justice program is to expand opportunities related to student careers in criminal justice. Seventeen interns have been placed with public-private agencies this academic year (2000-01). In fall 1999, a brochure was developed highlighting the criminal justice internship. Five new internship sites have been developed, and several other sites are in the developmental process. New evaluation forms were developed in 2000. Over 90% of agency evaluations indicated "excellent" experiences, quality, and satisfaction with our interns.

Many of our majors live and work in Greenville County. Greenville Technical College (GTC) is a source of potential criminal justice students for our program. Faculty is pursuing, along with GTC, the possibility of offering a four-year degree program in Greenville. Meetings with GTC have produced a plan and agreement to offer courses beginning fall 2001 and a four-year rotation plan.

One problem of concern that has emerged from the assessment process is that our majors do less well than expected in the areas of theoretical sophistication and methodological/statistical competence. Faculty recognizes several timing and structural problems to partially account for this obstacle in the learning process. The key questions being addressed by faculty is what student work, experiential learning, examinations (national or departmental), portfolios, etc. would serve as an effective measure of student learning, especially in the Theories of Crime and Research Methods classes. Several approaches are being discussed with students. One technique discussed to measure learning outcome is a senior essay/project or exit examination in which students would display their competency and demonstrate their understanding of criminal justice.

Academic advising is increasingly seen as a critical element in student retention and academic success. A latent problem emerged from the assessment of our program: too many of our majors are enrolled in upper-level courses before they have completed the required lower-level courses. Part of the problem is rooted in advising. This problem is being addressed by faculty. Efforts are being made to become a member of The National Assessment of Academic Advising in Baccalaureate Criminal Justice Programs with over 600 criminal justice programs in American colleges and universities.

Another weakness identified in the Assessment Planning Document is retention or "inactive files". In 1997, 16% of the 137 inactive files had 91 or more hours earned. Efforts were made during the 1999-2000 academic year to contact these inactive students. Nine students returned for the completion of their program of study. More efforts will be made to contact inactive students and inquire about their future plans in completing their degrees at USCS. Retention is taken very seriously by the criminal justice faculty.

Faculty is constantly reminded about a five-year course rotation. With increasing enrollments in our program and faculty attempting to schedule the basic courses in the major, it is difficult to develop and commit to a long-range course schedule. Faculty will do its best to develop a course schedule for day and evening students at USCS and Greenville.

Finally, continuous program assessment and student development is time-consuming and difficult in a normal crowding of faculty activities. Resources and other faculty incentives should be allocated by the university for program monitoring and improving student learning.

In an effort not to lose momentum, several in-house "retreats" will be scheduled in 2001 to continue addressing the question…What are the implications of the assessment findings for our program and our students?

For additional information concerning this program assessment summary, please contact Fred Wenz, the assessment unit coordinator.

 

3. Academic Advising

This component was reported on last in 2000. Based on the schedule of reporting, it will be reported next in 2003.

 

4. Achievement of Students Transferring from Two to Four Institutions

This component is not applicable to our institutional type.

 

5. Procedures for Student Development

This component was reported on last in 2000. Based on the schedule of reporting, it will be reported next in 2003.

 

6. Library Resources and Service

This component was reported on last in 2000. Based on the schedule of reporting , it will be reported next in 2004.