Guide to Survey Data for AIER
Data from a variety of surveys may be useful to you in evaluating the level of satisfaction with the programs or services provided by your office. In the outcomes section of the AIER links are available to you with data from the surveys listed below. Additional data provided for the 2006-07 report includes the Faculty Staff Survey data from fall 2006, and the senior data for the College Student Survey from spring 2006. The undergrad Alumni Survey data from 2003 has also been attached as a reference. In each section below there is information to guide you in using the data from each survey:
College Student Survey (CSS)
- The CSS was administered to all graduating seniors in the spring of 2006; 147 or 71% of the graduating seniors responded.
- The CSS is a national survey from the Higher Education Research Institute at UCLA. Comparison data for Mennonite colleges is available, as well as 151 “Other Religious 4 year Colleges” – the comparison group assigned to us by HERI. EMU’s data is highlighted in the column to the left.
- EMU added a number of questions, mostly on faith development, that are included at the end of the report of the comparison report.
- The data was reorganized into categories to make it easier to find what you want, and section headings were added in blue. The different parts of the report, including the list of institutions in each peer group, can most easily be accessed by clinking on the links in the bookmarks.
- The different parts of the report, including the overview, trend graphs, the data report by major and the lists of institutions in each peer group, can be accessed by clinking on the links in the bookmarks.
- The data are also provided for students in each major, except Chemistry, Music and Theater. Only one Chemistry and one Music major responded to the survey, so the data are not provided to protect the student’s confidentiality. No Theater majors responded to the survey.
Faculty Staff Survey
If your department also serves faculty and staff, you may find the results of the Faculty Staff Survey relevant as well. New data are included from the fall 2006 survey. The section on support services gives ratings for satisfaction with many of the service departments across campus.
Undergraduate Alumni Survey
- Data from the surveys conducted in 1998 and 2003 are currently available, and data from the current year will be available later in the spring.
- The undergraduate Alumni Survey is a survey developed in-house to measure alumni satisfaction with various aspects of EMU, and to collect information about alumni opinions about EMU and their current activities. The survey is administered every 5 years.
- Responses from the survey are reported as % of agreement (includes persons who marked “strongly agree” and “agree”). Data are reported for the last four survey administrations. The yellow columns to the right reflect the change in percent of agreement over each of the time spans indicated.
- Items from the survey are grouped into scales, with the average for all items included in the scale at the top of the column below the year.
Student Satisfaction Inventory (SSI)
- This survey of traditional undergraduates measures satisfaction with various aspects of academics, campus climate and student support. Students were asked to rate each item for its importance and satisfaction. (Note the scale on the right side of the page). The performance gap score represents the difference between the average importance and the average satisfaction rating.
- Program response rates overall were good at 60% in 2004, but lower this year. The most recent data is not yet available.
- Comparison data is provided for 2001, 2004, and 2007 for EMU and four-year private institutions. Significant differences were measured with effect size (see notes on right).
- Survey items are grouped into 11 scales and there are some additional items at the end of the survey that aren’t included in the scales. We added our own questions on spiritual life.
Adult Student Priorities Survey (ASPS)
- The Adult Student Priorities Survey measures student satisfaction with various aspects of academics and student support. Students were asked to rate each item for its importance and satisfaction. (Note the scale at the top of the data sheet). The performance gap score represents the difference between the average importance and the average satisfaction rating.
- Means are listed from left to right in chronological order, with the most recent year highlighted in yellow (survey will be repeated in 2007).
- The EMU means include all adult students (ADCP, Grad and Seminary); National means include adult students (25+).
- Survey items are grouped into scales. The mean for items in the scale is highlighted in blue.
National Survey on Student Engagement (NSSE)
- The data from this survey are most applicable to academic programs, but student life and academic support departments may find the Supportive Campus Environment benchmark and related items useful as well.
- Data for your department’s seniors are highlighted to the left in yellow. Due to low numbers of respondents, there are no data for the following departments: Theater, Art, Chemistry, JPCS, Music, Phys. Education and Recreation and WCSC.
- The graph at the top represents the benchmarks; the table below contains the means for individual items. Four Benchmarks that were particularly appropriate for academic programs are included: Academic Challenge, Active Collaborative Learning, Student Faculty Interaction, and Enriching Educational Experiences. The blue box under the benchmarks graph has more details.
- Syntax provided by NSSE was used to make the data comparable across years – necessary because of added questions in 2004, and rewording of several items.
- Enriching Educational Experiences: EMU and Bac-LA 2004 responses were recalculated using the frequencies tables provided by NSSE to account for changes in the items included in the scale.
- For new items added in 2004 there are blank spaces in the 2001 column and an “*” in
the left-hand column (see item 1e.)
Be sure to read what is in the blue rows, because the response scale differs by section. You can’t just go straight down the column – the means will not be comparable.
- Some departments have data for both 2001 and 2004, while others have data for only one year or the other. This is because we are unable to provide data when the department has fewer than five responses.