AISL > Archived Report Index > Gen Ed Project Analysis - Fall 2009

Gen Ed Project Analysis Spring '09 + Fall '09


Because there was so little data in the spring of '09, we combined it with the Fall '09 data to create a better baseline. This data set provides 2760 data points spread over the 19 GenEd objectives.


Multiple Views of Data

First, the data are presented, in Multiple Views of data, as average scores versus each GenEd objective, numbered 1-19. The various views contrast male/female, CTE/AS, ethnicity, campus, and GPA.

Finally, histograms of GPA and credit-hours earned are presented.


Time-series Evaluation of Scores

The following text refers to Gen Ed Project Results - Spring '09 + Fall '09:

The number of credit-hours earned for each of the students was associated with each score earned, then the student names were stripped out for anonymity by referring only to S-number in the data table. None of this identifiable information is present in any of the publically available data. Several statistics were developed for this data set.

For each of the 19 GenEd objectives, the (S-number,score) pairs were graphed as a single point. These scatter plots should show an upward sloping trend if students' level of mastery for that objective is increasing as they take more courses at the college. In some cases, this is clearly true, for example 1c, 2a and 2b. In the cases of 2b, 3a, 3b, 3d, 4b, 4c, and 4d, the combined data set shows substantially different results from the spring data set. This is mostly because of the small data size in the spring '09 data set.

A re-sampling (bootstrap) analysis with replacement was run 100,000 times on each GenEd objective to develop an overall probability of a positive slope. Bootstrap was used because the distribution is unknown, and probably non-normal.
Each resampling resutls in a scatter-graph of credit-hours-earned versus score, which is fitted to a line and the slope of that line is recorded. The number of positive slopes are counted and thus a probability of positive slope easily computed (simply the count divided by 100,000).

The GenEd objectives with probabilities of positive slope more than 75% - objectives where students appear to be gaining as they take additional coursework - are:
  • 1a - Identify principal point in reading
  • 1c - Draw conclusions from graphical
  • 2a - Write/speak with Focus
  • 2b - Write/speak with Organization
  • 2c - Write/speak using Evidence
  • 3b - Identify perspectives
  • 3d - Identify implications of argument
  • 4a - Perform mechanics of problem solving
Those with probabilities between 26% and 75% - objectives where student gains appear flat - are:
  • 1b - Draw conclusions from reading
  • 3a - Distinguish Fact from Opinion
  • 3c - Evaluate evidence for acc/relevance
  • 4b - Determine realistic answer
  • 4c - Demonstrate technology use
  • 4d - Demonstrate creative thinking
  • 5b - Exhibit ethical behavior
  • 5c - Exhibit significant volunteerism
The GenEd objectives with probabilities of positive slope less than 25% - objectives where students appear to be doing less well as they take more coursework - are:
  • 2d - Write/speak - Conventions
  • 3e - Identify argument strengths/wknss
  • 5a - Know ethical standard
See colorized rubric.