Observe change since the previous survey. If you’ve made significant changes to your practice since the previous survey, the difference between the last two points can help you see how those changes impacted student experience.
Look for trends over time. Changes from survey to survey can unearth insights about the impact of specific practices and other factors that affect students’ experiences. For example, if an initial improvement later returns to baseline, perhaps the strategies that caused the initial improvement are no longer being implemented. Or perhaps the course has become more challenging and students now need more support than they did before. Many instructors find it helpful to explicitly debrief results with students to learn what’s going well and how further improvements could be made.
Examine results by item (in Class and Community reports). Use the “results by item” toggle to see how each individual item included in the learning condition changed over time. This information can give you a sense of what items are driving the overall changes you see. For example, if you notice improvement in all items except for one, you might ask why students’ answers to that particular question may not be changing.
Examine results by community (in Network reports). Seeing Communities side-by-side allows you to identify strategies that may be particularly effective, especially if you see precipitous improvements. In Network reports, each row in the table represents a Community in the Network and each column represents a survey window. To understand change over time for a given Community, examine the Community’s row in the table. The numbers in the first column represent the percentage of students in the target range for survey 1, the second column represents that percentage for survey 2, etc.
Change between surveys is depicted in the same way as in other tables in your report: with an upwards arrow for positive changes, and a minus sign for negative changes. Each change score in the table represents change since the previous survey, e.g., the change score appearing next to the percentage in survey 2 represents change since survey 1. Large changes (>= 6 percentage points) are depicted in green, and large decrements (<= -6 percentage points) are depicted in red, to help them stand out visually. The last column in the table, called “Change Since Survey 1,” represents change from the first survey to the last — similar to the numbers depicted in the Student Experience Overview, except broken down by individual Communities.