Prior to October 11, 2021, Elevate and Ascend reports included only complete responses in reports. This allowed us to avoid including meaningless data, e.g., when the same student logged in several times and only completed the survey once. However, there are cases when an individual student’s only response may be a partial one. Given what research tells us about selection bias, this is likely to exacerbate an existing problem where the students we most want to hear from are the least likely to finish the survey. With our October 11, 2021 update, we include partial responses in the reports in those cases, so that students are not entirely discarded from the data simply for not making it to the last page of the survey.
What might users who collected data prior to October 11, 2021 notice as a result of this change?
Users who compare reports generated on or before October 4, 2021 to reports generated on or after October 11, 2021 may notice the response rates in their reports increasing, by more than would be expected given the amount of data they’ve collected. This is because students who only gave partial responses are now being included in the sample. Scores may shift as well for the same reason.