Support Center

Survey Methodology in Chicago Public Schools surveys

Last Updated: Aug 15, 2017 11:16AM CDT
For over 20 years, the University of Chicago Consortium on School Research has administered surveys to teachers students and principals in Chicago Public Schools (CPS). Because so many teachers and principals have made it a priority to fill out past surveys, we have learned a tremendous amount about the factors that lead to better outcomes for Chicago students.
 
The survey can play an important role in an individual school’s improvement efforts. Using results from past surveys, the Consortium has demonstrated that there are five essential supports of successful schools. Schools that have strong performance in the majority of these elements are 10 times more likely to improve student learning and much less likely to stagnate than are those who are weak. 
 

Methods

 
This survey was conducted by the Consortium in collaboration with CPS. As is the case with all surveys, this survey used at least three stages to gather information and report results:
 
  • Question development
  • Administration
  • Scoring survey results

Since the early 1990s, the Consortium has developed specific processes to ensure accurate and reliable information is available on schools in Chicago. Annually, these processes result in responses from more than 150,000 students and 23,000 teachers with data reported back to over 640 schools. The sections below detail each of the stages in the survey.
 

Question Development

 
The primary set of questions on the survey is derived from the research on the 5Essentials. All survey questions have been pretested. There are roughly 80 questions across the student and teacher survey that focus on the 5Essentials. The remaining questions are related to on-going research at the Consortium and CPS. 
 

Administration

 
Students and teachers. All students in grades 6-12 and those eligible to take the teacher survey were asked to participate. 
 
Timing. In 2017, the student and teacher surveys were administered online from January 31 to March 24.
 
Efforts to increase response rates before administration. Principals were asked to nominate a staff member to coordinate survey administration in that school. Materials to help coordinators manage the process were emailed to each of them.
 
Teachers were sent an email several days before administration informing them about the survey. On the day that the survey opened, teachers were sent invitations via email. 

Efforts to increase response rates during administration. For both the student and teacher surveys, the Consortium emailed principals and school coordinators weekly to encourage participation of students and teachers. In addition, network chiefs and their staff members were sent weekly response rate updates.
 

Scoring Survey Results

 
We use advanced techniques to score the survey similar to those used by national standardized test makers. Using Rasch analysis, we combine data from a set of questions conceptually related to each other This technique provides us with one score for the concept while taking into account that some questions are more difficult to agree with than others. For example, teachers were asked to rate the extent to which certain behaviors are a problem at their school in a teacher measure called Disorder and Crime. “Threats of violence toward teachers” is more difficult to endorse than “disorder in hallways” because it likely happens far less often.
 
Our scoring technique also allows us to account for the difference within questions. For example, it may be easier to go from strongly disagree to disagree than it is to go from agree to strongly agree. Rasch takes those differences into account for every question.
 
For more technical details about Rasch analysis, click here.  

For more information on how measure, essential, and 5Essential scores are calculated, see How Scores are Calculated.

Contact Us

  • Email Us
  • 5Essentials@uchicago.edu
    1.866.440.1874

    HOURS
    Monday - Friday: 9AM-5PM CST
ccsr-survey@uchicago.edu
http://assets0.desk.com/
false
desk
Loading
seconds ago
a minute ago
minutes ago
an hour ago
hours ago
a day ago
days ago
about
false
Invalid characters found
/customer/en/portal/articles/autocomplete