Improving Education -- Ranking Arkansas High Schools by Performance vs. Expected Performance

I decided to kick off this summer by developing a model to rank Arkansas high schools, not just based on test scores, but based on how schools scored against how they could be EXPECTED to score.

I used a regression model that takes demographic and enrollment data that is beyond the ability of the school to control. The individual schools' data is fed to the model to create predicted ACT Composite scores. The schools' predicted score is subtracted from the actual 2021-2022 average ACT Composite score, resulting in a "residual."

Residuals that are greater than zero indicate a school outperformed the model's expectation. Schools with a residual less than zero underperformed against the expectation. Schools were then ranked by residual in descending order. The highest ranked school had the highest residual.

Some schools were removed from the ranking as outliers or special cases with attributes that made them so different from typical high schools that including them would inappropriately skew the model.

In the end, 232 high schools were ranked. Some surprises on the high end and the low end. 

My hope is for schools that beat their predictions and schools that fell short to be studied further to discover variables that are under the school's control and lead to higher or lower scores. If these variables can be manipulated in low-performing schools, perhaps we can improve the educational outcomes for a lot of Arkansas students. 



Comments

Post a Comment

Popular posts from this blog

13 Years Ago Today...Amanda Marie Allison (1993 - 2011)

Image
She loved the snow. If she were alive today, she'd be loving this. But 13 years ago today, her life was taken by a drunken, stoned 19-year-old at a party. Teens drinking and using illegal drugs ended the life of Amanda, only four days before she would have turned 18, only four months before she would have graduated from high school. I knew she was partying. I knew she was doing things she shouldn't have been doing. I chalked them up to a teen phase that she would grow out of. She never go the chance to grow out of it. Many teens believe they're immune from harm. Amanda did. She thought she could handle whatever came at her. It's a real phenomenon, a sense of invincibility, a sense of immortality even. If you're a teen, please read the story of Amanda and realize that you're not invincible, and certainly not immortal. Alcohol and other mind-altering drugs may seem fun. Five minutes before Amanda was shot and killed, five minutes before, she texted a friend and sa
Read more

2023 Improving Education -- Ranking Arkansas High Schools by Performance vs. Expected Performance

Image
 The time has come for the second issue of my Arkansas High School Rankings. You may recall last year I ranked schools using demographic data and average ACT Composite scores from 232 Arkansas high schools to create a model that produced a predicted average ACT Composite score for each high school. The 232 schools were then ranked by the difference between their actual average and predicted average. The highest ranking school beat its predicted average by a larger amount than any other high school.  CLICK HERE TO SEE FULL LIST OF RANKED HIGH SCHOOLS The Arkansas Department of Education (ADE) released the Arkansas School Report Cards a few weeks ago. Since then I've been working to produce rankings for the 2022-2023 school year. I will give a brief overview of this year's results in this post. You can view the detailed report of the philosophy, methodology, and analysis behind the rankings here , and see the Jupyter Notebook with the code here. Recall, this model does not rank
Read more

Snow days SHOULD be made up!

Image
  Unpopular opinion. We've been making up snow days as long as I can remember. When I was a kid, I remember going to school on Saturday. I remember going past the last scheduled day. I remember lengthened school days, all to make up time lost to snow days. One thing we know for sure. Very few kids ever learned anything on AMI days. Heck, our school would not allow teachers to cover any new material for the same number of days we missed when kids came back from AMI days so they could catch up on the work they were supposed to do on AMI days! (Yes. What was the point of AMI days?) We also know that practically everyone bemoaned the fact that AMI days meant no more real snow days, even though most kids didn't do a lick of work while they were gone on AMI days. We KNOW these things! Now people are complaining that we have to make up the days. (Even though most schools have snow days built into their calendars and don't even know yet exactly how many days will be made up.) Now p
Read more