I still contend strongly that it is wrong to distill a person into a collection of numbers. They are not.
My mother was a special ed teacher who eventually became a diagnostician whose job it was to determine eligibility for services. Part of this job was to give a standardized test to a child to see if they met state set criteria. That said, this was only part of an assessment and was used along with parent preference, teacher recommendations, and other people involved with the process at the school. Outside of meeting state criteria, the numbers in the test were used to identify areas of strength and weakness to help understand a child and put this in perspective of a broader story. For example, if a child struggled with math, was it because they couldn't read well, struggled with the math itself, was distractable? There were also other instances where the test scores themselves were misleading. For example, did a child perform poorly because they were sick, or the AC of the building broke, or they set a test date on a school holiday when the child knew the other kids had a day off?
My point in telling this story is that the raw score in a standarized test can be helpful, but it does not tell a complete story. It is part of a broader assessment. The SAT and college admission is not different.
Purely using a test score does provide an objective score to rank a collection of applicants, but I still contend strongly that it misses the point. Depending on your point of view, college is meant to educate a populace, provide job training, give economic opportunity, or a whole host of other goals. One can use test scores a proxy to determine which applicants best approximate these goals, but I think we should consider whether they really help achieve this.
I'll also mention that using tests scores is not entirely "fair" either. I'd a friend who dated a guy who worked for Kaplan, one of the test prep companies. They had very good data about how much their test prep improved test scores. They were also very expensive. As a result, money and wealth can be used pretty directly to improve one's score. It's difficult for a university to fully address wealth inequality in society. However, since tests can be gamed so easily, I would caution against their over use.
> I still contend strongly that it is wrong to distill a person into a collection of numbers.
Welcome to the adult world, where you are distilled into a collection of number each step of the way: look at credit scores, performance reviews, etc.
> I'll also mention that using tests scores is not entirely "fair" either.
Unfortunately we didn't come up with a better way to rank a group of people on scale in a reasonable amount of time. So tests are a necessary compromise. I also know plenty of examples where people aced their tests by just spending $30 on a prep book and studying hard.
> I still contend strongly that it is wrong to distill a person into a collection of numbers
No one's saying a person is a collection of numbers.
> My point in telling this story is that the raw score in a standarized test can be helpful, but it does not tell a complete story. It is part of a broader assessment
And that's very noble and well-meaning. But it can also be used to discriminate and deny opportunity. Raw scores, on the other hand, are hard data. You either have them or you don't. Do factors outside of one's control go into them? Absolutely. Those factors are all-pervasive and will influence anything you might use to determine merit.
> Kaplan, one of the test prep companies. They had very good data about how much their test prep improved test scores.
Of course they would say that. Even assuming it's true, Kaplan test prep books are only around $50 on Amazon. You could also get them for free from a public or school library (or the high seas, if that's your thing).
As I understand it, Kaplan has apps and dashboards and more material if you're a subscriber. Is there data about the marginal score improvement using that versus just the books?
When you get right down to it, everyone's starting point is different. Reducing the number of variables improves opportunity IMO.