Devils advocate (really not affiliated with oxide, but I have worked for a “desirable” employer before).
How would you handle a few thousand applicants for a single role?
I think no matter what you do it will feel inhumane, we can argue that a few hours of work for a take home test is inhumane too, being ghosted after doing one definitely wouldn’t pass my personal bar of acceptability, but if its the first stage and the task would take a properly qualified applicant less than 30 minutes then I can’t fault.
How would you do things? remember that it has to scale and you cant leave any gaps based on human fallibility (HR/Hiring Managers are humans and will forget if there are too many things going on at once).
If you truly believe you’re “scaling” you do it the Google way and have a strict loop with a good rubric for the interview so applicants are comparable. The whole point of that system is thousands of people and hundreds of interviewers, and a very standard process. I’ve always found it pretty fair even with some randomness in scoring.
You shouldn’t be giving take homes unless they’re either short, or the applicant passed a screen and you’re investing time. Otherwise how are you “scaling” the review? Claude? Hidden test suite (not bad)? Some sort of leaderboard (bad, rewards people with time), something else?
There's a simple answer, if someone is doing a substantial amount of work for your interview process, pay them an amount of money that is more than zero but less than "do job interviews for a living". Or provide that amount times two to a charity of their choice.
I've done this for hiring before, for people who reached the "put substantial effort in" stage (in my case basically 2nd or 3rd round work sample stuff), and it was a great way to make sure we got good signal and they felt respected.