> why anyone would want to do inference on a laptop

Because reviewers tell them this is is a good use case, and people want to take advantage of the HW they buy [0]. Unfortunately those reviewers didn't take any extra step to validate anything beyond the default config, out of the box.

[0] https://arstechnica.com/reviews/2026/10/the-surface-laptop-u...