logoalt Hacker News

OutOfHereyesterday at 3:23 PM0 repliesview on HN

That is completely false. It is a reasonable type of question and a reasonable expectation. You can't route correctly if you can't do reasoning.

Imagine a prompt:

```

INSTRUCTION: You're a customer service agent that routes customer service requests.

CUSTOMER MESSAGE: I haven't received my order and want a refund.

CONTEXT: A signature is required at delivery. No one was available to sign.

You can route to one of:

* Billing & refunds

* Shipping & tracking

* Order cancelation

* Level II customer service

```

The dumb model, e.g. 1.7B, wrongly routes to Billing. The smart model, e.g. GPT-5.6-Medium, correctly routes to Shipping. It matters. In the real world, the CONTEXT will even be 10-100x larger and noisier.