logoalt Hacker News

dim13yesterday at 9:36 AM5 repliesview on HN

Fails "car wash" test miserably. Ask it:

> I want to wash my car. The car wash is 50 meters away. Should I walk or drive?

Ref: https://opper.ai/blog/car-wash-test


Replies

Xalutionoyesterday at 10:37 AM

Thats absolutly not the point of these models.

They are here to route things, do tool calls, ask experts.

show 1 reply
SwellJoeyesterday at 9:50 AM

Even very large models failed tests like this up until a year or two ago...this is a very, very, small model.

woadwarrior01yesterday at 10:11 AM

Works with the Bonsai-27B-1bit-mlx model on my mac.

Edit: this is running with MLX, and not with WebGPU on the browser, also it is a fail.

"""

You should *walk*.

Here’s why:

- *Distance*: 50 meters is very short — about 0.3 miles or 0.5 kilometers.

- *Time*: Walking takes roughly 2–3 minutes. Driving would take longer due to parking, starting the engine, and maneuvering.

- *Effort*: Walking is light exercise and avoids parking hassle.

- *Safety*: Less risk of misjudging parking space or damaging the car.

Unless you have a disability that makes walking difficult, walking is the most practical and efficient choice.

"""

show 1 reply
HelloUsernameyesterday at 9:42 AM

[dead]