logoalt Hacker News

minimaxiryesterday at 7:05 PM8 repliesview on HN

> Spend at least 8 hours on this before even thinking of returning or giving up.

Do current model harnesses have concepts of amount of time spent? Sometimes the model notices if a subprocess takes too long/hangs and kills it, but I've never seen it time itself.


Replies

garethspriceyesterday at 7:32 PM

Many harnesses include a current date and time in their system prompt, and if there is a way for the model to call for an updated time (either a dedicated time tool or calling the OS' `date` tool) they can track time they spent doing something. If not told up-front, they can try to infer it from timestamps in their logs. Sort of like a human - if you ask them to time something and give them a stopwatch, they do it. If you ask them post-facto they'll estimate it.

This "spend at least 8 hours" trick is a new one to me, though.

show 2 replies
nextaccounticyesterday at 7:15 PM

they can call CLI tools to notice the passage of time. the harness can include timestamps too

Cider9986yesterday at 7:11 PM

The voice models certainly can't: https://kittygr.am/reel/DWr31A1B1Ux/

show 1 reply
doogliusyesterday at 8:08 PM

It is not necessarily the case that the instruction needs be taken literally

not-a-llmyesterday at 7:18 PM

of you ask it, surely it can run a "time" in its sandbox from time to time and see how long it worked for

show 1 reply
refulgentisyesterday at 7:10 PM

No, however, if they have the ability to get the current time, they obey constraints like these in a way a model a year ago didn't.

simianwordsyesterday at 7:10 PM

Temporal awareness with GPT-Live

https://www.youtube.com/watch?v=8vvWTz6N7Qg

show 1 reply
tiahurayesterday at 8:58 PM

that can run date