alt Hacker Newsisn't browser use sota on web voyager? At this point web voyager seems to be outdated, there's def a need for a new harder benchmark.
Replies
suchintan • 01/17/2025
Definitely need a newer benchmark.
I couldn't find where browser-use published their run results (expected to see it here https://github.com/browser-use/eval)
We went ahead and published our full run at https://eval.skyvern.com so our run could be independently audited
Yes, this is the report of browser-use with 89%: https://browser-use.com/posts/sota-technical-report
We definitely need a new dataset with more complex tasks, like uploading files, handling multiple tabs, and handling many more steps.