alt Hacker NewsIs there a library of good tools for LLMs to call? I have to imagine the bot-detection avoidance mechanisms are a major engineering effort and not likely to work out of the box with a simple harness and random local LLM.
Replies
ossa-ma • today at 12:33 AM
Even the hosted ones are blocked from searching certain sites, for example Claude is banned from searching Reddit:
`Error: "The following domains are not accessible to our user agent: ['reddit.com']."`
wyre • today at 12:39 AM
Tavily, Exa, Firecrawl, Perplexity, and Linkup are all tools for agents to search the web.
I’ve been building a harness the past few months and supports them all out of the box with an API key.
➕ show 2 replies
If your volume is low enough, it should be pretty fine. It can just piggy back onto your personal browser cookies for Cloudflare.