I may be missing something so apologies if I'm telling you something you already know but: there are plenty of web search APIs for agents - the Brave one is the one I use: https://brave.com/search/api/