I don't think refusal is the right approach. I would much prefer that it respond with something like:
> There is not enough information to make an accurate estimate, but if you'd like, I can take a stab at it. If so, how much effort to put into it?
> Yes, go ahead and spend up to 5mins and $1 to analyze it.
> Done, I've had 100 subagents analyze the image and have arrived at a 95% confidence interval of the portion containing ...
I know this is just an example but my eyes kind of bugged out thinking about paying $1 every time I want to estimate the calories in my sandwich.