3 Comments
User's avatar
Jefferson Kim's avatar

AI has difficulty crawling lots of websites, including consumer purchasing websites. At least for Gemini it primarily uses Google Caching.

The consumer websites have incentives to force real humans to their pages rather than allow crawlers. I'm still looking for solutions using OpenClaw and proxies, but it is still very difficult even when you let OpenClaw take over your device.

Let me clarify. We used up all our $20/month tokens when we tried that with Claude, likely due to the requirement of it using tokens to analyze the screen with each click.

Gridhunter's avatar

AI reliably fails at the same detail-oriented processes that normal people fail at. Good to know.

Jordamøn's avatar

not quite. it's very good at brute force analysis. part of its limitations is people intentionally making the interfaces difficult - for example, airlines do NOT want AI optimizing people's ticket purchases - and part of it is that people naturally spend more time training it in detail on the parts they themselves already know intimately.