Discussion about this post

User's avatar
Jay L Gischer's avatar

You know, one can already put a tag in one's website that forbids search engines to crawl it.

One of the staples of the web is teaching/information content. It is a big winner on YouTube, for instance. But the described practice might undermine the attention economy reasons for creating such content.

Perhaps we need a tag that says, "go ahead and index, but you are forbidden to feed this to a LLM or similar AI".

And then I wonder, would this make the web better or worse? Would it make such sites less travelled or more travelled.

I use the web for shopping, yes, but also for generic information about the world. Information to help me program better. Information to help me understand world events better. Sometimes to understand mechanics/strategy in a computer game. And so on.

Sometimes the AI response is helpful, but I can't ever trust it. Not after seeing all the times it makes things up.

Expand full comment
Alex Tolley's avatar

This post seems to be missing the known enshittification of Google Search to boost ad revenue. The search was deliberately made worse so that the "best results are to be found on page 1" has been downgraded, so that one needs to dig through more pages. To get more revenue, this implies that just having an ad or paying website on the search page generates revenue for Google. Yes, increasing ad rates boost that further.

But as any business knows, increasing ad costs without a comparable gain just results in advertising elsewhere or through other means. Squeezing businesses and worsening the ad experience is eventually self-destructive.

Despite the increasingly poor quality, I still use Google Search with the AI summaries turned off, but if MAMLMs could deliver what I want, I might end my use of Google Search. However, I don't expect that to happen any time soon.

Expand full comment
5 more comments...

No posts