Discussion about this post

User's avatar
Jack Shanahan's avatar

Now put this capability in the hands of a government intel analyst (in either country) who does not have nearly the same level of expertise and cultural awareness of anybody at ChinaTalk, and it's not hard to project very bad outcomes. Between "average of averages," janky single-source references, poison fountains, various other deliberate efforts to corrupt data and sourcing, lack of training on the capability, etc. etc., you have a recipe for disaster. That's not a pre-ordained future. It just means education & training (plus human judgment) become more important than ever, along with demanding the same level of analytic rigor people expected in the pre-AI days.

Janne Sinkkonen's avatar

It is not only paywalls, but the robots.txt files on web sites. The web fetch of Claude honors those files, and many sites simply block AI traffic, or Anthropic's traffic, in their robots.txt. This holds for example to main Finnish news sites, including the big one funded by the government.

Among AI bots, Grok seems to be an exception here. Its default harness at X seems not to care about robots.txt at all.

4 more comments...

No posts

Ready for more?