Skip to content

Latest news

Eleutheros Ltd
Coiled optical fiber cable glowing red at both ends on black

Artificial intelligence

Publishers and AI scrapers: what the latest warning changes

Digiday reports a warning that publishers must protect their content from AI scrapers now. The parallel with the early web and social platforms is the useful part: access granted freely is hard to reverse later.

Digiday published a piece on 9 November 2026 in which Piano's CEO argues that publishers need to protect their content from AI scrapers without delay. The central argument is historical: each technology wave arrives with the same promise of reach and relevance, and publishers who opened their doors to gain exposure later spent years trying to recover the value they had handed over. The report does not detail specific tools, pricing or measured revenue effects, so the practical implications have to be reasoned from the pattern it describes.

The pattern being described

The comparison drawn is with two earlier moments. When the web arrived, publishers published freely to gain visibility, then worked for a decade to rebuild revenue around content that was already circulating. When social platforms arrived, archives were opened to intermediaries that captured the audience relationship. The argument is not that exposure is worthless, but that the terms of access are much easier to set before the access happens than after.

For teams working on acquisition and monetisation, the relevant question is not whether AI systems read published content. It is whether the business has any position on what that reading is worth, and whether anyone inside the company owns that position. General industry context: the debate around crawl permissions, licensing and referral traffic has moved from specialist conferences into standard commercial negotiation, and large language model providers increasingly strike deals with content owners. That context is widely established; the Digiday report itself does not specify which deals exist or what they pay.

What a team can check this week

Concrete checks are possible without waiting for a formal strategy.

  • Confirm what the site's robots directives currently allow, and who last changed them and why.
  • Check whether paywalled, gated or member-only content is technically reachable by automated crawlers.
  • List which parts of the archive carry commercial value, and which are simply historical volume.
  • Establish who inside the organisation is empowered to answer a licensing or access request, so it does not stall.

None of these require new budget. They produce a factual picture of exposure that any later decision depends on.

The monetisation angle

Traffic-based models assume that readers arrive through channels the publisher can measure and influence. Automated consumption breaks that assumption: it can generate load and cost without producing sessions, subscribers or ad impressions. That does not automatically mean blocking everything, and the report offers no evidence on which approach performs better. It does mean the default posture deserves a deliberate decision rather than an inherited setting.

For acquisition teams, the mirror question matters too. If content distribution increasingly happens inside AI answers rather than on the open web, the attribution and conversion paths built around clicks will undercount. Publishers who treat this as purely a defensive problem may miss the part where visibility itself is being renegotiated.

The simplest takeaway from the Digiday piece is timing. Access terms set quietly today become the baseline everyone argues from tomorrow, and the cost of revisiting them rises with every year of accumulated dependence.

Also worth reading

All news

Aerial night view of Alexander Nevsky Cathedral in central Sofia

Contact

Tell us where the project stands.

A few lines are enough: what you are building, where it is today, and what is blocking it. We answer every message personally.

Contact us contact@eleutheros.eu