This is the new MLex platform. Existing customers should continue to use the existing MLex platform until migrated.
For any queries, please contact Customer Services or your Account Manager. Dismiss

In loss for web publishers, US judge deems robots.txt weak as lawn sign

By Emma Whitford ( December 16, 2025, 21:25 GMT | Insight) -- In a loss for online publishers seeking to hold artificial intelligence companies to account, a judge in a New York federal court has deemed news publisher Ziff Davis’s robots.txt files insufficient technological barriers to sustain an illegal web-scraping claim.In a loss for online publishers seeking to hold artificial intelligence companies to account, a judge in the US District for the Southern District of New York has deemed news publisher Ziff Davis’s robots.txt files insufficient technological barriers to sustain a claim of illegal web scraping....

Prepare for tomorrow’s regulatory change, today

MLex identifies risk to business wherever it emerges, with specialist reporters across the globe providing exclusive news and deep-dive analysis on the proposals, probes, enforcement actions and rulings that matter to your organization and clients, now and in the longer term.


Know what others in the room don’t, with features including:

  • Daily newsletters for Antitrust, M&A, Trade, Data Privacy & Security, Technology, AI and more
  • Custom alerts on specific filters including geographies, industries, topics and companies to suit your practice needs
  • Predictive analysis from expert journalists across North America, the UK and Europe, Latin America and Asia-Pacific
  • Curated case files bringing together news, analysis and source documents in a single timeline

Experience MLex today with a 14-day free trial.

Start Free Trial

Already a subscriber? Click here to login