2026-11-12 · America/Los_Angeles · 论文 · #17

ScrapeBench: Evaluating Legal Compliance of AI Agents in Website Scraping

AI agents deployed on the open web are becoming more capable of performing actions that may breach contractual provisions and violate computer security laws. In this paper, we introduce ScrapeBench, the first agentic benchmark for empirically evaluating the legal compliance of AI agents with website scraping policies, namely terms of service (ToS) and robots.txt directives. Across widely used closed-weight and open-weight AI agents, we find that most agents exhibit low compliance rates (< 5%) when instructed to scrape websites in our sample of 1,626 popular websites that explicitly prohibit…

热度 29.9 / 100；排名与评分保留该期记录。