Perplexity is allegedly scraping websites it's not supposed to, again
Web crawlers deployed by Perplexity to scrape websites are allegedly skirting restrictions, according to a new report from Cloudflare. Specifically, the report claims that the company's bots appear to be "stealth crawling" sites by disguising their identity to get around robots.txt files and firewalls.<br /> Robots.txt is a simple file websites host that lets web crawlers know if they can scrape a websites' content or not. Perplexity's official web crawling bots are "PerplexityBot" and "Perplexity-User." In Cloudflare's tests, Perplexity was still able to display the content of a new, unindexed website, even when those specific bots were blocked by robots.txt. The behavior extended to websites with specific Web Application Firewall (W [...]
Rating
Innovation
Pricing
Technology
Usability
We have discovered similar tools to what you are looking for. Check out our suggestions for similar AI tools.
Perplexity launches 'Computer' AI agent that coordinates 19 models, priced at $200 a month
Perplexity, the AI-powered search company valued at $20 billion, on Wednesday launched what it calls the most ambitious product in its three-year history: a multi-model agent orchestration platform ca [...]
Perplexity takes its ‘Computer’ AI agent into the enterprise, taking aim at Microsoft and Salesforce
Perplexity, the AI-powered search company valued at $20 billion, announced on Wednesday at its inaugural Ask 2026 developer conference that its multi-model AI agent, Computer, is now available to ente [...]
Reddit sues Perplexity and three other companies for allegedly using its content without paying
Reddit is suing companies SerApi, OxyLabs, AWMProxy and Perplexity for allegedly scraping its data from search results and using it without a license, The New York Times reports. The new lawsuit follo [...]
Perplexity sued by Japanese media giants for stealing information and presenting false information
Another day, another instance of AI companies purportedly engaging in copyright infringement. Two Japanese media groups, Nikkei and the Asahi Shimbun, are suing Perplexity for illicitly having "c [...]
Amazon and Perplexity are fighting over the future of AI shopping
Amazon has sent a cease-and-desist letter to Perplexity that demands that the AI startup prevents its Comet browser from making purchases on Amazon, Bloomberg reports. In a blog post responding to Ama [...]
Perplexity has cooked up a new way to pay publishers for their content
Perplexity is launching a new revenue-sharing plan for publishers that will pay them every time its AI assistants use an article to answer a question, The Wall Street Journal reports. Perplexity is la [...]
The New York Times and Chicago Tribune sue Perplexity over alleged copyright infringement
The New York Times and the Chicago Tribune have filed separate lawsuits against Perplexity over alleged copyright infringement. The Times said it had sent Perplexity several cease-and-desist demands t [...]