An artist says Meta’s bots overwhelmed her website and left her scrambling to protect her business
Reported by Fast Company and Business Insider2 sources ↓
San Diego artist Chelsea Paulus said Meta crawlers made more than 550,000 requests to her website in 48 hours, exhausting its hosting resources. Her site was still struggling as she tried to block the bots.
Key points
- Paulus said her hosting resource usage reached 100% after another Meta crawler arrived
- She said the requests came from Meta External Agent and Meta Web Indexer crawlers
- Paulus said she removed her website link from Instagram to reduce additional traffic
- Meta said site owners can manage crawler activity through tools such as robots.txt
Sources
Details
Business Insider reports that Paulus, a children’s author and illustrator in San Diego, traced repeated website requests to Meta crawlers. Her hosting provider, SiteGround, confirmed that one visitor identified itself as “Meta External Agent,” which Meta says crawls websites for uses including AI training or product improvement. A later crawler, Meta Web Indexer, is described by Meta as helping improve AI search results.
Paulus said she received an October 24 warning from SiteGround that her four websites, which share one hosting plan, had used 80% of allocated CPU resources. She tried changing her robots.txt file and adding a firewall, but said those measures could take up to 24 hours to take effect. SiteGround gave her code for a temporary fix, but she said the later crawler pushed resource use to 100%.
Meta told Business Insider that website managers can control how its crawlers interact with their sites and referred to its developer documentation. As of the article’s Monday reporting, Paulus said her website was still struggling; she had removed its link from her Instagram profile and was exploring Cloudflare’s human-verification tools. She said she could not afford to pay for more hosting capacity for traffic that brought no customers.
Written from coverage as of
Images
- Business Insider
Stocks in this story
Change since open: 20 Nov to 21 Nov 2026
Last refresh