

Hell yeah!
Seems there’s a lot of buzz about pride month this year. I’ve been to one pride parade as a teen and have approximately zero LGBT fashion items, but solidarity and visibility seems more important in recent years. I should find a necklace with trans flag colors or something.
This is just naive web crawling: Crawl a page, extract all the links, then crawl all the links and repeat.
Any crawler that doesn’t know what their doing and doesn’t respect robots but wants to crawl an entire domain will end up following these sorts of links naturally. It has no sense that the requests are “complex”, just that it’s fetching a URL with a few more query parameters than it started at.
The article even alludes to how to take advantage of this with it’s “trap the bots in a maze of fake pages” suggestion. Even crawlers that know what they’re doing will sometimes struggle with infinite URL spaces.