I am a sociolinguist and a lot of our research on real, authentic language usage, especially among young people, depends on web crawlers.
Your anti-crawling activism actively sabotages research about e. g. queer language, gender, racism, hate speech and social structures.
Yeah, consent is the highest authority, and "AI" shouldn't be used to replace or underpay workers.
But at some point some of y'all really just act like anti-organ donation activists.