Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

The linked page claims that most identified crawlers are related to scraping for training data of LLMs, which seems likely.


Consider applying for YC's Summer 2026 batch! Applications are open till May 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: