Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Unless you have an idea to stop scraping, the status quo is all downside. Everything gets grabbed but also crawlers overwhelm servers.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: