Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Is there any equivalent of the robots.txt standard for public code repositories? Being able to opt-in to certain bots might be helpful (opt-out being the default, of course).


That's a really cool suggestion and I would love to see some sudo-standard on this.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: