6 Commits

Author	SHA1	Message	Date
syeopite	92b04a30f3	Prevent indexing of Invidious instances (#2420) ... Closes #2418	2021-09-22 01:29:51 +02:00
Paul Braeuning	e38b602b7d	Disallow /watch path for bots again	2021-06-14 10:40:59 +02:00
Omar Roth	6c19f0f242	Revert "Update robots.txt" ... This reverts commit b26b6b9bdf.	2018-11-08 00:41:03 -06:00
Omar Roth	b26b6b9bdf	Update robots.txt	2018-11-06 23:13:31 -06:00
Omar Roth	5df7c43e5d	Ignore login in robots.txt	2018-03-24 23:15:03 -05:00
Omar Roth	d88b60979b	Add robots.txt	2018-02-05 18:11:59 -06:00