diff options
| author | Ted Guild <ted@w3.org> | 2015-08-10 14:41:24 -0400 |
|---|---|---|
| committer | Ted Guild <ted@w3.org> | 2015-08-10 14:41:24 -0400 |
| commit | beac9899f64372f4e56a96773ff12513a8423976 (patch) | |
| tree | 68cd67263eb4982ea245c395b7a2301da531227d | |
| parent | 75c04c312ce894a0e77b056d53b3bb8db91056f8 (diff) | |
| download | markup-validator-master.zip markup-validator-master.tar.gz markup-validator-master.tar.bz2 | |
| -rw-r--r-- | htdocs/robots.txt | 8 |
1 files changed, 8 insertions, 0 deletions
diff --git a/htdocs/robots.txt b/htdocs/robots.txt index d0aa2e7..fba8251 100644 --- a/htdocs/robots.txt +++ b/htdocs/robots.txt @@ -5,3 +5,11 @@ User-agent: * Disallow: /check Disallow: /feed/check +Disallow: /checklink +Disallow: /mobile/check +Disallow: /mobile/alpha +Disallow: /css-validator +Disallow: /unicorn/check +Disallow: /http-checker +Disallow: /i18n-checker/check +Disallow: /nu |