Skip to content
Snippets Groups Projects
Commit 1b8974a3 authored by egon w. stemle's avatar egon w. stemle :robot:
Browse files

Add Disallow statements

Found two lines in robots.txt at UFAL's installation that seem ok. Add
also to our stash:
```
Disallow: /repository/*allzip$
Disallow: /repository/oai/requeststripped
```
parent 0e6268d2
No related branches found
No related tags found
No related merge requests found
......@@ -16,6 +16,8 @@ Disallow: /repository/xmlui/forgot
Disallow: /repository/xmlui/login
Disallow: /repository/xmlui/register
Disallow: /repository/xmlui/search-filter
Disallow: /repository/*allzip$
Disallow: /repository/oai/requeststripped
Disallow: /Shibboleth.sso
#
# Optionally uncomment the following line ONLY if sitemaps are working
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment