The [RFC](http://www.robotstxt.org/orig.html) mentions only `Disallow` directive, so it must appear in the file. `Allow` is an ad hoc agreement between search engines that no all of them follow.
5 lines
77 B
Plaintext
5 lines
77 B
Plaintext
User-agent: zola
|
|
Disallow:
|
|
Allow: /
|
|
Sitemap: {{config.base_url}}/sitemap.xml
|