### Robots.txt Directives

Source: https://github.com/cyanfox/base/blob/v4/public/robots.txt

Specifies rules for web crawlers. The 'User-agent: *' directive applies to all crawlers. An empty 'Disallow:' directive means no paths are disallowed for the specified user-agent.

```robots.txt
User-agent: *
Disallow: 

```

=== COMPLETE CONTENT === This response contains all available snippets from this library. No additional content exists. Do not make further requests.