Files
gd-list/robots.txt
T

7 lines
143 B
Plaintext

# Allow all pages on fedl.site
User-agent: *
Allow: /
# Subdomains should have their own robots.txt files
# to define their crawling policies