miles-web/robots.txt at cloudflare/workers-autoconfig - miles-web - Gitea: Git with a cup of tea

miles/miles-web

mirror of https://github.com/mileswolfallen2/miles-web.git synced 2026-09-08 11:23:17 +00:00

Files

T

miles cc103cde03 Add new blog posts for Nova AI and OmniEmu, and create robots.txt and sitemap.xml

- Created nova-devlog.html detailing the development of Nova AI, emphasizing its local operation and privacy features.
- Created omniemu-devlog.html explaining the motivation behind OmniEmu, a cross-platform emulator manager.
- Added robots.txt to manage web crawler access and disallow specific directories.
- Added sitemap.xml to improve site indexing and navigation for search engines.

2026-07-26 13:27:02 -05:00

6 lines

110 B

Plaintext

Raw Permalink Blame History

 User-agent: *
 Allow: /
 Disallow: /node_modules/
 Disallow: /.git/
 Sitemap: https://milesallen.site/sitemap.xml