songtianlun
6544f0247c
- Add disallow rules for /admin/ to prevent indexing - Update sitemap URL to point to the correct domain These changes improve site indexing by ensuring that sensitive admin pages are not accessible to search engine crawlers and updating the sitemap to reflect the accurate URL, helping discovery and SEO efforts.
8 lines
209 B
Plaintext
8 lines
209 B
Plaintext
# See https://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
|
|
User-agent: *
|
|
Allow: /
|
|
Disallow: /admin/
|
|
Disallow: /admin
|
|
|
|
Sitemap: https://todayaiweather.com/sitemap.xml.gz
|