songtianlun/today_ai_weather
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
09b3f06ad4
today_ai_weather/public/robots.txt

8 lines
209 B
Plaintext
Raw Normal View History

init with rails8 + active-admin
2025-01-19 01:13:59 +08:00
# See https://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
feat: add SEO meta tags and sitemap generation - Introduced `SeoConcern` module to handle SEO meta tags - Integrated `meta-tags` gem for customizable meta tags - Created `RefreshSitemapWorker` to automate sitemap updates - Added relevant meta tags in controllers for weather art and cities - Configured sitemap generation settings These changes improve the SEO of the application by ensuring that pages have appropriate meta tags. Additionally, a sitemap is now generated and refreshed daily, enhancing site visibility to search engines.
2025-01-23 19:02:52 +08:00
User-agent: *
Allow: /
chore: update robots.txt for better indexing - Add disallow rules for /admin/ to prevent indexing - Update sitemap URL to point to the correct domain These changes improve site indexing by ensuring that sensitive admin pages are not accessible to search engine crawlers and updating the sitemap to reflect the accurate URL, helping discovery and SEO efforts.
2025-01-23 19:03:00 +08:00
Disallow: /admin/
Disallow: /admin
feat: add SEO meta tags and sitemap generation - Introduced `SeoConcern` module to handle SEO meta tags - Integrated `meta-tags` gem for customizable meta tags - Created `RefreshSitemapWorker` to automate sitemap updates - Added relevant meta tags in controllers for weather art and cities - Configured sitemap generation settings These changes improve the SEO of the application by ensuring that pages have appropriate meta tags. Additionally, a sitemap is now generated and refreshed daily, enhancing site visibility to search engines.
2025-01-23 19:02:52 +08:00
chore: update robots.txt for better indexing - Add disallow rules for /admin/ to prevent indexing - Update sitemap URL to point to the correct domain These changes improve site indexing by ensuring that sensitive admin pages are not accessible to search engine crawlers and updating the sitemap to reflect the accurate URL, helping discovery and SEO efforts.
2025-01-23 19:03:00 +08:00
Sitemap: https://todayaiweather.com/sitemap.xml.gz
Reference in New Issue Copy Permalink