Skip to content

Commit

Permalink
robots.txt added for SEO
Browse files Browse the repository at this point in the history
  • Loading branch information
@priyankarpal
priyankarpal committed Feb 12, 2023
1 parent be44126 commit 5d95cc5
Showing 1 changed file with 19 additions and 0 deletions.
19 changes: 19 additions & 0 deletions robots.txt
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
robots.txt generated by www.seoptimer.com
User-agent: Googlebot
Disallow:
User-agent: googlebot-image
Disallow:
User-agent: googlebot-mobile
Disallow:
User-agent: MSNBot
Disallow:
User-agent: Slurp
Disallow:
User-agent: yahoo-mmcrawler
Disallow:
User-agent: yahoo-blogs/v3.9
Disallow:
User-agent: *
Disallow:
Crawl-delay: 20
Sitemap: https://projectshut.vercel.app/sitemap.xml

1 comment on commit 5d95cc5

@vercel
Copy link

@vercel vercel bot commented on 5d95cc5 Feb 12, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Successfully deployed to the following URLs:

projectshut – ./

projectshut.vercel.app
projectshut-git-main-priyankarpal.vercel.app
projectshut-priyankarpal.vercel.app

Please sign in to comment.