Custom Robots.txt file for Blogger/Blogspot blogs for SEO

Pin It
Custom Robots.txt for blogger
Today I will show you How to Enable Custom Robot.txt File in Blogger for better SEO and search engine results?

Blogger now lets you edit your blog's robots.txt file. What are Robots.txt files, robots files are plain text files which instruct the search engines what to not index. Robot.txt is a way to tell search engines whether they are allow to index a page in the search result or not. The bots are automatic, and before they could access your site, they check the Robot.txt file to make sure whether they are allowed to crawl this page or not.

How to Enable Custom Robots.txt in Blogger


1. Blogger Dashboard >> Select Blog >> Select Settings tab >> Search Preferences

Robots.txt

2. Click on Edit in front of Custom robots.txt
3. Click on Yes and proceed to next step.
3. Next a box comes up and paste following given code.

User-agent: Mediapartners-Google
Disallow:

User-agent: *
Disallow: /search
Allow: /
Sitemap: http://YOURBLOGURL.blogspot.com/feeds/posts/default?orderby=UPDATED
4. and finally click on Save Changes button to save code.

I hope this tip would help you. If you are having any issue regarding crawling then, feel free to leave your questions in the comments below and I would try to help you in solving them.

PLEASE NOTE:

If you have any questions regarding this article,please comment and I'll reply as soon as possible.

We have Zero Tolerance to Spam. Comments with Links will be deleted.

22 comments:

  1. Resources like the one you mentioned here will be very useful to me! I will post a link to this page on my blog. I am sure my visitors will find that very useful.
    http://www.sqlservermasters.com/

    ReplyDelete
  2. This is a massive and a very interesting post. Thanks for sharing this.

    ReplyDelete
  3. could you please explain what you did here?what those lines mean?
    wwwe.wetechies.blogspot.in

    ReplyDelete
  4. My index status says indexed 27, blocked 27. It dosnt show on google if I inpute the title of my blog. But if I inpute the url it does show. What can I do to make it show if I inpute the title or related keyword. Robot.txt is disabled

    ReplyDelete
  5. If i follow the instructions above,,will it increase my blog traffic??please reply with a yes or no....
    Waiting....

    ReplyDelete
    Replies
    1. yes ... maybe ....
      add meta tags and your traffic will increase.

      Delete
  6. Nice post...
    http://topratedtricks.blogspot.com/

    ReplyDelete
  7. great article.....keep posting
    http://www.askdanyal.com/

    ReplyDelete
  8. i put you one question solve my problem. my domain is letsplaymedia.in and am used my domain on blogger so which robot.txt used ?

    ReplyDelete
  9. Thanks.I improve traffic.
    http://99-softwares.blogspot.com/

    ReplyDelete
  10. Good method. I have used this robot in my blog. Check it out.

    http://smart-phoney.blogspot.com

    ReplyDelete
  11. URL restricted by robots.txt

    Now This error comes to show after 1 month.
    What to do my blog is dramasdhoom.blogspot.com

    ReplyDelete
    Replies
    1. Your robots.txt is not correct , use as given above in post.

      Delete
  12. make money with sarwarbobby in urdu language
    learn blogging in urdu
    http://sarwarbobby.blogspot.com

    ReplyDelete
  13. Excellent info, I will defo use this.
    www.top-10-money-makers.blogspot.com

    ReplyDelete
  14. A/S, went through your blog. I really appreciate your work. Plz help me to get my blogger better (i'm a newbie).
    www.cricketsamratind.blogspot.com

    ReplyDelete
    Replies
    1. Join our blog and implement all our tutorial in your blog to get good traffic and basic seo

      Delete
  15. Integrating robot.txt file and adding code in the robots.txt file is the easiest task. Still your article is helpful for beginners. Good write up!.

    ReplyDelete
  16. It’s a nice article. As a blogger this is very helpful to me. I always keep this seo tips in my mind. Thanks for sharing such informative post.

    ReplyDelete
  17. Submit your website or blog now for indexing in Google and over 300 other search engines!

    Over 200,000 websites handled!

    SUBMIT TODAY via I NEED HITS!

    ReplyDelete
Emoticons Smileys for Blogger Comments
Show Emoticons >>

PLEASE NOTE:

If you have any questions regarding this article,please comment and I'll reply as soon as possible.

We have Zero Tolerance to Spam. Comments with Links will be deleted.