Custom Robots.txt file for Blogger/Blogspot blogs for SEO
Blogger now lets you edit your blog's robots.txt file. What are Robots.txt files, robots files are plain text files which instruct the search engines what to not index. Robot.txt is a way to tell search engines whether they are allow to index a page in the search result or not. The bots are automatic, and before they could access your site, they check the Robot.txt file to make sure whether they are allowed to crawl this page or not.
How to Enable Custom Robots.txt in Blogger
1. Blogger Dashboard >> Select Blog >> Select Settings tab >> Search Preferences
2. Click on Edit in front of Custom robots.txt
3. Click on Yes and proceed to next step.
3. Next a box comes up and paste following given code.
User-agent: Mediapartners-Google4. and finally click on Save Changes button to save code.
Disallow:
User-agent: *
Disallow: /search
Allow: /
Sitemap: http://YOURBLOGURL.blogspot.com/feeds/posts/default?orderby=UPDATED
I hope this tip would help you. If you are having any issue regarding crawling then, feel free to leave your questions in the comments below and I would try to help you in solving them.
Categories:
Blogger,
Blogger Tips,
Robots.txt File,
SEO
Liked this post. Share!
Enjoyed the article so far? Recommend it to your friends and peers.
:)
:(
:))
:((
=))
=D>
:D
:P
:-O
:-?
:-SS
:-f
d(
:-*
b-(
h-(
g-)
5-p
y-)
c-)
s-)
d-)
w-)
:-h
:X
This is a massive and a very interesting post. Thanks for sharing this.
ReplyDeleteThank u so much...
ReplyDeletecould you please explain what you did here?what those lines mean?
ReplyDeletewwwe.wetechies.blogspot.in
My index status says indexed 27, blocked 27. It dosnt show on google if I inpute the title of my blog. But if I inpute the url it does show. What can I do to make it show if I inpute the title or related keyword. Robot.txt is disabled
ReplyDeleteIf i follow the instructions above,,will it increase my blog traffic??please reply with a yes or no....
ReplyDeleteWaiting....
yes ... maybe ....
Deleteadd meta tags and your traffic will increase.
Nice post...
ReplyDeletehttp://topratedtricks.blogspot.com/
great article.....keep posting
ReplyDeletehttp://www.askdanyal.com/
i put you one question solve my problem. my domain is letsplaymedia.in and am used my domain on blogger so which robot.txt used ?
ReplyDeleteThanks.I improve traffic.
ReplyDeletehttp://99-softwares.blogspot.com/
Good method. I have used this robot in my blog. Check it out.
ReplyDeletehttp://smart-phoney.blogspot.com
URL restricted by robots.txt
ReplyDeleteNow This error comes to show after 1 month.
What to do my blog is dramasdhoom.blogspot.com
Your robots.txt is not correct , use as given above in post.
Deletemake money with sarwarbobby in urdu language
ReplyDeletelearn blogging in urdu
http://sarwarbobby.blogspot.com
Excellent info, I will defo use this.
ReplyDeletewww.top-10-money-makers.blogspot.com
A/S, went through your blog. I really appreciate your work. Plz help me to get my blogger better (i'm a newbie).
ReplyDeletewww.cricketsamratind.blogspot.com
Join our blog and implement all our tutorial in your blog to get good traffic and basic seo
DeleteThis kind of treatise envy is usually without a doubt fabulous. My partner and i started out the actual aspect, wanted what exactly My partner and i required in addition I had some sort of endurance with no practice! That is asst seen viscouss guide memorial My partner and i see pro therefore drastically! Notion an individual pertaining to expressing this up-to-date people. SEO companies sydney
ReplyDeleteThank you for discussing this very useful article. I heard something new from you. Keep blogging. SEO Dubai
ReplyDeleteI have written blog about tarpaulins. Tarpaulins Protect your Garden and you can also use in your home. for more Read This
ReplyDeleteThese information are quite good. In Chennai, best digital marketing services. We offer the best website design along with other digital marketing services.
ReplyDelete