Custom Robot txt Header Tags Settings ForBlogger SEO Optimization Guide.


Do you know what are search robots, They are responsible for the recognition of the updates added in our sites and takes the information to the search engines about the updates for more crawling and ranking of content.
With the proper implementation of the predefined tags, you can communicate with the search engines crawlers to increase and decrease the search visibility in the search results of the updated website content. That’s the exact full idea of the Robot txt that we are going to tackle about.

How to Set up the Custom Robots Header Tags on Blogger?

I hope I am teaching a  Blogger user and not a WordPress one since this tutorial looking forward to increasing your search engine exposure in blogger posts by proper installation of robot txt file so that the search engines can generate organic traffic easily through your commands.
If so, I recommend following this guide and enabling the custom robots header tags for maximum search engine visibility (especially for new blogs).
Before getting to know the process of setting up custom robots header tags on Blogger, you should know what they are.

Custom Robots Header Tags Blogger Settings Guide - Seoclive
You may also like:

Custom Robots Header Tags and Purpose

In Blogger, you are going to deal with the following custom robots header tags.
1. all – If you set this tag, crawlers are not bound by any constraints. They can freely crawl, index and expose your content to search results.
2.noindex – Not all the blogs are meant for public content info. Even if you don’t share the URL of your personal blog with anybody, chances are people will be brought to the private post from search results.To avoid that happening, you can use noindex tag as it prevents search engines from indexing the pages.
3. nofollow – Nofollow and dofollow tags are for outbound links. Dofollow is the default robot tag for all your outbound links. That means the search engines can sneak upon the website pages you have linked to. If you don’t want search bots to crawl through your links, addition of a nofollow tag must help you.
4. none – none combines the features of both noindex and nofollow tags. The crawlers will neither index your pages nor skim through the links right when using this feature.
5. noarchive – You might have noticed a cached label with most of the website links on SERPs. It shows that Google has captured a copy of your site into their server to display in case it goes down. That being said, the noarchive tag turns off cached version in search pages.
6. nosnippet – The text snippets in search results help people find what’s on the webpage. If you want to keep the content exclusive, you can turn this header tag on.
7. noodp – Open Directory Project or Dmoz is a man-made directory of websites. Google uses the information from there sometimes. You can turn it off with this tag if you want to but I think it's paramount the only thing I don't know if its a requirement since there is less info about it.
8. notranslate – Do you want to disable translation on your site? Then make use of the notranslate button for the purpose of avoiding translation.
9. noimageindex – If you allow Google to index your images, people may steal it and use on their own websites. To prevent that, you can keep the images deindexed using noimageindex tag. 
10. unavailable_after – In Blogger, you will get a field right to this tag. So, the webpage will be deindexed after this time.

Now let me take you to the real tour of the setup. Enjoy

How to Setup Custom Robots Header Tags?

It's so easy to set up the robot tags, it only takes few second unless you want to grab a cup of coffee and come back. Now follow the steps given below to proceed with the setup.
Step 1: Visit blogger.com and sign in to your account.  choose the one blog website from the drop-down of your blogger sites at the far left for which you want to modify robots tags. Click Here
Step 2: Then go to Settings >> Search preference. There you find see a setting called Custom robots header tags under Crawlers and Indexing. Click the Edit link to the right of it.
Crawlers and Indexing
Step 3: At this step, you will notice two radio buttons.Click on the Yes option to start.
Enable Custom Robots Header Tags
Step 4: Now, you will get a set of checkboxes. But don’t get intimidated! It may feel like a complicated one, but it’s not. You can set them on your own by reading the “Custom Robots Header Tags and Purpose” once again. Or, just follow the same settings I chose (refer to the image given below) and hit Save changes.
Custom Robots Header Tags Settings
Note: We can set this up on the homepage, archive pages, and post pages too.
That's it.A as I said earlier, so easy! You have done It.

Bottom Line
Trust me custom robots header tags are powerful! As Google provides a readymade setup to use them, why don’t you go for it?
Also, don’t even think of clicking on the noindex checkbox until and unless you are sure because it will automatically pull your website off from search engine result pages (SERPs) and the pages will not be indexed.
Notify me if you liked the post. Comment below

4 Comments

  1. Thanks your articles are so educative add more

    ReplyDelete
  2. Talking of the above
    what can i do to the pages that i dont want google to index them

    ReplyDelete
  3. I always get confused about no follow , explain more

    ReplyDelete

Post a Comment

Previous Post Next Post

About Joecalih

This website is a Blogger template, tutorials and Photography blog resource equipped with Presets and Luts for cinematic editing. + Learning tutorials for Blogger website development entailing widgets, plugins and SEO solutions are featured - Enjoy Reading.

Blogger

Web resource for blogger widgets and desigh plugins for blogger.com development.

Templates

Free download blogger templates and purchace top Blogger Premiun templates.

Tutorials

Get step to step guide for blogger solutions with tips and tricks for Blogger solutions.

Photography

Archive for Joecalih Portifolio and Gear lessons from the profesional Photographer, Book Today.

Presets

Download best editting Presets and Cinematic Luts from Preset Archive resources.

SEO

Learn Search Engine Optimization (SEO) to improve your website search ranking.