Magento 1.9 | Manage robots TXT

November 8th, 2016

  • Login on admin area :
  • enter in : System -> Configuration -> Design -> HTML Head -> Default Robots
  • here you can manage global robots.txt options

  • For static cms page
  • locate the field Layout Update XML
  • add <reference name=”head”> <action method=”setRobots”><value>noindex, nofollow</value><name>robots</name></action> </reference>
  • This code can also be used in any template you choose.

 

If you want add it on search results page :

  • open or loacal.xml , or, catalogsearch.xml,
  • find ” <catalogsearch_result_index translate=”label”> ” and immediately before </catalogsearch_result_index>
  • add <reference name=”head”> <action method=”setRobots”><value>noindex, nofollow</value><name>robots</name></action> </reference>
  • made same steps for <catalogsearch_advanced_result translate=”label”>