# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file # # To ban all spiders from the entire site uncomment the next two lines: # User-agent: * # Disallow: / User-agent: * Disallow: /sko_ask_questions/* Disallow: /mailer_price_request/* User-agent: Yandex Clean-param: order_price_descending&order_price_increase&order_comments&order_by_popularity&order_rating /advanced_search/ Clean-param: refers_to_sku_from_search&statistics_count_param&from_map /search/* Clean-param: region&show_sources /map_search/