User-agent: * Host: ya-parts.ru Crawl-delay: 10 Disallow: /price_items/search Disallow: /catalogs/*/pav/* Disallow: /tecdoc2/*/models/* Disallow: /laximo/* Disallow: /levam/* Disallow: /il_catalogs/* Disallow: /price_items/search/* Disallow: /products/price.json User-agent: Yandex Disallow: Clean-param: v2search&sort_type