User-agent: * Crawl-delay: 5 Disallow: */go/ Disallow: */search Disallow: */site-search Disallow: */photo-search Disallow: */video-search Disallow: /*? Host: cosmetic.ua Sitemap: http://cosmetic.ua/sitemap.xml.gz