User-agent: * Disallow: /call-for-papers/ Disallow: /*? Disallow: /*?* Disallow: /*.xml Disallow: /cgi-bin/ Disallow: /smw/index.php Disallow: /smw123/ Disallow: /tmp/ Disallow: /search/ User-agent: SemrushBot Disallow: / User-agent: SemrushBot-SA Disallow: / User-agent: Vegi Bot Disallow: / User-agent: "Vegi bot (we follow your robots.txt settings before crawling, you can slow down the bot by change the Crawl-Delay parameter in the settings.if you have an enquiry, please email to: abuse-report@terrykyleseoagency.com)" Disallow: / User-agent: Yandex Disallow: / User-agent: YandexBot # will only use the main indexing robot Disallow: / User-agent: HTTrack 3.0 Disallow: /