# Robots Exclusion Standard file for ftp.zap.org.au # [JNZ] Modified 17-Oct-2020 # Block bots (in alphabetical order) that bring no value to this site User-agent: Adsbot User-agent: AhrefsBot User-agent: Aspiegel User-agent: AspiegelBot User-agent: BLEXBot User-agent: BacklinkCrawler User-agent: DomainStatsBot User-agent: Exabot User-agent: GarlikCrawler User-agent: JobboerseBot User-agent: Kraken User-agent: MJ12bot User-agent: Mappy User-agent: MauiBot User-agent: MegaIndex.ru User-agent: SEOdiver User-agent: SEOkicks User-agent: SEOkicks-Robot User-agent: SemrushBot User-agent: SemrushBot-BA User-agent: SemrushBot-BM User-agent: SemrushBot-CT User-agent: SemrushBot-SA User-agent: SemrushBot-SI User-agent: SemrushBot-SWA User-agent: SurdotlyBot User-agent: SurveyBot User-agent: YaK User-agent: adsbot-google User-agent: adscanner User-agent: aiHitBot User-agent: coccocbot-web User-agent: dotbot User-agent: grapeshot User-agent: linkdexbot User-agent: ltx71 User-agent: metajobbot User-agent: rogerbot User-agent: serpstatbot User-agent: trendictionbot User-agent: trendictionbot User-agent: zoominfobot Disallow: / # Settings for all other (allowed) bots User-agent: * Disallow: /incoming/