User-agent: * Disallow: /administrator/ Disallow: /cache/ Disallow: /components/ Disallow: /images/ Disallow: /includes/ Disallow: /installation/ Disallow: /language/ Disallow: /libraries/ Disallow: /media/ Disallow: /modules/ Disallow: /plugins/ Disallow: /templates/ Disallow: /tmp/ Disallow: /xmlrpc/ Disallow: /component/content/article/* Disallow: /component/search/* Disallow: /component/* Disallow: /recaptcha/ Disallow: /favicon.ico Disallow: /your-primary-profile/userprofile/ Disallow: /member-directory/ Disallow/index.php?start=16 User-agent: ia_archiver Disallow: / User-agent: Alexa* Disallow: / User-agent: baiduspider Disallow: / User-agent: Baiduspider-image Disallow: / User-agent: Baiduspider+(+http://www.baidu.com/search/spider.htm) Disallow: / User-agent: Biible Disallow: / User-agent: CamontSpider* Disallow: / User-agent: ccbot Disallow: / User-agent: ccubee Disallow: / User-agent: cfetch Disallow: / User-agent: CFNetwork Disallow: / User-agent: CheeseBot Disallow: / User-agent: CherryPicker* Disallow: / User-agent: CherryPickerElite Disallow: / User-agent: CherryPickerSE Disallow: / User-agent: CSHttpClient Disallow: / User-agent: CligooRobot Disallow: / User-agent: CoffeeCan Disallow: / User-agent: CoolBot Disallow: / User-agent: Copernic Disallow: / User-agent: CopyRightCheck Disallow: / User-agent: cosmos Disallow: / User-agent: Cowbot Disallow: / User-agent: curl Disallow: / User-agent: Crescent* Disallow: / User-agent: CydralSpider Disallow: / User-agent: cizilla Disallow: / User-agent: DailyPerfect* Disallow: / User-agent: DiamondBot Disallow: / User-agent: DigExt Disallow: / User-agent: digout4u Disallow: / User-agent: dcbspider Disallow: / User-agent: DittoSpyder Disallow: / User-agent: DoCoMo Disallow: / User-agent: dotbot Disallow: / User-Agent: dotbot/1.0 Disallow: / User-Agent: DotBot/1.0.1+(http://www.dotnetdotcom.org/#info,+crawler@dotnetdotcom.org) Disallow: / User-Agent: DotBot/1.0.1+(http://www.dotnetdotcom.org/,+crawler@dotnetdotcom.org) Disallow: / User-agent: Download Ninja Disallow: / User-agent: DuckDuckBot* Disallow: / User-agent: Dumbot Disallow: / User-agent: Echo Disallow: / User-agent: EchO! Disallow: / User-agent: ecollector Disallow: / User-agent: E-mail Harvester Disallow: / User-agent: EmailCollector Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EmailWolf Disallow: / User-agent: EroCrawler Disallow: / User-agent: e-SocietyRobot Disallow: / User-agent: EuripBot Disallow: / User-agent: EverbeeCrawler Disallow: / User-agent: ExtractorPro Disallow: / User-agent: Exabot Disallow: / User-agent: Gigabot Disallow: / User-agent: Gigabot/3.0 Disallow: / User-agent: Gigabot/3.0+(http://www.gigablast.com/spider.html) Disallow: / User-agent: GingerCrawler/1.0 Disallow: / User-agent: GingerCrawler/1.0 (Language Assistant for Dyslexics; www.gingersoftware.com/crawler_agent.htm; support at ginger software dot com) Disallow: / User-agent: Googlebot-Image Disallow: / User-agent: Heritrix* Disallow: / User-agent: ichiro Disallow: / User-agent: Java* Disallow: / User-agent: Jakarta* Disallow: / User-agent: kalooga Disallow: / User-agent: kalooga/KaloogaBot (Kalooga; http://www.kalooga.com/info.html?page=crawler) Disallow: / User-agent: kalooga/KaloogaBot+(Kalooga;+http://www.kalooga.com;+info@kalooga.com) Disallow: / User-agent: MJ12bot Disallow: / User-agent: MLBot Disallow: / User-agent: MondoSearch Disallow: / User-agent: MondoSearch-MS/5.3+(http://0021.search.harvestinfo.com) Disallow: / User-agent: Mozilla/5.0+(compatible;+MJ12bot/v1.2.1;+http://www.majestic12.co.uk/bot.php?+) Disallow: / User-agent: Mozilla/5.0+(SnapPreviewBot)+Gecko/20061206+Firefox/1.5.0.9 Disallow: / User-agent: MSR-ISRCCrawler Disallow: / User-agent: NaverBot Disallow: / User-agent: NeoScioCrawler Disallow: / User-agent: NextGenSearchBot Disallow: / User-agent: nu_tch-princeton/Nu_tch-1.0-dev (princeton crawler for cass project; http://www.cs.princeton.edu/cass/; zhewang a_t cs ddot princeton dot edu) Disallow: / User-agent: OmniExplorer_Bot Disallow: / User-agent: OpenPlaces/Nutch-1.0-dev Disallow: / User-agent: panscient.com Disallow: / User-agent: psbot Disallow: / User-agent: Python-urllib Disallow: / User-agent: Speedy Disallow: / User-agent: Speedy Spider (Entireweb; Beta/1.3; http://www.entireweb.com/about/search_tech/speedyspider/) Disallow: / User-agent: TurnitinBot Disallow: / User-agent: Twiceler Disallow: / User-agent: VoilaBot Disallow: / User-agent: voyager Disallow: / User-Agent: W3C-checklink Disallow: / User-agent: WebAlta+Crawler/2.0+(http://www.webalta.net/ru/about_webmaster.html) Disallow: / User-agent: Webspider Disallow: / User-agent: Wget* Disallow: / User-agent: yacybot Disallow: / User-agent: Yandex Disallow: / User-agent: Yanga Disallow: / User-agent: YebolBot Disallow: / User-agent: Yeti Disallow: / User-agent: YodaoBot Disallow: / User-agent: zibber-v0.1(www.zibb.com/crawler/) Disallow: / Sitemap: http://www.darknessembraced.com/index.php?option=com_xmap&sitemap=1&view=xml