# www.robotstxt.org/ # http://code.google.com/web/controlcrawlindex/ # Reduce load by limiting search engines in remote areas User-agent: Yandex User-agent: MegaIndex.ru/2.0 User-agent: MegaIndex.ru User-agent: megaIndex.ru Disallow: / # Default User-agent: * Crawl-delay: 60 Disallow: /admin* Disallow: /ajax* Disallow: /edit* Disallow: /earth* Disallow: /misc* Disallow: /page-improvements* Disallow: /data* Sitemap: https://www.mountainproject.com/sitemap.xml