# MGF.net - Robots.txt Structure Copyright 2008. All rights reserved # # Robots.txt file from http://www.miss-b.net/robots.txt # # All robots will spider the domain Sitemap: http://www.miss-b.net/sitemap.xml User-agent: * Disallow: Disallow: /cgi-bin/ Disallow: /sitemanage/ Disallow: /CSSMenuWriter/ Disallow: /members2/ Disallow: /members/ Disallow: