# see http://info.webcrawler.com/mak/projects/robots/norobots.html#format for instructions User-agent: * Disallow: