# Allow only specific directories User-Agent: Rednano Crawler (crawler@sphsearch.sg) Disallow: /cgi-bin/ Disallow: /images/ Allow: / User-agent: * Disallow: /cgi-bin/ Disallow: /images/