###################################################### #################### sample robots.txt file for this website #################### addresses all robots by using wild card * User-agent: * #################### list folders robots are not allowed to index Disallow: /cgi-bin/ Disallow: /Css/ Disallow: /db/ Disallow: /Engels/Images/ Disallow: /Enquete/ Disallow: /Flash Disallow: /Frans/Images/ Disallow: /Images Disallow: /Nederlands/Images/ Disallow: /Pss #################### list specific files robots are not allowed to index Disallow: /Engels/P09.cfm Disallow: /Engels/P09b.cfm Disallow: /Engels/P10.cfm # Disallow: /Frans/P09.cfm Disallow: /Frans/P09b.cfm Disallow: /Frans/P10.cfm # Disallow: /Nederlands/P09.cfm Disallow: /Nederlands/P09b.cfm Disallow: /Nederlands/P10.cfm #################### End of robots.txt file ######################################################