# # This file stores the directories which the web crawler need not # check and index for searches # placed by MLM on 06/13/09 # User-agent:* Disallow:/cgi-bin/ Disallow:/error/ Disallow:/icons/ Disallow:/images/ Disallow:/pdfs/