# Spider.txt file from autoxtra # # Bans from cgi-bin and images # User-agent: * Disallow: *.js Disallow: *.css Disallow: *.php