Having watched Brian Teeman's excellent "Hidden Joomla Secrets" talk, I was inspired to try to achieve better Google Image Search traffic (most Joomla sites receive none, as you'll understand if you've listened to the talk!).I came up with the following amendments to the standard Joomla! robots.txt file and would welcome your thoughts... (e.g. some places tell me that there is no such thing as an Allow command, but Google themselves say there is)# Allow Google Images to spider the images folder as well as the largest K2 image filesUser-agent: Googlebot-ImageAllow: /images/stories/Allow: /media/k2/items/cache/*_XL.jpg#Allow the Google AdSense spider to spider the entire site for the purpose of applying appropriate ads. This does not communicate with other Google bots, so won't put your pages into the Google listingsUser-agent: Mediapartners-GoogleAllow: /User-agent: *Disallow: /administrator/Disallow: /cache/Disallow: /components/Disallow: /includes/Disallow: /installation/Disallow: /language/Disallow: /libraries/Disallow: /images/Disallow: /media/Disallow: /modules/Disallow: /plugins/Disallow: /templates/Disallow: /tmp/Disallow: /xmlrpc/
16 years 7 months ago #81787