[haiku-web] Trac & RobotsTxt

Hi there,

I followed a hint from Stephan, and made Trac serve a robots.txt to 
avoid any crawlers from eating our resources. Maybe this helps with the 
speed a bit, we'll see.

In any case, I made the following changes on Web24:
* Copied and unpacked the robotstxt plugin at work/
* Installed it at trac/plugins
* Renamed trac/conf/trac.ini.save to trac.ini.2008-02-05
* Copied trac.ini to trac.ini.2008-05-14
* Added "robotstxt.* = enabled" in trac.ini
* Created the RobotsTxt wiki page that is now served on incoming 
requests of /robots.txt

It already takes quite a few seconds to get robots.txt (from Germany, 
that is), so I'm not sure if that's the best way to go about it. 
Suggestions welcome :-)

Bye,
   Axel.

-----------------------------------------------------------------------
haiku-web@xxxxxxxxxxxxx - Haiku Web & Developer Support Discussion List

Other related posts: