[dokuwiki] Re: google crawls my export=raw?

Ben Coburn writes:

I don't know if this was what you were thinking of Andi, but how about something like this....

No I thought of looking for the useragent string and the URL and send a forbidden on certain cases. However your suggestion is much better.

If mod-rewrite mode is enabled set the alternate urls to the form:
   _export_xhtml/wiki:dokuwiki
   _export_raw/wiki:dokuwiki


I suggest _export/xhtml/wiki:dokuwiki

Then you can use

User-agent: *
Disallow: _export/

for disallowing all exports

Could you add a feature request to support this in rewrite mode 1 ?

Andi
--
DokuWiki mailing list - more info at
http://wiki.splitbrain.org/wiki:mailinglist

References:
- [dokuwiki] Re: google crawls my export=raw?
  - From: Andreas Gohr
- [dokuwiki] Re: google crawls my export=raw?
  - From: Ben Coburn