[Pdweb] puredata.info robots.txt disallows everything

IOhannes m zmoelnig zmoelnig at iem.at
Thu Jul 1 22:34:13 CEST 2010


On 2010-07-01 21:32, Hans-Christoph Steiner wrote:
>
>> Oh, you're saying my home cable modem is faster than IEM's internet
>> connection?

am i?

how about: the speed of your home cable modem prevents the server to be
queried (and server requests) at a speed that overloads it?

> What about specifying the large files in the robots.txt file and letting
> the rest be indexed?  It seems to me that /docs, /dev, and /exhibition
> are all just text/HTML and maybe some images so they could be allowed. 
> Or maybe just turn off indexing on /Members and allow it everywhere else.

might work

fgasdr
IOhannes

-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 3636 bytes
Desc: S/MIME Cryptographic Signature
URL: <http://lists.puredata.info/pipermail/pdweb/attachments/20100701/094fc992/attachment.bin>


More information about the Pdweb mailing list