[Pdweb] puredata.info robots.txt disallows everything
IOhannes m zmoelnig
zmoelnig at iem.at
Thu Jul 1 22:34:13 CEST 2010
On 2010-07-01 21:32, Hans-Christoph Steiner wrote:
>
>> Oh, you're saying my home cable modem is faster than IEM's internet
>> connection?
am i?
how about: the speed of your home cable modem prevents the server to be
queried (and server requests) at a speed that overloads it?
> What about specifying the large files in the robots.txt file and letting
> the rest be indexed? It seems to me that /docs, /dev, and /exhibition
> are all just text/HTML and maybe some images so they could be allowed.
> Or maybe just turn off indexing on /Members and allow it everywhere else.
might work
fgasdr
IOhannes
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 3636 bytes
Desc: S/MIME Cryptographic Signature
URL: <http://lists.puredata.info/pipermail/pdweb/attachments/20100701/094fc992/attachment.bin>
More information about the Pdweb
mailing list