From: "Nick S. Grechukh" <nick.grechukh@bigmir.net>
To: smoke-room@altlinux.ru
Subject: Re: [room] robots.txt
Date: Mon, 18 Jul 2005 18:50:01 +0300
Message-ID: <200507181850.02108.nick.grechukh@bigmir.net> (raw)
In-Reply-To: <20050718154220.GP24908@osdn.org.ua>
В сообщении от Понедельник 18 Июль 2005 18:42 Michael Shigorin написал(a):
> On Mon, Jul 18, 2005 at 08:25:18PM +0600, Andrey Rahmatullin wrote:
> > По-моему, кому-то заинтересованному уже пора поискать-таки, что
> > про это пишуть в стандартах... А то пока не особо
> > аргументироанно получается. Ман - не аргумент.
> Блин. Это такой же proposal, как и любой RFC.
> http://www.robotstxt.org/wc/exclusion.html
ну типа да.
many Web Robots offer facilities for Web site administrators and content
providers to limit what the robot does.
Note that these methods rely on cooperation from the Robot, and are by no
means guaranteed to work for every Robot. If you need stronger protection
from robots and other agents, you should use alternative methods such as
password protection.
но произвольный http агент совершенно не обязан что-либо знать о robots.txt.
prev parent reply other threads:[~2005-07-18 15:50 UTC|newest]
Thread overview: 13+ messages / expand[flat|nested] mbox.gz Atom feed top
2005-07-16 10:35 Nick Grechukh
2005-07-16 12:20 ` Eugene Ostapets
2005-07-16 13:12 ` Andrey Rahmatullin
2005-07-16 14:25 ` Eugene Ostapets
2005-07-17 5:23 ` Nick S. Grechukh
2005-07-17 8:46 ` Eugene Ostapets
2005-07-17 9:51 ` Nick S. Grechukh
2005-07-17 19:49 ` Aleksey Korotkov
2005-07-18 4:23 ` Eugene Ostapets
2005-07-18 14:25 ` Andrey Rahmatullin
2005-07-18 14:42 ` Eugene Ostapets
2005-07-18 15:42 ` Michael Shigorin
2005-07-18 15:50 ` Nick S. Grechukh [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=200507181850.02108.nick.grechukh@bigmir.net \
--to=nick.grechukh@bigmir.net \
--cc=smoke-room@altlinux.ru \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Культурный офтопик
This inbox may be cloned and mirrored by anyone:
git clone --mirror http://lore.altlinux.org/smoke-room/0 smoke-room/git/0.git
# If you have public-inbox 1.1+ installed, you may
# initialize and index your mirror using the following commands:
public-inbox-init -V2 smoke-room smoke-room/ http://lore.altlinux.org/smoke-room \
smoke-room@lists.altlinux.org smoke-room@lists.altlinux.ru smoke-room@lists.altlinux.com smoke-room@altlinux.ru smoke-room@altlinux.org smoke-room@altlinux.com
public-inbox-index smoke-room
Example config snippet for mirrors.
Newsgroup available over NNTP:
nntp://lore.altlinux.org/org.altlinux.lists.smoke-room
AGPL code for this site: git clone https://public-inbox.org/public-inbox.git