From: Aleksey Korotkov <ziga@udm.net> To: "культурный офтопик" <smoke-room@altlinux.ru> Subject: Re: [room] robots.txt Date: Mon, 18 Jul 2005 00:49:36 +0500 Message-ID: <20050718004936.1e128d28.ziga@udm.net> (raw) In-Reply-To: <dbd9mg$ifh$1@sea.gmane.org> On Sun, 17 Jul 2005 12:51:12 +0300 Nick S. Grechukh wrote: NSG> дык я ж схему защиты предлагаю :) нужно доказать что их паук НЕ NSG> скачал этот файл (а качать не обязан). vs. скачал но не послушался. wget'у, например, легко сказать -- качать robots.txt или нет: [ziga@localhost etc]$ cat wgetrc |grep -A 2 robots.txt # Setting this to off makes Wget not download /robots.txt. Be sure to # know *exactly* what /robots.txt is and how it is used before changing # the default! #robots = on -- С уважением, Алексей Коротков mailto:ziga@uni.udm.ru
next prev parent reply other threads:[~2005-07-17 19:49 UTC|newest] Thread overview: 13+ messages / expand[flat|nested] mbox.gz Atom feed top 2005-07-16 10:35 Nick Grechukh 2005-07-16 12:20 ` Eugene Ostapets 2005-07-16 13:12 ` Andrey Rahmatullin 2005-07-16 14:25 ` Eugene Ostapets 2005-07-17 5:23 ` Nick S. Grechukh 2005-07-17 8:46 ` Eugene Ostapets 2005-07-17 9:51 ` Nick S. Grechukh 2005-07-17 19:49 ` Aleksey Korotkov [this message] 2005-07-18 4:23 ` Eugene Ostapets 2005-07-18 14:25 ` Andrey Rahmatullin 2005-07-18 14:42 ` Eugene Ostapets 2005-07-18 15:42 ` Michael Shigorin 2005-07-18 15:50 ` Nick S. Grechukh
Reply instructions: You may reply publicly to this message via plain-text email using any one of the following methods: * Save the following mbox file, import it into your mail client, and reply-to-all from there: mbox Avoid top-posting and favor interleaved quoting: https://en.wikipedia.org/wiki/Posting_style#Interleaved_style * Reply using the --to, --cc, and --in-reply-to switches of git-send-email(1): git send-email \ --in-reply-to=20050718004936.1e128d28.ziga@udm.net \ --to=ziga@udm.net \ --cc=smoke-room@altlinux.ru \ /path/to/YOUR_REPLY https://kernel.org/pub/software/scm/git/docs/git-send-email.html * If your mail client supports setting the In-Reply-To header via mailto: links, try the mailto: link
Культурный офтопик This inbox may be cloned and mirrored by anyone: git clone --mirror http://lore.altlinux.org/smoke-room/0 smoke-room/git/0.git # If you have public-inbox 1.1+ installed, you may # initialize and index your mirror using the following commands: public-inbox-init -V2 smoke-room smoke-room/ http://lore.altlinux.org/smoke-room \ smoke-room@lists.altlinux.org smoke-room@lists.altlinux.ru smoke-room@lists.altlinux.com smoke-room@altlinux.ru smoke-room@altlinux.org smoke-room@altlinux.com public-inbox-index smoke-room Example config snippet for mirrors. Newsgroup available over NNTP: nntp://lore.altlinux.org/org.altlinux.lists.smoke-room AGPL code for this site: git clone https://public-inbox.org/public-inbox.git