From: Anton Gorlov <Pnz.Stalker@mail.ru> To: community@altlinux.ru Subject: [Comm] кто врёт Date: Thu, 30 Jun 2005 10:02:29 +0400 Message-ID: <637057457.20050630100229@mail.ru> (raw) Здравствуйте, community. На лог сквида настроено 3 утилиты: calamaris oops-stat webalizer так вот -первые 2 показывают трафф примерно 4 мега (это всё в тесте пока..) а webalizer аш 4 7 мб.. Кто врёт? ВНа всякий сллучай ниже скрипт.. которым собираю статистику #!/bin/sh # # 1. Move tscd logs -> *.date # 2. Move File access.log -> access.log.date # 3. Process Statistics MODE="hourly" if [ "$1" = "dayly" ]; then MODE="dayly" echo "Running dayly mode" fi # # 1. Set COMMON Variables # EXT="log" HOST=fs.local TOPN=100 LOGDIR=/var/log/squid BINDIR=/work/statistics WWWDIR=/var/www/vhosts/fs.local/https/squid PIDFILE=/var/run/squid.pid # # Anything below here does NOT need changing! # umask 022 DATE=`date +%Y%m%d` # YEAR=`date +%Y` MON=`date +%m` DAY=`date +%d` DATE2=${YEAR}${MON} # PID=`cat $PIDFILE` LOGFILE=$LOGDIR/access.log.$DATE STARTDIR=`pwd` cd /work/statistics ############################ Process SQUID Log ############################## ############################ Rename SQUID Log ############################### if [ $MODE = "dayly" ] ; then mv $LOGDIR/access.$EXT $LOGFILE cat /dev/null >$LOGDIR/access.$EXT chown squid:squid $LOGDIR/access.$EXT if [ -f /var/lock/subsys/squid ]; then /etc/rc.d/init.d/squid restart fi else cp $LOGDIR/access.log $LOGFILE fi ########################## Running oops-stat ################################# SUMFILE=$WWWDIR/oops-stat/.SUM/$DATE.sum WWWFILE=$WWWDIR/oops-stat/Dayly/$DATE.html THISDAY=$WWWDIR/oops-stat/ThisDay.html date echo "Processing by oops-stat" echo "Processing $LOGFILE ..." echo "Running access-extract.pl ..." $BINDIR/oops-stat/access-extract.pl < $LOGFILE > $SUMFILE echo "Running access-extract-urls.pl ..." $BINDIR/oops-stat/access-extract-urls.pl < $LOGFILE >> $SUMFILE echo "Generating $WWWFILE ..." echo "Running access-summary.pl ..." $BINDIR/oops-stat/access-summary.pl -p 3128 -m $HOST -n $TOPN -H < $SUMFILE > $WWWFILE cp -f $WWWFILE $THISDAY ####################### Monthly oops-stat statistics ######################### if [ $MODE = "dayly" ] ; then WWWMONTHLY=$WWWDIR/oops-stat/Monthly/$DATE2.html SUMMONTHLY=$WWWDIR/oops-stat/.SUM/$DATE2 THISMONTH=$WWWDIR/oops-stat/ThisMonth.html echo "Running access-summary.pl for whole $MON month ..." cat ${SUMMONTHLY}*.sum | $BINDIR/oops-stat/access-summary.pl -m $HOST -n $TOPN -H > $WWWMONTHLY cp -f $WWWMONTHLY $THISMONTH fi ########################### Running Calamaris ############################### SUMFILE=$WWWDIR/calamaris/.SUM/$DATE.sum WWWFILE=${WWWDIR}/calamaris/Dayly/$DATE.html THISDAY=$WWWDIR/calamaris/ThisDay.html echo "Running calamaris-2.59 - thisday statistic" $BINDIR/calamaris-2.59/calamaris -u -d -1 -P 60 -r -1 -t 20 -s -w -O -o $WWWDIR/calamaris/.SUM/$DATE.sum < $LOGFILE >$WWWFILE cp $WWWFILE $THISDAY if [ $MODE="dayly" ] ; then WWWMONTHLY=${WWWDIR}/calamaris/Monthly/$DATE2.html THISMONTH=$WWWDIR/calamaris/ThisMonth.html echo "Running calamaris summary for whole $MON month ..." (cd ${WWWDIR}/calamaris/.SUM ; cat ${DATE2}* >${WWWDIR}/calamaris/.SUM/${DATE2}.sum ; $BINDIR/calamaris-2.59/calamaris -u -z -i ${WWWDIR}/calamaris/.SUM/${DATE2}.sum -d -1 -P 60 -r -1 -t 20 -s -w -O >$WWWMONTHLY ; rm ${WWWDIR}/calamaris/.SUM/${DATE2}.sum) cp -f $WWWMONTHLY $THISMONTH fi #============================================================================== if [ $MODE = "dayly" ] ; then gzip $LOGFILE else rm $LOGFILE fi #==собираем из кусков целое для обработкой web-alizer'ом================================================================== cp $LOGDIR/access.log.*.gz /work/statistics/tmp/webalizer gunzip /work/statistics/tmp/webalizer/*.gz rm -f /work/statistics/tmp/webalizer/*.gz cp $LOGDIR/access.log cd /work/statistics/tmp/webalizer cat ./access.log.* >>./mysquid.log cat ./access.log >>./mysquid.log webalizer -c /etc/webalizer/squid.conf rm -f /work/statistics/tmp/webalizer/* cd $STARTDIR exit 0 -- С уважением, Anton mailto:Pnz.Stalker@mail.ru FIDO: 2:5059/37
next reply other threads:[~2005-06-30 6:02 UTC|newest] Thread overview: 6+ messages / expand[flat|nested] mbox.gz Atom feed top 2005-06-30 6:02 Anton Gorlov [this message] 2005-06-30 16:23 ` Alexey S. Kuznetsov 2005-06-30 6:37 ` Mike Lykov 2005-06-30 6:45 ` Re[2]: " Anton Gorlov 2005-06-30 16:42 ` Alexey S. Kuznetsov 2005-06-30 6:46 ` Anton Gorlov
Reply instructions: You may reply publicly to this message via plain-text email using any one of the following methods: * Save the following mbox file, import it into your mail client, and reply-to-all from there: mbox Avoid top-posting and favor interleaved quoting: https://en.wikipedia.org/wiki/Posting_style#Interleaved_style * Reply using the --to, --cc, and --in-reply-to switches of git-send-email(1): git send-email \ --in-reply-to=637057457.20050630100229@mail.ru \ --to=pnz.stalker@mail.ru \ --cc=community@altlinux.ru \ /path/to/YOUR_REPLY https://kernel.org/pub/software/scm/git/docs/git-send-email.html * If your mail client supports setting the In-Reply-To header via mailto: links, try the mailto: link
ALT Linux Community general discussions This inbox may be cloned and mirrored by anyone: git clone --mirror http://lore.altlinux.org/community/0 community/git/0.git # If you have public-inbox 1.1+ installed, you may # initialize and index your mirror using the following commands: public-inbox-init -V2 community community/ http://lore.altlinux.org/community \ mandrake-russian@linuxteam.iplabs.ru community@lists.altlinux.org community@lists.altlinux.ru community@lists.altlinux.com public-inbox-index community Example config snippet for mirrors. Newsgroup available over NNTP: nntp://lore.altlinux.org/org.altlinux.lists.community AGPL code for this site: git clone https://public-inbox.org/public-inbox.git