From: Anton Gorlov <Pnz.Stalker@mail.ru>
To: community@altlinux.ru
Subject: [Comm] кто врёт
Date: Thu, 30 Jun 2005 10:02:29 +0400
Message-ID: <637057457.20050630100229@mail.ru> (raw)
Здравствуйте, community.
На лог сквида настроено 3 утилиты:
calamaris
oops-stat
webalizer
так вот -первые 2 показывают трафф примерно 4 мега (это всё в тесте
пока..) а webalizer аш 4 7 мб.. Кто врёт? ВНа всякий сллучай ниже
скрипт.. которым собираю статистику
#!/bin/sh
#
# 1. Move tscd logs -> *.date
# 2. Move File access.log -> access.log.date
# 3. Process Statistics
MODE="hourly"
if [ "$1" = "dayly" ]; then
MODE="dayly"
echo "Running dayly mode"
fi
#
# 1. Set COMMON Variables
#
EXT="log"
HOST=fs.local
TOPN=100
LOGDIR=/var/log/squid
BINDIR=/work/statistics
WWWDIR=/var/www/vhosts/fs.local/https/squid
PIDFILE=/var/run/squid.pid
#
# Anything below here does NOT need changing!
#
umask 022
DATE=`date +%Y%m%d`
#
YEAR=`date +%Y`
MON=`date +%m`
DAY=`date +%d`
DATE2=${YEAR}${MON}
#
PID=`cat $PIDFILE`
LOGFILE=$LOGDIR/access.log.$DATE
STARTDIR=`pwd`
cd /work/statistics
############################ Process SQUID Log ##############################
############################ Rename SQUID Log ###############################
if [ $MODE = "dayly" ] ; then
mv $LOGDIR/access.$EXT $LOGFILE
cat /dev/null >$LOGDIR/access.$EXT
chown squid:squid $LOGDIR/access.$EXT
if [ -f /var/lock/subsys/squid ]; then
/etc/rc.d/init.d/squid restart
fi
else
cp $LOGDIR/access.log $LOGFILE
fi
########################## Running oops-stat #################################
SUMFILE=$WWWDIR/oops-stat/.SUM/$DATE.sum
WWWFILE=$WWWDIR/oops-stat/Dayly/$DATE.html
THISDAY=$WWWDIR/oops-stat/ThisDay.html
date
echo "Processing by oops-stat"
echo "Processing $LOGFILE ..."
echo "Running access-extract.pl ..."
$BINDIR/oops-stat/access-extract.pl < $LOGFILE > $SUMFILE
echo "Running access-extract-urls.pl ..."
$BINDIR/oops-stat/access-extract-urls.pl < $LOGFILE >> $SUMFILE
echo "Generating $WWWFILE ..."
echo "Running access-summary.pl ..."
$BINDIR/oops-stat/access-summary.pl -p 3128 -m $HOST -n $TOPN -H < $SUMFILE > $WWWFILE
cp -f $WWWFILE $THISDAY
####################### Monthly oops-stat statistics #########################
if [ $MODE = "dayly" ] ; then
WWWMONTHLY=$WWWDIR/oops-stat/Monthly/$DATE2.html
SUMMONTHLY=$WWWDIR/oops-stat/.SUM/$DATE2
THISMONTH=$WWWDIR/oops-stat/ThisMonth.html
echo "Running access-summary.pl for whole $MON month ..."
cat ${SUMMONTHLY}*.sum | $BINDIR/oops-stat/access-summary.pl -m $HOST -n $TOPN -H > $WWWMONTHLY
cp -f $WWWMONTHLY $THISMONTH
fi
########################### Running Calamaris ###############################
SUMFILE=$WWWDIR/calamaris/.SUM/$DATE.sum
WWWFILE=${WWWDIR}/calamaris/Dayly/$DATE.html
THISDAY=$WWWDIR/calamaris/ThisDay.html
echo "Running calamaris-2.59 - thisday statistic"
$BINDIR/calamaris-2.59/calamaris -u -d -1 -P 60 -r -1 -t 20 -s -w -O -o $WWWDIR/calamaris/.SUM/$DATE.sum < $LOGFILE >$WWWFILE
cp $WWWFILE $THISDAY
if [ $MODE="dayly" ] ; then
WWWMONTHLY=${WWWDIR}/calamaris/Monthly/$DATE2.html
THISMONTH=$WWWDIR/calamaris/ThisMonth.html
echo "Running calamaris summary for whole $MON month ..."
(cd ${WWWDIR}/calamaris/.SUM ; cat ${DATE2}* >${WWWDIR}/calamaris/.SUM/${DATE2}.sum ; $BINDIR/calamaris-2.59/calamaris -u -z -i ${WWWDIR}/calamaris/.SUM/${DATE2}.sum -d -1 -P 60 -r -1 -t 20 -s -w -O >$WWWMONTHLY ; rm ${WWWDIR}/calamaris/.SUM/${DATE2}.sum)
cp -f $WWWMONTHLY $THISMONTH
fi
#==============================================================================
if [ $MODE = "dayly" ] ; then
gzip $LOGFILE
else
rm $LOGFILE
fi
#==собираем из кусков целое для обработкой web-alizer'ом==================================================================
cp $LOGDIR/access.log.*.gz /work/statistics/tmp/webalizer
gunzip /work/statistics/tmp/webalizer/*.gz
rm -f /work/statistics/tmp/webalizer/*.gz
cp $LOGDIR/access.log
cd /work/statistics/tmp/webalizer
cat ./access.log.* >>./mysquid.log
cat ./access.log >>./mysquid.log
webalizer -c /etc/webalizer/squid.conf
rm -f /work/statistics/tmp/webalizer/*
cd $STARTDIR
exit 0
--
С уважением,
Anton mailto:Pnz.Stalker@mail.ru
FIDO: 2:5059/37
next reply other threads:[~2005-06-30 6:02 UTC|newest]
Thread overview: 6+ messages / expand[flat|nested] mbox.gz Atom feed top
2005-06-30 6:02 Anton Gorlov [this message]
2005-06-30 16:23 ` Alexey S. Kuznetsov
2005-06-30 6:37 ` Mike Lykov
2005-06-30 6:45 ` Re[2]: " Anton Gorlov
2005-06-30 16:42 ` Alexey S. Kuznetsov
2005-06-30 6:46 ` Anton Gorlov
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=637057457.20050630100229@mail.ru \
--to=pnz.stalker@mail.ru \
--cc=community@altlinux.ru \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
ALT Linux Community general discussions
This inbox may be cloned and mirrored by anyone:
git clone --mirror http://lore.altlinux.org/community/0 community/git/0.git
# If you have public-inbox 1.1+ installed, you may
# initialize and index your mirror using the following commands:
public-inbox-init -V2 community community/ http://lore.altlinux.org/community \
mandrake-russian@linuxteam.iplabs.ru community@lists.altlinux.org community@lists.altlinux.ru community@lists.altlinux.com
public-inbox-index community
Example config snippet for mirrors.
Newsgroup available over NNTP:
nntp://lore.altlinux.org/org.altlinux.lists.community
AGPL code for this site: git clone https://public-inbox.org/public-inbox.git