[devel] hasher и глюки apt'а

[devel] hasher и глюки apt'а

[Alexey Tourbin]

[-- Attachment #1: Type: text/plain, Size: 1947 bytes --]

После долгого обсуждения с swi@ на канале, которе уже обещало стать
бесплодным, удалось докопаться до сути проблемы (невозможности сборки
apache2-mod_python специального вида с помощью gear).

$ hsh --initroot $TMPDIR/build
...
$ hsh-install $TMPDIR/build 'apache2-devel>=2.2.4' 'rpm-build-python>=0.21-alt1' python=2.4 flex python-dev python-modules-encodings
Preparing packages for installation...
ca-certificates-2007.02.06-alt1
libssl6-0.9.8d-alt2
libgdbm-1.8.3-alt3
libapr1-1.2.8-alt1.1
libexpat-2.0.0-alt3.1
libkrb5-1.5.1-alt4
libsasl2-2.1.22-alt1.1.0
libldap2.3-2.3.34-alt1
libaprutil1-1.2.8-alt2
libdb4.4-devel-4.4.20-alt2
perl-DBM-5.8.8-alt9
perl-Digest-SHA1-2.11-alt1
vhosts-filesystem-0.2-alt1
crontab-control-1.1-alt1
setproctitle-0.3.1-alt1
vixie-cron-4.1.20060426-alt2
crontabs-1.8-alt1
logrotate-3.6.2-alt3
apache2-2.2.4-alt16
flex-2.5.33-alt2
python-modules-email-2.4.4-alt10
python-modules-compiler-2.4.4-alt10
python-modules-logging-2.4.4-alt10
python-modules-2.4.4-alt10
python-modules-encodings-2.4.4-alt10
python-modules-curses-2.4.4-alt10
python-modules-xml-2.4.4-alt10
python-modules-hotshot-2.4.4-alt10
python-modules-bsddb-2.4.4-alt10
python-dev-2.4.4-alt10
libapr1-devel-1.2.8-alt1.1
libaprutil1-devel-1.2.8-alt2
apache2-devel-2.2.4-alt16
$ hsh-install $TMPDIR/build 'apache2-devel>=2.2.4' 'rpm-build-python>=0.21-alt1' python=2.4 flex python-dev python-modules-encodings
error: failed dependencies:
        python-strict conflicts with python-relaxed-2.4.4-alt10
        python-relaxed conflicts with python-strict-2.4.4-alt10
hsh-install: Packages installation failed.
$

То есть повторить команду hsh-install не удается.
В связи с этим два вопроса:

1) вопрос скорее ко мне: почему та же самая (повторная) команда на
установку пакетов дает конфликт по python-relaxed и python-strict.

2) вопрос скорее к ldv: почему hasher два раза ставит сборочные
зависимости?

[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]

Re: [devel] hasher и глюки apt'а

[Alexey Tourbin]

[-- Attachment #1: Type: text/plain, Size: 528 bytes --]

On Wed, Apr 04, 2007 at 08:02:53PM +0400, Alexey Tourbin wrote:
> После долгого обсуждения с swi@ на канале, которе уже обещало стать
> бесплодным, удалось докопаться до сути проблемы (невозможности сборки
> apache2-mod_python специального вида с помощью gear).

Вот так вот устойчиво воспроизводится:

hsh --initroot $TMPDIR/build && hsh-install $TMPDIR/build python=2.4 python-dev && hsh-install $TMPDIR/build python=2.4

Причем если убрать python-dev (из первой команды hsh-install), то работает.
Кошмар какой-то.

[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]

Re: [devel] hasher и глюки apt'а

[Dmitry V. Levin]

[-- Attachment #1: Type: text/plain, Size: 430 bytes --]

On Wed, Apr 04, 2007 at 08:02:53PM +0400, Alexey Tourbin wrote:
> 2) вопрос скорее к ldv: почему hasher два раза ставит сборочные
> зависимости?

Когда hasher собирает gear-пакет, сборочные зависимости ставятся трижды:
1. BuildRequires(pre): для того, чтобы работал rpmbuild -bE.
2. BuildRequires: для того, чтобы работал rpmbuild -bs.
3. Зависимости srpm-пакета: для того, чтобы работал rpmbuild --rebuild.


-- 
ldv

[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]

Re: [devel] hasher и глюки apt'а

[Alexey Tourbin]

[-- Attachment #1: Type: text/plain, Size: 539 bytes --]

On Wed, Apr 04, 2007 at 08:24:02PM +0400, Dmitry V. Levin wrote:
> On Wed, Apr 04, 2007 at 08:02:53PM +0400, Alexey Tourbin wrote:
> > 2) вопрос скорее к ldv: почему hasher два раза ставит сборочные
> > зависимости?
> 
> Когда hasher собирает gear-пакет, сборочные зависимости ставятся трижды:
> 1. BuildRequires(pre): для того, чтобы работал rpmbuild -bE.
> 2. BuildRequires: для того, чтобы работал rpmbuild -bs.
> 3. Зависимости srpm-пакета: для того, чтобы работал rpmbuild --rebuild.

В каких случаях 2) отличается от 3) ?

[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]

Re: [devel] hasher и глюки apt'а

[Dmitry V. Levin]

[-- Attachment #1: Type: text/plain, Size: 725 bytes --]

On Wed, Apr 04, 2007 at 08:59:26PM +0400, Alexey Tourbin wrote:
> On Wed, Apr 04, 2007 at 08:24:02PM +0400, Dmitry V. Levin wrote:
> > On Wed, Apr 04, 2007 at 08:02:53PM +0400, Alexey Tourbin wrote:
> > > 2) вопрос скорее к ldv: почему hasher два раза ставит сборочные
> > > зависимости?
> > 
> > Когда hasher собирает gear-пакет, сборочные зависимости ставятся трижды:
> > 1. BuildRequires(pre): для того, чтобы работал rpmbuild -bE.
> > 2. BuildRequires: для того, чтобы работал rpmbuild -bs.
> > 3. Зависимости srpm-пакета: для того, чтобы работал rpmbuild --rebuild.
> 
> В каких случаях 2) отличается от 3) ?

В экзотических: наличе пакета в системе может повлиять на сборочные
зависимости.


-- 
ldv

[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]

Re: [devel] hasher и глюки apt'а

[Alexey Tourbin]

[-- Attachment #1: Type: text/plain, Size: 300 bytes --]

On Wed, Apr 04, 2007 at 08:02:53PM +0400, Alexey Tourbin wrote:
> 1) вопрос скорее ко мне: почему та же самая (повторная) команда на
> установку пакетов дает конфликт по python-relaxed и python-strict.

JFYI, APT-RPM development switches from Subversion to GIT (25.02.2007)
http://apt-rpm.org/

[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]

Re: [devel] hasher и глюки apt'а

[Alexey Tourbin]

[-- Attachment #1: Type: text/plain, Size: 1000 bytes --]

On Wed, Apr 04, 2007 at 08:02:53PM +0400, Alexey Tourbin wrote:
> $ hsh-install $TMPDIR/build 'apache2-devel>=2.2.4' 'rpm-build-python>=0.21-alt1' python=2.4 flex python-dev python-modules-encodings
> error: failed dependencies:
>         python-strict conflicts with python-relaxed-2.4.4-alt10
>         python-relaxed conflicts with python-strict-2.4.4-alt10
> hsh-install: Packages installation failed.
> $

Забавно.

[at@hint1 ~]$ /tmp/.private/at/build/aptbox/apt-get --dry-run install python=2.4
Reading Package Lists... Done
Building Dependency Tree... Done
Selected version python-relaxed#2.4.4-alt10 for python=2.4
The following packages will be REMOVED:
  python-strict
The following NEW packages will be installed:
  python-relaxed
0 upgraded, 1 newly installed, 1 removed and 0 not upgraded.
Remv python-strict (2.4.4-alt10 Sisyphus:unstable/)
Inst python-relaxed (2.4.4-alt10 Sisyphus:unstable/)
Conf python-relaxed (2.4.4-alt10 Sisyphus:unstable/)
[at@hint1 ~]$ 

[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]

Re: [devel] hasher и глюки apt'а

[Alexey Tourbin]

[-- Attachment #1: Type: text/plain, Size: 2333 bytes --]

On Wed, Apr 04, 2007 at 10:40:12PM +0400, Alexey Tourbin wrote:
> On Wed, Apr 04, 2007 at 08:02:53PM +0400, Alexey Tourbin wrote:
> > $ hsh-install $TMPDIR/build 'apache2-devel>=2.2.4' 'rpm-build-python>=0.21-alt1' python=2.4 flex python-dev python-modules-encodings
> > error: failed dependencies:
> >         python-strict conflicts with python-relaxed-2.4.4-alt10
> >         python-relaxed conflicts with python-strict-2.4.4-alt10
> > hsh-install: Packages installation failed.
> > $
> 
> Забавно.
> 
> [at@hint1 ~]$ /tmp/.private/at/build/aptbox/apt-get --dry-run install python=2.4
> Reading Package Lists... Done
> Building Dependency Tree... Done
> Selected version python-relaxed#2.4.4-alt10 for python=2.4
> The following packages will be REMOVED:
>   python-strict
> The following NEW packages will be installed:
>   python-relaxed
> 0 upgraded, 1 newly installed, 1 removed and 0 not upgraded.
> Remv python-strict (2.4.4-alt10 Sisyphus:unstable/)
> Inst python-relaxed (2.4.4-alt10 Sisyphus:unstable/)
> Conf python-relaxed (2.4.4-alt10 Sisyphus:unstable/)
> [at@hint1 ~]$ 

Ха-ха-ха!

[at@hint1 ~]$ hsh --initroot $TMPDIR/build
Components: hasher
Processing pkglists... hasher done
Processing srclists...  hasher done
Creating component releases... done
Updating global release file... done
Appending MD5Sum... hasher done
All your base are belong to us!!!
[at@hint1 ~]$ hsh-install $TMPDIR/build python=2.4 python=2.4
Reading Package Lists...
Building Dependency Tree...
Selected version python-strict#2.4.4-alt10 for python=2.4
Selected version python-relaxed#2.4.4-alt10 for python=2.4
Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:

The following packages have unmet dependencies:
  python-relaxed: Conflicts: python-strict but 2.4.4-alt10 is to be installed
  python-strict: Conflicts: python-relaxed but 2.4.4-alt10 is to be installed
E: Broken packages
hsh-install: failed to calculate package file list.
hsh-install: Failed to generate package file list.
[at@hint1 ~]$ 

Что там писал про apt комрад Луговский?

[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]

Re: [devel] hasher и глюки apt'а

[Alexey Tourbin]

[-- Attachment #1: Type: text/plain, Size: 1139 bytes --]

On Wed, Apr 04, 2007 at 10:21:14PM +0400, Alexey Tourbin wrote:
> On Wed, Apr 04, 2007 at 08:02:53PM +0400, Alexey Tourbin wrote:
> > 1) вопрос скорее ко мне: почему та же самая (повторная) команда на
> > установку пакетов дает конфликт по python-relaxed и python-strict.
> 
> JFYI, APT-RPM development switches from Subversion to GIT (25.02.2007)
> http://apt-rpm.org/

$ git-clone http://apt-rpm.org/scm/apt.git
...
got cf6e1c019d4b89ecaa17dd1663f1322be46b9837
*** glibc detected *** git-http-fetch: corrupted double-linked list: 0x00000000006a6d80 ***
======= Backtrace: =========
/lib64/libc.so.6[0x2aaaab2dde1e]
/lib64/libc.so.6[0x2aaaab2dfdcd]
/lib64/libc.so.6(__libc_calloc+0x96)[0x2aaaab2e1296]
/usr/lib64/libcurl.so.4(Curl_connect+0x5f)[0x2aaaab04d58f]
/usr/lib64/libcurl.so.4[0x2aaaab05f431]
/usr/lib64/libcurl.so.4(curl_multi_perform+0x5b)[0x2aaaab0602eb]
git-http-fetch[0x40389f]
git-http-fetch[0x40392e]
git-http-fetch[0x405ef7]
git-http-fetch[0x403245]
git-http-fetch[0x40598a]
/lib64/libc.so.6(__libc_start_main+0xf4)[0x2aaaab291c14]
git-http-fetch(fwrite+0x111)[0x402af9]

git-core-1.5.0.4-alt1

[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]

Re: [devel] hasher и глюки apt'а

[Alexey Tourbin]

[-- Attachment #1: Type: text/plain, Size: 1293 bytes --]

On Thu, Apr 05, 2007 at 12:18:02AM +0400, Alexey Tourbin wrote:
> [at@hint1 ~]$ hsh-install $TMPDIR/build python=2.4 python=2.4
> Reading Package Lists...
> Building Dependency Tree...
> Selected version python-strict#2.4.4-alt10 for python=2.4
> Selected version python-relaxed#2.4.4-alt10 for python=2.4

Ура!  Расковырял!

Там есть глюк в Fix_.ScoreSort; почему-то если пакет уже установлен
или выбран для установки, то его score понижается.  Но я решил это дело
просто обойти стороной.

at@solemn BUILD/apt-0.5.15lorg2/cmdline 3 $ PATH=$PWD:$PATH ~tmp/build/aptbox/apt-get --dry-run install python=2.4 python=2.4
Reading Package Lists... Done
Building Dependency Tree... Done
Selected version python-strict#2.4.4-alt10 for python=2.4
Version python-strict#2.4.4-alt10 for python=2.4 is already selected for install
...


$ ./apt-get --dry-run install python=2.4 python=2.4                                
Reading Package Lists... Done
Building Dependency Tree... Done
Version python-strict#2.4.4-alt10 for python=2.4 is already installed
python-strict is already the newest version.
Version python-strict#2.4.4-alt10 for python=2.4 is already installed
python-strict is already the newest version.
0 upgraded, 0 newly installed, 0 removed and 67 not upgraded.

[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]

Re: [devel] hasher и глюки apt'а

[Alexey Tourbin]

[-- Attachment #1: Type: text/plain, Size: 1275 bytes --]

On Thu, Apr 05, 2007 at 02:00:41AM +0400, Alexey Tourbin wrote:
> On Thu, Apr 05, 2007 at 12:18:02AM +0400, Alexey Tourbin wrote:
> > [at@hint1 ~]$ hsh-install $TMPDIR/build python=2.4 python=2.4
> > Reading Package Lists...
> > Building Dependency Tree...
> > Selected version python-strict#2.4.4-alt10 for python=2.4
> > Selected version python-relaxed#2.4.4-alt10 for python=2.4

> Там есть глюк в Fix_.ScoreSort; почему-то если пакет уже установлен
> или выбран для установки, то его score понижается.
> просто обойти стороной.

Нет, похоже это моя ошибка.  Fix_.ScoreSort как раз увеличивает score,
если пакет уже установлен.  Точнее, ScoreSort просто сортирует
пакеты по возрастанию score, чего нельзя понять из названия функции.
Посмотрите на этот код:

int pkgProblemResolver::ScoreSort(const void *a,const void *b)
{  
   Package const **A = (Package const **)a;
   Package const **B = (Package const **)b;
   if (This->Scores[(*A)->ID] > This->Scores[(*B)->ID])
      return -1;
   if (This->Scores[(*A)->ID] < This->Scores[(*B)->ID])
      return 1;
   return 0;
}                                                                       

По-моему если кто-то пишет 'if (a>b) return -1' а функция называется
Sort а не ReverseSort то...

[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]

Re: [devel] hasher и глюки apt'а

[Igor Zubkov]

В сообщении от Thursday 05 April 2007 00:04:05 Alexey Tourbin написал(а):
> git-core-1.5.0.4-alt1

На git-core-1.5.0.6-alt1 -- аналогично.
got e7e70ebd3caa7cca59bdec9b203e0974a759039b
*** glibc detected *** git-http-fetch: corrupted double-linked list: 
0x080942d0 ***
======= Backtrace: =========
/lib/libc.so.6[0xb7d52402]
/lib/libc.so.6[0xb7d5476d]
/lib/libc.so.6(__libc_calloc+0x8d)[0xb7d558ad]
/usr/lib/libcurl.so.4(Curl_connect+0x7a)[0xb7e2dcfa]
/usr/lib/libcurl.so.4[0xb7e4000e]
/usr/lib/libcurl.so.4(curl_multi_perform+0x62)[0xb7e40f52]
git-http-fetch[0x804abe1]
git-http-fetch[0x804ac7b]
git-http-fetch[0x804d45b]
git-http-fetch[0x804a520]
git-http-fetch[0x804cee9]
/lib/libc.so.6(__libc_start_main+0xdc)[0xb7d0605c]
git-http-fetch[0x8049e11]
======= Memory map: ========
08048000-08069000 r-xp 00000000 03:06 1056511    /usr/bin/git-http-fetch
08069000-0806a000 rw-p 00021000 03:06 1056511    /usr/bin/git-http-fetch
0806a000-08348000 rw-p 0806a000 00:00 0          [heap]

[icesik@iceberg git]$ uname -a
Linux iceberg.work 2.6.18-std-smp-alt5 #1 SMP Fri Mar 9 17:41:44 MSK 2007 i686 
GNU/Linux
[icesik@iceberg git]$  

-- 
icesik

Re: [devel] hasher и глюки apt'а

[Igor Zubkov]

В сообщении от Thursday 05 April 2007 00:04:05 Alexey Tourbin написал(а):
> git-core-1.5.0.4-alt1

got b03044dcd68e304cb8f8151b59d136ed0d62a9bb
got de9b742f390738e7e4a52e0c6901f8ee71c13517
/usr/bin/git-clone: line 33:  5608 Ошибка сегментирования  
git-http-fetch -v -a -w "$tname" "$name" "$1/"
[icesik@iceberg git2]$ rpm -q git-core
git-core-1.5.0.7-alt1
[icesik@iceberg git2]$ 

Фактически, тоже самое.

-- 
icesik

Re: [devel] hasher и глюки apt'а

[Alexey Tourbin]

[-- Attachment #1: Type: text/plain, Size: 852 bytes --]

On Wed, Apr 04, 2007 at 08:02:53PM +0400, Alexey Tourbin wrote:
> $ hsh-install $TMPDIR/build 'apache2-devel>=2.2.4' 'rpm-build-python>=0.21-alt1' python=2.4 flex python-dev python-modules-encodings
> error: failed dependencies:
>         python-strict conflicts with python-relaxed-2.4.4-alt10
>         python-relaxed conflicts with python-strict-2.4.4-alt10
> hsh-install: Packages installation failed.
> $

Подготовил новую сборку apt'а, в которой все эти проблемы исправлены.

0.5.15lorg2-alt11

- Updated 'apt-get install' algorithm for versioned dependencies:
  + fixed wrong usage of ScoreSort condition introduced in previous release;
  + added explicit check if any package satisfying versioned dependency is
    already installed or selected for install; in this case, apt-get will
    not try to install any other package.

[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]