On Wed, Jul 18, 2018 at 09:48:40PM +0400, Evgeny Sinelnikov wrote: > Здравствуйте, > > В течении последней недели в сизифе сломалась сборка virtualbox под x86_64: > http://git.altlinux.org/tasks/209753/ > > Было так: > http://git.altlinux.org/tasks/209753/logs/events.3.1.log > > А стало так: > http://git.altlinux.org/tasks/209753/logs/events.4.1.log > > Сыпется так: > http://git.altlinux.org/tasks/209753/build/260/x86_64/log > > В чём дело - пока не ясно. Может кто подскажет? Очевидно, сборка слишком прожорливая. Сборка events.3.1 была на новом сервере, где памяти побольше. Но он вышел из строя, и сборка events.4.1 была на старом сервере, где для каждой сборки действует лимит 31Gb на память+tmpfs. cc1plus invoked oom-killer: gfp_mask=0x14000c0(GFP_KERNEL), nodemask=(null), order=0, oom_score_adj=0 cc1plus cpuset=bee03 mems_allowed=0-3 CPU: 8 PID: 1255 Comm: cc1plus Not tainted 4.14.55-std-def-alt1 #1 Call Trace: dump_stack+0x72/0x8a dump_header+0x8f/0x221 oom_kill_process+0x217/0x410 out_of_memory+0x109/0x470 mem_cgroup_out_of_memory+0x44/0x70 mem_cgroup_oom_synchronize+0x354/0x380 ? get_mem_cgroup_from_mm+0x90/0x90 pagefault_out_of_memory+0x2a/0x6f __do_page_fault+0x4a9/0x4e0 ? page_fault+0x2f/0x50 page_fault+0x45/0x50 RIP: 0004:0xfffffffffffffff8 RSP: 03f8:00000000000003f8 EFLAGS: 0000007f Task in /user/bee03 killed as a result of limit of /user/bee03 memory: usage 32505856kB, limit 32505856kB, failcnt 0 memory+swap: usage 32505856kB, limit 32505856kB, failcnt 84105 kmem: usage 220452kB, limit 9007199254740988kB, failcnt 0 Memory cgroup stats for /user/bee03: cache:4994496KB rss:27290908KB rss_huge:8482816KB shmem:4994496KB mapped_file:25696KB dirty:0KB writeback:0KB swap:0KB inactive_anon:2151596KB active_anon:30133028KB inactive_file:0KB active_file:0KB unevictable:0KB [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name [18761] 0 18761 18644 1499 40 3 0 0 sshd [18766] 524 18766 18682 1013 38 3 0 0 sshd [32004] 524 32004 1714 543 8 3 0 0 gb-remote-build [ 7076] 524 7076 2328 647 9 3 0 0 hsh-rebuild [ 9924] 524 9924 1714 539 7 3 0 0 chrootuid2.sh [ 9930] 524 9930 1616 424 8 3 0 0 hasher-priv [ 9931] 526 9931 2244 530 9 3 0 0 entry [ 9934] 526 9934 1041 195 7 3 0 0 time [ 9939] 526 9939 9784 1376 23 3 0 0 rpmbuild [10155] 526 10155 2244 600 9 3 0 0 sh [11047] 526 11047 32468 28620 66 3 0 0 kmk [ 1205] 526 1205 1352 202 7 3 0 0 x86_64-alt-linu [ 1206] 526 1206 290400 245531 507 4 0 0 cc1plus [ 1208] 526 1208 4443 1916 13 3 0 0 as [ 1210] 526 1210 1352 210 6 3 0 0 x86_64-alt-linu [ 1211] 526 1211 312076 265056 546 5 0 0 cc1plus [ 1212] 526 1212 4443 1915 13 3 0 0 as [ 1219] 526 1219 1352 201 7 3 0 0 x86_64-alt-linu [ 1220] 526 1220 291886 243958 506 4 0 0 cc1plus [ 1221] 526 1221 4444 1990 12 3 0 0 as [ 1223] 526 1223 1352 202 7 3 0 0 x86_64-alt-linu [ 1224] 526 1224 278893 232326 481 4 0 0 cc1plus [ 1225] 526 1225 4444 1879 12 3 0 0 as [ 1226] 526 1226 1352 201 7 3 0 0 x86_64-alt-linu [ 1227] 526 1227 248500 218420 451 3 0 0 cc1plus [ 1228] 526 1228 4445 1991 12 3 0 0 as [ 1229] 526 1229 1352 202 7 3 0 0 x86_64-alt-linu [ 1230] 526 1230 258121 229042 470 4 0 0 cc1plus [ 1231] 526 1231 4444 1990 12 3 0 0 as [ 1236] 526 1236 1352 209 7 3 0 0 x86_64-alt-linu [ 1237] 526 1237 277177 245658 508 4 0 0 cc1plus [ 1238] 526 1238 4444 1992 12 3 0 0 as [ 1239] 526 1239 1352 203 7 3 0 0 x86_64-alt-linu [ 1240] 526 1240 262509 230721 475 4 0 0 cc1plus [ 1241] 526 1241 4444 1880 12 3 0 0 as [ 1242] 526 1242 1352 210 7 3 0 0 x86_64-alt-linu [ 1243] 526 1243 257226 226529 467 4 0 0 cc1plus [ 1244] 526 1244 1352 210 7 3 0 0 x86_64-alt-linu [ 1245] 526 1245 4906 2408 13 3 0 0 as [ 1246] 526 1246 263616 231767 479 4 0 0 cc1plus [ 1247] 526 1247 4445 1990 12 3 0 0 as [ 1248] 526 1248 1352 210 6 3 0 0 x86_64-alt-linu [ 1249] 526 1249 263533 230627 480 4 0 0 cc1plus [ 1250] 526 1250 4444 1880 11 3 0 0 as [ 1251] 526 1251 1352 201 7 3 0 0 x86_64-alt-linu [ 1252] 526 1252 263487 230922 480 4 0 0 cc1plus [ 1253] 526 1253 4444 1991 12 3 0 0 as [ 1254] 526 1254 1352 209 7 3 0 0 x86_64-alt-linu [ 1255] 526 1255 263481 230856 481 4 0 0 cc1plus [ 1256] 526 1256 4444 1991 12 3 0 0 as [ 1257] 526 1257 1352 202 7 3 0 0 x86_64-alt-linu [ 1258] 526 1258 264065 231621 481 4 0 0 cc1plus [ 1259] 526 1259 4444 1991 12 3 0 0 as [ 1260] 526 1260 1352 209 7 3 0 0 x86_64-alt-linu [ 1261] 526 1261 264148 231528 480 4 0 0 cc1plus [ 1262] 526 1262 1352 210 7 3 0 0 x86_64-alt-linu [ 1263] 526 1263 4445 1879 12 3 0 0 as [ 1264] 526 1264 262477 230598 476 4 0 0 cc1plus [ 1265] 526 1265 4444 1879 14 3 0 0 as [ 1266] 526 1266 1352 202 7 3 0 0 x86_64-alt-linu [ 1267] 526 1267 262535 230128 476 4 0 0 cc1plus [ 1268] 526 1268 4444 1990 12 3 0 0 as [ 1269] 526 1269 1352 202 6 3 0 0 x86_64-alt-linu [ 1270] 526 1270 261909 229107 477 4 0 0 cc1plus [ 1271] 526 1271 1352 210 7 3 0 0 x86_64-alt-linu [ 1272] 526 1272 4444 1880 12 3 0 0 as [ 1273] 526 1273 261959 229762 476 4 0 0 cc1plus [ 1274] 526 1274 4444 1992 12 3 0 0 as [ 1275] 526 1275 1352 203 7 3 0 0 x86_64-alt-linu [ 1276] 526 1276 262956 230624 476 4 0 0 cc1plus [ 1277] 526 1277 4444 1990 12 3 0 0 as [ 1278] 526 1278 1352 209 7 3 0 0 x86_64-alt-linu [ 1279] 526 1279 262033 229916 475 4 0 0 cc1plus [ 1280] 526 1280 4444 1991 12 3 0 0 as [ 1281] 526 1281 1352 209 7 3 0 0 x86_64-alt-linu [ 1282] 526 1282 259420 227126 472 4 0 0 cc1plus [ 1283] 526 1283 4444 1990 12 3 0 0 as [ 1284] 526 1284 1352 202 7 3 0 0 x86_64-alt-linu [ 1285] 526 1285 257173 225895 467 4 0 0 cc1plus [ 1286] 526 1286 4444 1991 12 3 0 0 as [ 1287] 526 1287 1352 209 7 3 0 0 x86_64-alt-linu [ 1289] 526 1289 257170 225727 467 4 0 0 cc1plus [ 1290] 526 1290 4445 1991 12 3 0 0 as [ 1291] 526 1291 1352 201 6 3 0 0 x86_64-alt-linu [ 1292] 526 1292 256656 225392 465 4 0 0 cc1plus [ 1293] 526 1293 4444 1991 12 3 0 0 as [ 1294] 526 1294 1352 201 7 3 0 0 x86_64-alt-linu [ 1295] 526 1295 249832 217307 455 4 0 0 cc1plus [ 1296] 526 1296 4445 1990 11 3 0 0 as [ 1297] 526 1297 1352 202 7 3 0 0 x86_64-alt-linu [ 1298] 526 1298 223962 192286 403 4 0 0 cc1plus [ 1299] 526 1299 4444 1879 12 3 0 0 as [ 1305] 526 1305 1352 210 7 3 0 0 x86_64-alt-linu [ 1306] 526 1306 200402 168340 359 4 0 0 cc1plus [ 1307] 526 1307 4444 1880 13 3 0 0 as [ 1308] 526 1308 1352 210 7 3 0 0 x86_64-alt-linu [ 1309] 526 1309 199369 167000 355 3 0 0 cc1plus [ 1310] 526 1310 4444 1880 12 3 0 0 as [ 1311] 526 1311 1352 202 7 3 0 0 x86_64-alt-linu [ 1312] 526 1312 164058 147956 313 3 0 0 cc1plus [ 1313] 526 1313 4444 1990 13 3 0 0 as [ 1315] 526 1315 1352 202 7 3 0 0 x86_64-alt-linu [ 1316] 526 1316 108398 92749 206 4 0 0 cc1plus [ 1317] 526 1317 4444 1991 12 3 0 0 as [ 1318] 526 1318 1352 201 7 3 0 0 x86_64-alt-linu [ 1319] 526 1319 93902 78323 180 4 0 0 cc1plus [ 1320] 526 1320 4444 1879 12 3 0 0 as Memory cgroup out of memory: Kill process 1211 (cc1plus) score 32 or sacrifice child Killed process 1211 (cc1plus) total-vm:1248304kB, anon-rss:1045372kB, file-rss:4kB, shmem-rss:14848kB -- ldv