Skocz do zawartości
Zaloguj się, aby obserwować  
Pietyk

Pady serwera

Polecane posty

Witam,

 

Mam taki problem co jakis czas serwer jakby sie zawieszal. Z niczym nie da sie polaczyc.

 

W logach mam (daemon.log):

 

May  7 04:56:36 srv1 named[2613]: unexpected RCODE (REFUSED) resolving '52.183.224.67.in-addr.arpa/PTR/IN': 196.28.61.145#53
May  7 05:10:52 srv1 named[2613]: lame server resolving 'matrix.cidernet.pl' (in 'cidernet.pl'?): 85.255.0.5#53
May  7 05:10:53 srv1 named[2613]: lame server resolving 'ns2.akk.net.pl' (in 'akk.net.pl'?): 85.255.0.5#53
May  7 05:10:53 srv1 named[2613]: unexpected RCODE (SERVFAIL) resolving '2.140.51.80.in-addr.arpa/PTR/IN': 80.50.50.50#53
May  7 05:10:53 srv1 named[2613]: lame server resolving '2.140.51.80.in-addr.arpa' (in '140.51.80.in-addr.arpa'?): 85.14.72.10#53
May  7 05:10:53 srv1 named[2613]: unexpected RCODE (SERVFAIL) resolving '2.140.51.80.in-addr.arpa/PTR/IN': 80.50.50.50#53
May  7 05:10:53 srv1 named[2613]: lame server resolving '2.140.51.80.in-addr.arpa' (in '140.51.80.in-addr.arpa'?): 85.14.72.10#53
May  7 05:16:04 srv1 named[2613]: lame server resolving '146.144/28.205.195.81.in-addr.arpa' (in '144/28.205.195.81.in-addr.arpa'?): 212.188.8.37#53
May  7 05:16:30 srv1 last message repeated 7 times
May  7 05:17:06 srv1 named[2613]: lame server resolving '2.198.117.195.in-addr.arpa' (in '198.117.195.in-addr.arpa'?): 194.204.159.1#53
May  7 05:17:06 srv1 named[2613]: lame server resolving '2.198.117.195.in-addr.arpa' (in '198.117.195.in-addr.arpa'?): 88.220.88.3#53
May  7 05:17:06 srv1 named[2613]: lame server resolving '2.198.117.195.in-addr.arpa' (in '198.117.195.in-addr.arpa'?): 194.204.159.1#53
May  7 05:17:06 srv1 named[2613]: lame server resolving '2.198.117.195.in-addr.arpa' (in '198.117.195.in-addr.arpa'?): 88.220.88.3#53
May  7 05:17:06 srv1 named[2613]: lame server resolving '2.198.117.195.in-addr.arpa' (in '198.117.195.in-addr.arpa'?): 194.204.159.1#53
May  7 05:17:06 srv1 named[2613]: lame server resolving '2.198.117.195.in-addr.arpa' (in '198.117.195.in-addr.arpa'?): 88.220.88.3#53
May  7 05:17:06 srv1 named[2613]: lame server resolving '2.198.117.195.in-addr.arpa' (in '198.117.195.in-addr.arpa'?): 194.204.159.1#53
May  7 05:17:06 srv1 named[2613]: lame server resolving '2.198.117.195.in-addr.arpa' (in '198.117.195.in-addr.arpa'?): 88.220.88.3#53
May  7 05:23:39 srv1 named[2613]: lame server resolving '200.43.30.64.in-addr.arpa' (in '43.30.64.in-addr.arpa'?): 209.247.1.130#53
May  7 05:23:39 srv1 named[2613]: lame server resolving '200.43.30.64.in-addr.arpa' (in '43.30.64.in-addr.arpa'?): 209.244.6.146#53
May  7 05:23:39 srv1 named[2613]: lame server resolving '200.43.30.64.in-addr.arpa' (in '43.30.64.in-addr.arpa'?): 209.247.1.129#53
May  7 05:23:42 srv1 named[2613]: lame server resolving '200.43.30.64.in-addr.arpa' (in '43.30.64.in-addr.arpa'?): 209.247.1.130#53
May  7 05:23:42 srv1 named[2613]: lame server resolving '200.43.30.64.in-addr.arpa' (in '43.30.64.in-addr.arpa'?): 209.244.6.146#53
May  7 05:23:43 srv1 named[2613]: lame server resolving '200.43.30.64.in-addr.arpa' (in '43.30.64.in-addr.arpa'?): 209.247.1.129#53
May  7 05:23:43 srv1 named[2613]: lame server resolving '200.43.30.64.in-addr.arpa' (in '43.30.64.in-addr.arpa'?): 209.247.1.130#53
May  7 05:23:43 srv1 named[2613]: lame server resolving '200.43.30.64.in-addr.arpa' (in '43.30.64.in-addr.arpa'?): 209.244.6.146#53
May  7 05:23:43 srv1 named[2613]: lame server resolving '200.43.30.64.in-addr.arpa' (in '43.30.64.in-addr.arpa'?): 209.247.1.129#53
May  7 05:23:43 srv1 named[2613]: lame server resolving '200.43.30.64.in-addr.arpa' (in '43.30.64.in-addr.arpa'?): 209.247.1.130#53
May  7 05:23:43 srv1 named[2613]: lame server resolving '200.43.30.64.in-addr.arpa' (in '43.30.64.in-addr.arpa'?): 209.244.6.146#53
May  7 05:23:44 srv1 named[2613]: lame server resolving '200.43.30.64.in-addr.arpa' (in '43.30.64.in-addr.arpa'?): 209.247.1.129#53
May  7 05:32:50 srv1 named[2613]: lame server resolving '104.203.162.211.in-addr.arpa' (in '203.162.211.in-addr.arpa'?): 211.161.192.73#53
May  7 05:32:51 srv1 named[2613]: lame server resolving '104.203.162.211.in-addr.arpa' (in '203.162.211.in-addr.arpa'?): 211.161.192.1#53
May  7 05:32:55 srv1 named[2613]: lame server resolving '104.203.162.211.in-addr.arpa' (in '203.162.211.in-addr.arpa'?): 211.161.192.73#53
May  7 05:32:55 srv1 named[2613]: lame server resolving '104.203.162.211.in-addr.arpa' (in '203.162.211.in-addr.arpa'?): 211.161.192.1#53
May  7 05:33:01 srv1 named[2613]: lame server resolving '104.203.162.211.in-addr.arpa' (in '203.162.211.in-addr.arpa'?): 211.161.192.73#53
May  7 05:33:02 srv1 named[2613]: lame server resolving '104.203.162.211.in-addr.arpa' (in '203.162.211.in-addr.arpa'?): 211.161.192.1#53
May  7 05:33:02 srv1 named[2613]: lame server resolving '104.203.162.211.in-addr.arpa' (in '203.162.211.in-addr.arpa'?): 211.161.192.73#53
May  7 05:33:03 srv1 named[2613]: lame server resolving '104.203.162.211.in-addr.arpa' (in '203.162.211.in-addr.arpa'?): 211.161.192.1#53
May  7 05:33:03 srv1 named[2613]: lame server resolving '104.203.162.211.in-addr.arpa' (in '203.162.211.in-addr.arpa'?): 211.161.192.73#53
May  7 05:33:04 srv1 named[2613]: lame server resolving '104.203.162.211.in-addr.arpa' (in '203.162.211.in-addr.arpa'?): 211.161.192.1#53
May  7 05:33:06 srv1 named[2613]: lame server resolving '104.203.162.211.in-addr.arpa' (in '203.162.211.in-addr.arpa'?): 211.161.192.1#53
May  7 05:33:06 srv1 named[2613]: lame server resolving '104.203.162.211.in-addr.arpa' (in '203.162.211.in-addr.arpa'?): 211.161.192.73#53
May  7 05:33:07 srv1 named[2613]: lame server resolving '104.203.162.211.in-addr.arpa' (in '203.162.211.in-addr.arpa'?): 211.161.192.1#53
May  7 05:33:07 srv1 named[2613]: lame server resolving '104.203.162.211.in-addr.arpa' (in '203.162.211.in-addr.arpa'?): 211.161.192.73#53
May  7 05:35:02 srv1 named[2613]: lame server resolving '30.194.31.121.in-addr.arpa' (in '31.121.in-addr.arpa'?): 221.7.138.5#53
May  7 05:35:03 srv1 named[2613]: lame server resolving '30.194.31.121.in-addr.arpa' (in '31.121.in-addr.arpa'?): 221.7.128.37#53
May  7 05:35:06 srv1 named[2613]: lame server resolving '30.194.31.121.in-addr.arpa' (in '31.121.in-addr.arpa'?): 221.7.128.37#53
May  7 05:35:07 srv1 named[2613]: lame server resolving '30.194.31.121.in-addr.arpa' (in '31.121.in-addr.arpa'?): 221.7.138.5#53
May  7 05:35:07 srv1 named[2613]: lame server resolving '30.194.31.121.in-addr.arpa' (in '31.121.in-addr.arpa'?): 221.7.128.37#53
May  7 05:35:08 srv1 named[2613]: lame server resolving '30.194.31.121.in-addr.arpa' (in '31.121.in-addr.arpa'?): 221.7.138.5#53
May  7 05:35:08 srv1 named[2613]: lame server resolving '30.194.31.121.in-addr.arpa' (in '31.121.in-addr.arpa'?): 221.7.128.37#53
May  7 05:35:08 srv1 named[2613]: lame server resolving '30.194.31.121.in-addr.arpa' (in '31.121.in-addr.arpa'?): 221.7.138.5#53
May  7 05:40:48 srv1 mysqld_safe[4829]: Number of processes running now: 0
May  7 05:40:49 srv1 mysqld_safe[4831]: restarted
May  7 05:40:51 srv1 mysqld[4834]: 080507  5:40:51  InnoDB: Database was not shut down normally!
May  7 05:40:51 srv1 mysqld[4834]: InnoDB: Starting crash recovery.
May  7 05:40:51 srv1 mysqld[4834]: InnoDB: Reading tablespace information from the .ibd files...
May  7 05:40:51 srv1 mysqld[4834]: InnoDB: Restoring possible half-written data pages from the doublewrite
May  7 05:40:51 srv1 mysqld[4834]: InnoDB: buffer...
May  7 05:40:51 srv1 mysqld[4834]: 080507  5:40:51  InnoDB: Starting log scan based on checkpoint at
May  7 05:40:51 srv1 mysqld[4834]: InnoDB: log sequence number 0 62182.
May  7 05:40:51 srv1 mysqld[4834]: InnoDB: Doing recovery: scanned up to log sequence number 0 62182
May  7 05:40:53 srv1 mysqld[4834]: InnoDB: Last MySQL binlog file position 0 75736, file name /var/log/mysql/mysql-bin.000358
May  7 05:40:53 srv1 mysqld[4834]: 080507  5:40:53  InnoDB: Started; log sequence number 0 62182
May  7 05:40:53 srv1 mysqld[4834]: 080507  5:40:53 [Note] Recovering after a crash using /var/log/mysql/mysql-bin
May  7 05:40:53 srv1 mysqld[4834]: 080507  5:40:53 [Note] Starting crash recovery...
May  7 05:40:53 srv1 mysqld[4834]: 080507  5:40:53 [Note] Crash recovery finished.
May  7 05:40:53 srv1 mysqld[4834]: 080507  5:40:53 [Note] /usr/sbin/mysqld: ready for connections.
May  7 05:40:53 srv1 mysqld[4834]: Version: '5.0.32-Debian_7etch5-log'  socket: '/var/run/mysqld/mysqld.sock'  port: 3306  Debian etch distribution
May  7 05:43:26 srv1 mysqld_safe[4867]: Number of processes running now: 0
May  7 05:43:30 srv1 mysqld_safe[4869]: restarted
May  7 05:43:30 srv1 mysqld[4872]: 080507  5:43:10  InnoDB: Database was not shut down normally!
May  7 05:43:30 srv1 mysqld[4872]: InnoDB: Starting crash recovery.
May  7 05:43:30 srv1 mysqld[4872]: InnoDB: Reading tablespace information from the .ibd files...
May  7 05:43:30 srv1 mysqld[4872]: InnoDB: Restoring possible half-written data pages from the doublewrite
May  7 05:43:30 srv1 mysqld[4872]: InnoDB: buffer...
May  7 05:43:30 srv1 mysqld[4872]: 080507  5:43:20  InnoDB: Starting log scan based on checkpoint at
May  7 05:43:30 srv1 mysqld[4872]: InnoDB: log sequence number 0 62182.
May  7 05:43:30 srv1 mysqld[4872]: InnoDB: Doing recovery: scanned up to log sequence number 0 62182
May  7 05:44:54 srv1 mysqld_safe[4882]: ended
May  7 05:44:55 srv1 named[2613]: lame server resolving '142.128.154.141.66.in-addr.arpa' (in '128.154.141.66.in-addr.arpa'?): 151.164.11.218#53
May  7 05:44:55 srv1 named[2613]: lame server resolving 'visioncabinets.com.au' (in 'visioncabinets.com.au'?): 203.149.65.1#53

 

i kern.log

 

May  7 05:47:35 srv1 kernel: cpu 4 hot: high 186, batch 31 used:6
May  7 05:47:35 srv1 kernel: cpu 4 cold: high 62, batch 15 used:54
May  7 05:47:35 srv1 kernel: cpu 5 hot: high 186, batch 31 used:63
May  7 05:47:35 srv1 kernel: cpu 5 cold: high 62, batch 15 used:21
May  7 05:47:35 srv1 kernel: cpu 6 hot: high 186, batch 31 used:153
May  7 05:47:35 srv1 kernel: cpu 6 cold: high 62, batch 15 used:22
May  7 05:47:35 srv1 kernel: cpu 7 hot: high 186, batch 31 used:16
May  7 05:47:35 srv1 kernel: cpu 7 cold: high 62, batch 15 used:61
May  7 05:47:35 srv1 kernel: HighMem per-cpu:
May  7 05:47:35 srv1 kernel: cpu 0 hot: high 186, batch 31 used:28
May  7 05:47:35 srv1 kernel: cpu 0 cold: high 62, batch 15 used:54
May  7 05:47:35 srv1 kernel: cpu 1 hot: high 186, batch 31 used:13
May  7 05:47:35 srv1 kernel: cpu 1 cold: high 62, batch 15 used:56
May  7 05:47:35 srv1 kernel: cpu 2 hot: high 186, batch 31 used:179
May  7 05:47:35 srv1 kernel: cpu 2 cold: high 62, batch 15 used:0
May  7 05:47:35 srv1 kernel: cpu 3 hot: high 186, batch 31 used:35
May  7 05:47:35 srv1 kernel: cpu 3 cold: high 62, batch 15 used:48
May  7 05:47:35 srv1 kernel: cpu 4 hot: high 186, batch 31 used:41
May  7 05:47:35 srv1 kernel: cpu 4 cold: high 62, batch 15 used:14
May  7 05:47:35 srv1 kernel: cpu 5 hot: high 186, batch 31 used:57
May  7 05:47:35 srv1 kernel: cpu 5 cold: high 62, batch 15 used:50
May  7 05:47:35 srv1 kernel: cpu 6 hot: high 186, batch 31 used:28
May  7 05:47:35 srv1 kernel: cpu 6 cold: high 62, batch 15 used:14
May  7 05:47:35 srv1 kernel: cpu 7 hot: high 186, batch 31 used:26
May  7 05:47:35 srv1 kernel: cpu 7 cold: high 62, batch 15 used:23
May  7 05:47:35 srv1 kernel: Free pages:	   86108kB (468kB HighMem)
May  7 05:47:35 srv1 kernel: Active:536312 inactive:208801 dirty:0 writeback:0 unstable:0 free:21527 slab:4998 mapped:82 pagetables:3040
May  7 05:47:35 srv1 kernel: DMA free:12288kB min:68kB low:84kB high:100kB active:896kB inactive:356kB present:16384kB pages_scanned:2053 all_unreclaimable? yes
May  7 05:47:35 srv1 kernel: lowmem_reserve[]: 0 0 880 3055
May  7 05:47:35 srv1 kernel: DMA32 free:0kB min:0kB low:0kB high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
May  7 05:47:35 srv1 kernel: lowmem_reserve[]: 0 0 880 3055
May  7 05:47:35 srv1 kernel: Normal free:73352kB min:3756kB low:4692kB high:5632kB active:560448kB inactive:198620kB present:901120kB pages_scanned:10808370 all_unreclaimable? yes
May  7 05:47:35 srv1 kernel: lowmem_reserve[]: 0 0 0 17406
May  7 05:47:35 srv1 kernel: HighMem free:468kB min:512kB low:2832kB high:5156kB active:1583904kB inactive:636228kB present:2228012kB pages_scanned:321110 all_unreclaimable? no
May  7 05:47:35 srv1 kernel: lowmem_reserve[]: 0 0 0 0
May  7 05:47:35 srv1 kernel: DMA: 0*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 3*4096kB = 12288kB
May  7 05:47:35 srv1 kernel: DMA32: empty
May  7 05:47:35 srv1 kernel: Normal: 8*4kB 53*8kB 12*16kB 8*32kB 2*64kB 7*128kB 3*256kB 2*512kB 0*1024kB 0*2048kB 17*4096kB = 73352kB
May  7 05:47:35 srv1 kernel: HighMem: 1*4kB 8*8kB 1*16kB 0*32kB 0*64kB 1*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 468kB
May  7 05:47:35 srv1 kernel: Swap cache: add 250523, delete 250523, find 82467/85694, race 0+18
May  7 05:47:35 srv1 kernel: Free swap  = 0kB
May  7 05:47:35 srv1 kernel: Total swap = 859468kB
May  7 05:47:35 srv1 kernel: Free swap:			0kB
May  7 05:47:35 srv1 kernel: 786379 pages of RAM
May  7 05:47:35 srv1 kernel: 557003 pages of HIGHMEM
May  7 05:47:35 srv1 kernel: 7134 reserved pages
May  7 05:47:35 srv1 kernel: 266701 pages shared
May  7 05:47:35 srv1 kernel: 0 pages swap cached
May  7 05:47:35 srv1 kernel: 0 pages dirty
May  7 05:47:35 srv1 kernel: 0 pages writeback
May  7 05:47:35 srv1 kernel: 82 pages mapped
May  7 05:47:35 srv1 kernel: 4996 pages slab
May  7 05:47:35 srv1 kernel: 3040 pages pagetables
May  7 05:47:35 srv1 kernel: oom-killer: gfp_mask=0x280d2, order=0
May  7 05:47:35 srv1 kernel:  [<c0144533>] out_of_memory+0x25/0x13a
May  7 05:47:35 srv1 kernel:  [<c014599c>] __alloc_pages+0x1f5/0x275
May  7 05:47:35 srv1 kernel:  [<c014bf92>] __handle_mm_fault+0xf8/0x740
May  7 05:47:35 srv1 kernel:  [<c0124657>] do_gettimeofday+0x31/0xce
May  7 05:47:35 srv1 kernel:  [<c01154b6>] do_page_fault+0x18a/0x481
May  7 05:47:35 srv1 kernel:  [<c011532c>] do_page_fault+0x0/0x481
May  7 05:47:35 srv1 kernel:  [<c01037f9>] error_code+0x39/0x40
May  7 05:47:35 srv1 kernel: Mem-info:
May  7 05:47:35 srv1 kernel: DMA per-cpu:
May  7 05:47:35 srv1 kernel: cpu 0 hot: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 0 cold: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 1 hot: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 1 cold: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 2 hot: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 2 cold: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 3 hot: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 3 cold: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 4 hot: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 4 cold: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 5 hot: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 5 cold: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 6 hot: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 6 cold: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 7 hot: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 7 cold: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: DMA32 per-cpu: empty
May  7 05:47:35 srv1 kernel: Normal per-cpu:
May  7 05:47:35 srv1 kernel: cpu 0 hot: high 186, batch 31 used:27
May  7 05:47:35 srv1 kernel: cpu 0 cold: high 62, batch 15 used:56
May  7 05:47:35 srv1 kernel: cpu 1 hot: high 186, batch 31 used:20
May  7 05:47:35 srv1 kernel: cpu 1 cold: high 62, batch 15 used:55
May  7 05:47:35 srv1 kernel: cpu 2 hot: high 186, batch 31 used:72
May  7 05:47:35 srv1 kernel: cpu 2 cold: high 62, batch 15 used:26
May  7 05:47:35 srv1 kernel: cpu 3 hot: high 186, batch 31 used:22
May  7 05:47:35 srv1 kernel: cpu 3 cold: high 62, batch 15 used:60
May  7 05:47:35 srv1 kernel: cpu 4 hot: high 186, batch 31 used:6
May  7 05:47:35 srv1 kernel: cpu 4 cold: high 62, batch 15 used:54
May  7 05:47:35 srv1 kernel: cpu 5 hot: high 186, batch 31 used:63
May  7 05:47:35 srv1 kernel: cpu 5 cold: high 62, batch 15 used:21
May  7 05:47:35 srv1 kernel: cpu 6 hot: high 186, batch 31 used:153
May  7 05:47:35 srv1 kernel: cpu 6 cold: high 62, batch 15 used:22
May  7 05:47:35 srv1 kernel: cpu 7 hot: high 186, batch 31 used:16
May  7 05:47:35 srv1 kernel: cpu 7 cold: high 62, batch 15 used:61
May  7 05:47:35 srv1 kernel: HighMem per-cpu:
May  7 05:47:35 srv1 kernel: cpu 0 hot: high 186, batch 31 used:28
May  7 05:47:35 srv1 kernel: cpu 0 cold: high 62, batch 15 used:54
May  7 05:47:35 srv1 kernel: cpu 1 hot: high 186, batch 31 used:13
May  7 05:47:35 srv1 kernel: cpu 1 cold: high 62, batch 15 used:56
May  7 05:47:35 srv1 kernel: cpu 2 hot: high 186, batch 31 used:179
May  7 05:47:35 srv1 kernel: cpu 2 cold: high 62, batch 15 used:59
May  7 05:47:35 srv1 kernel: cpu 3 hot: high 186, batch 31 used:35
May  7 05:47:35 srv1 kernel: cpu 3 cold: high 62, batch 15 used:57
May  7 05:47:35 srv1 kernel: cpu 4 hot: high 186, batch 31 used:41
May  7 05:47:35 srv1 kernel: cpu 4 cold: high 62, batch 15 used:14
May  7 05:47:35 srv1 kernel: cpu 5 hot: high 186, batch 31 used:57
May  7 05:47:35 srv1 kernel: cpu 5 cold: high 62, batch 15 used:50
May  7 05:47:35 srv1 kernel: cpu 6 hot: high 186, batch 31 used:28
May  7 05:47:35 srv1 kernel: cpu 6 cold: high 62, batch 15 used:14
May  7 05:47:35 srv1 kernel: cpu 7 hot: high 186, batch 31 used:26
May  7 05:47:35 srv1 kernel: cpu 7 cold: high 62, batch 15 used:23
May  7 05:47:35 srv1 kernel: Free pages:	   86596kB (948kB HighMem)
May  7 05:47:35 srv1 kernel: Active:530687 inactive:214238 dirty:0 writeback:0 unstable:0 free:21649 slab:4996 mapped:82 pagetables:3040
May  7 05:47:35 srv1 kernel: DMA free:12288kB min:68kB low:84kB high:100kB active:896kB inactive:356kB present:16384kB pages_scanned:2053 all_unreclaimable? yes
May  7 05:47:35 srv1 kernel: lowmem_reserve[]: 0 0 880 3055
May  7 05:47:35 srv1 kernel: DMA32 free:0kB min:0kB low:0kB high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
May  7 05:47:35 srv1 kernel: lowmem_reserve[]: 0 0 880 3055
May  7 05:47:35 srv1 kernel: Normal free:73360kB min:3756kB low:4692kB high:5632kB active:552384kB inactive:206556kB present:901120kB pages_scanned:16960 all_unreclaimable? no
May  7 05:47:35 srv1 kernel: lowmem_reserve[]: 0 0 0 17406
May  7 05:47:35 srv1 kernel: HighMem free:948kB min:512kB low:2832kB high:5156kB active:1569340kB inactive:650168kB present:2228012kB pages_scanned:928 all_unreclaimable? no
May  7 05:47:35 srv1 kernel: lowmem_reserve[]: 0 0 0 0
May  7 05:47:35 srv1 kernel: DMA: 0*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 3*4096kB = 12288kB
May  7 05:47:35 srv1 kernel: DMA32: empty
May  7 05:47:35 srv1 kernel: Normal: 8*4kB 54*8kB 12*16kB 8*32kB 2*64kB 7*128kB 3*256kB 2*512kB 0*1024kB 0*2048kB 17*4096kB = 73360kB
May  7 05:47:35 srv1 kernel: HighMem: 132*4kB 10*8kB 1*16kB 0*32kB 0*64kB 1*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 1008kB
May  7 05:47:35 srv1 kernel: Swap cache: add 250523, delete 250523, find 82467/85694, race 0+18
May  7 05:47:35 srv1 kernel: Free swap  = 0kB
May  7 05:47:35 srv1 kernel: Total swap = 859468kB
May  7 05:47:35 srv1 kernel: Free swap:			0kB
May  7 05:47:35 srv1 kernel: 786379 pages of RAM
May  7 05:47:35 srv1 kernel: 557003 pages of HIGHMEM
May  7 05:47:35 srv1 kernel: 7134 reserved pages
May  7 05:47:35 srv1 kernel: 266696 pages shared
May  7 05:47:35 srv1 kernel: 0 pages swap cached
May  7 05:47:35 srv1 kernel: 0 pages dirty
May  7 05:47:35 srv1 kernel: 0 pages writeback
May  7 05:47:35 srv1 kernel: 82 pages mapped
May  7 05:47:35 srv1 kernel: 4996 pages slab
May  7 05:47:35 srv1 kernel: 3040 pages pagetables
May  7 05:47:35 srv1 kernel: oom-killer: gfp_mask=0x201d2, order=0
May  7 05:47:35 srv1 kernel:  [<c0144533>] out_of_memory+0x25/0x13a
May  7 05:47:35 srv1 kernel:  [<c014599c>] __alloc_pages+0x1f5/0x275
May  7 05:47:35 srv1 kernel:  [<c0146b4b>] __do_page_cache_readahead+0xc8/0x1e8
May  7 05:47:35 srv1 kernel:  [<c0143c44>] filemap_nopage+0x15b/0x313
May  7 05:47:35 srv1 kernel:  [<c014c108>] __handle_mm_fault+0x26e/0x740
May  7 05:47:35 srv1 kernel:  [<c0164b26>] pipe_read+0x1a/0x1e
May  7 05:47:35 srv1 kernel:  [<c01154b6>] do_page_fault+0x18a/0x481
May  7 05:47:35 srv1 kernel:  [<c011532c>] do_page_fault+0x0/0x481
May  7 05:47:35 srv1 kernel:  [<c01037f9>] error_code+0x39/0x40
May  7 05:47:35 srv1 kernel: Mem-info:
May  7 05:47:35 srv1 kernel: DMA per-cpu:
May  7 05:47:35 srv1 kernel: cpu 0 hot: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 0 cold: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 1 hot: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 1 cold: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 2 hot: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 2 cold: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 3 hot: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 3 cold: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 4 hot: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 4 cold: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 5 hot: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 5 cold: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 6 hot: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 6 cold: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 7 hot: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 7 cold: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: DMA32 per-cpu: empty
May  7 05:47:35 srv1 kernel: Normal per-cpu:
May  7 05:47:35 srv1 kernel: cpu 0 hot: high 186, batch 31 used:27
May  7 05:47:35 srv1 kernel: cpu 0 cold: high 62, batch 15 used:56
May  7 05:47:35 srv1 kernel: cpu 1 hot: high 186, batch 31 used:11
May  7 05:47:35 srv1 kernel: cpu 1 cold: high 62, batch 15 used:55
May  7 05:47:35 srv1 kernel: cpu 2 hot: high 186, batch 31 used:72
May  7 05:47:35 srv1 kernel: cpu 2 cold: high 62, batch 15 used:26
May  7 05:47:35 srv1 kernel: cpu 3 hot: high 186, batch 31 used:22
May  7 05:47:35 srv1 kernel: cpu 3 cold: high 62, batch 15 used:60
May  7 05:47:35 srv1 kernel: cpu 4 hot: high 186, batch 31 used:30
May  7 05:47:35 srv1 kernel: cpu 4 cold: high 62, batch 15 used:54
May  7 05:47:35 srv1 kernel: cpu 5 hot: high 186, batch 31 used:63
May  7 05:47:35 srv1 kernel: cpu 5 cold: high 62, batch 15 used:22
May  7 05:47:35 srv1 kernel: cpu 6 hot: high 186, batch 31 used:153
May  7 05:47:35 srv1 kernel: cpu 6 cold: high 62, batch 15 used:22
May  7 05:47:35 srv1 kernel: cpu 7 hot: high 186, batch 31 used:16
May  7 05:47:35 srv1 kernel: cpu 7 cold: high 62, batch 15 used:61
May  7 05:47:35 srv1 kernel: HighMem per-cpu:
May  7 05:47:35 srv1 kernel: cpu 0 hot: high 186, batch 31 used:28
May  7 05:47:35 srv1 kernel: cpu 0 cold: high 62, batch 15 used:50
May  7 05:47:35 srv1 kernel: cpu 1 hot: high 186, batch 31 used:16
May  7 05:47:35 srv1 kernel: cpu 1 cold: high 62, batch 15 used:14
May  7 05:47:35 srv1 kernel: cpu 2 hot: high 186, batch 31 used:179
May  7 05:47:35 srv1 kernel: cpu 2 cold: high 62, batch 15 used:49
May  7 05:47:35 srv1 kernel: cpu 3 hot: high 186, batch 31 used:35
May  7 05:47:35 srv1 kernel: cpu 3 cold: high 62, batch 15 used:57
May  7 05:47:35 srv1 kernel: cpu 4 hot: high 186, batch 31 used:30
May  7 05:47:35 srv1 kernel: cpu 4 cold: high 62, batch 15 used:6
May  7 05:47:35 srv1 kernel: cpu 5 hot: high 186, batch 31 used:57
May  7 05:47:35 srv1 kernel: cpu 5 cold: high 62, batch 15 used:50
May  7 05:47:35 srv1 kernel: cpu 6 hot: high 186, batch 31 used:28
May  7 05:47:35 srv1 kernel: cpu 6 cold: high 62, batch 15 used:14
May  7 05:47:35 srv1 kernel: cpu 7 hot: high 186, batch 31 used:26
May  7 05:47:35 srv1 kernel: cpu 7 cold: high 62, batch 15 used:56
May  7 05:47:35 srv1 kernel: Free pages:	   85988kB (464kB HighMem)
May  7 05:47:35 srv1 kernel: Active:435432 inactive:309626 dirty:0 writeback:0 unstable:0 free:21497 slab:5005 mapped:364 pagetables:3040
May  7 05:47:35 srv1 kernel: DMA free:12288kB min:68kB low:84kB high:100kB active:896kB inactive:356kB present:16384kB pages_scanned:2053 all_unreclaimable? yes
May  7 05:47:35 srv1 kernel: lowmem_reserve[]: 0 0 880 3055
May  7 05:47:35 srv1 kernel: DMA32 free:0kB min:0kB low:0kB high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
May  7 05:47:35 srv1 kernel: lowmem_reserve[]: 0 0 880 3055
May  7 05:47:35 srv1 kernel: Normal free:73236kB min:3756kB low:4692kB high:5632kB active:348384kB inactive:410572kB present:901120kB pages_scanned:322324 all_unreclaimable? no
May  7 05:47:35 srv1 kernel: lowmem_reserve[]: 0 0 0 17406
May  7 05:47:35 srv1 kernel: HighMem free:464kB min:512kB low:2832kB high:5156kB active:1392448kB inactive:827576kB present:2228012kB pages_scanned:188479 all_unreclaimable? no
May  7 05:47:35 srv1 kernel: lowmem_reserve[]: 0 0 0 0
May  7 05:47:35 srv1 kernel: DMA: 0*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 3*4096kB = 12288kB
May  7 05:47:35 srv1 kernel: DMA32: empty
May  7 05:47:35 srv1 kernel: Normal: 1*4kB 42*8kB 12*16kB 8*32kB 2*64kB 7*128kB 3*256kB 2*512kB 0*1024kB 0*2048kB 17*4096kB = 73236kB
May  7 05:47:35 srv1 kernel: HighMem: 0*4kB 8*8kB 1*16kB 0*32kB 0*64kB 1*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 464kB
May  7 05:47:35 srv1 kernel: Swap cache: add 250523, delete 250523, find 82467/85694, race 0+18
May  7 05:47:35 srv1 kernel: Free swap  = 0kB
May  7 05:47:35 srv1 kernel: Total swap = 859468kB
May  7 05:47:35 srv1 kernel: Free swap:			0kB
May  7 05:47:35 srv1 kernel: 786379 pages of RAM
May  7 05:47:35 srv1 kernel: 557003 pages of HIGHMEM
May  7 05:47:35 srv1 kernel: 7134 reserved pages
May  7 05:47:35 srv1 kernel: 267029 pages shared
May  7 05:47:35 srv1 kernel: 0 pages swap cached
May  7 05:47:35 srv1 kernel: 0 pages dirty
May  7 05:47:35 srv1 kernel: 0 pages writeback
May  7 05:47:35 srv1 kernel: 364 pages mapped
May  7 05:47:35 srv1 kernel: 5005 pages slab
May  7 05:47:35 srv1 kernel: 3040 pages pagetables
May  7 05:47:35 srv1 kernel: oom-killer: gfp_mask=0x201d2, order=0
May  7 05:47:35 srv1 kernel:  [<c0144533>] out_of_memory+0x25/0x13a
May  7 05:47:35 srv1 kernel:  [<c014599c>] __alloc_pages+0x1f5/0x275
May  7 05:47:35 srv1 kernel:  [<c0146b4b>] __do_page_cache_readahead+0xc8/0x1e8
May  7 05:47:35 srv1 kernel:  [<c027f7d4>] io_schedule+0x26/0x30
May  7 05:47:35 srv1 kernel:  [<c027f9f0>] __wait_on_bit_lock+0x4b/0x52
May  7 05:47:35 srv1 kernel:  [<c0141734>] __lock_page+0x51/0x57
May  7 05:47:35 srv1 kernel:  [<c0143c44>] filemap_nopage+0x15b/0x313
May  7 05:47:35 srv1 kernel:  [<c014c108>] __handle_mm_fault+0x26e/0x740
May  7 05:47:35 srv1 kernel:  [<c01154b6>] do_page_fault+0x18a/0x481
May  7 05:47:35 srv1 kernel:  [<c011532c>] do_page_fault+0x0/0x481
May  7 05:47:35 srv1 kernel:  [<c01037f9>] error_code+0x39/0x40
May  7 05:47:35 srv1 kernel: Mem-info:
May  7 05:47:35 srv1 kernel: DMA per-cpu:
May  7 05:47:35 srv1 kernel: cpu 0 hot: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 0 cold: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 1 hot: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 1 cold: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 2 hot: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 2 cold: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 3 hot: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 3 cold: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 4 hot: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 4 cold: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 5 hot: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 5 cold: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 6 hot: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 6 cold: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 7 hot: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 7 cold: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: DMA32 per-cpu: empty
May  7 05:47:35 srv1 kernel: Normal per-cpu:
May  7 05:47:35 srv1 kernel: cpu 0 hot: high 186, batch 31 used:23
May  7 05:47:35 srv1 kernel: cpu 0 cold: high 62, batch 15 used:53
May  7 05:47:35 srv1 kernel: cpu 1 hot: high 186, batch 31 used:4
May  7 05:47:35 srv1 kernel: cpu 1 cold: high 62, batch 15 used:51
May  7 05:47:35 srv1 kernel: cpu 2 hot: high 186, batch 31 used:72
May  7 05:47:35 srv1 kernel: cpu 2 cold: high 62, batch 15 used:51
May  7 05:47:35 srv1 kernel: cpu 3 hot: high 186, batch 31 used:3
May  7 05:47:35 srv1 kernel: cpu 3 cold: high 62, batch 15 used:49
May  7 05:47:35 srv1 kernel: cpu 4 hot: high 186, batch 31 used:7
May  7 05:47:35 srv1 kernel: cpu 4 cold: high 62, batch 15 used:1
May  7 05:47:35 srv1 kernel: cpu 5 hot: high 186, batch 31 used:63
May  7 05:47:35 srv1 kernel: cpu 5 cold: high 62, batch 15 used:29
May  7 05:47:35 srv1 kernel: cpu 6 hot: high 186, batch 31 used:174
May  7 05:47:35 srv1 kernel: cpu 6 cold: high 62, batch 15 used:39
May  7 05:47:35 srv1 kernel: cpu 7 hot: high 186, batch 31 used:16
May  7 05:47:35 srv1 kernel: cpu 7 cold: high 62, batch 15 used:49
May  7 05:47:35 srv1 kernel: HighMem per-cpu:
May  7 05:47:35 srv1 kernel: cpu 0 hot: high 186, batch 31 used:27
May  7 05:47:35 srv1 kernel: cpu 0 cold: high 62, batch 15 used:53
May  7 05:47:35 srv1 kernel: cpu 1 hot: high 186, batch 31 used:16
May  7 05:47:35 srv1 kernel: cpu 1 cold: high 62, batch 15 used:51
May  7 05:47:35 srv1 kernel: cpu 2 hot: high 186, batch 31 used:179
May  7 05:47:35 srv1 kernel: cpu 2 cold: high 62, batch 15 used:47
May  7 05:47:35 srv1 kernel: cpu 3 hot: high 186, batch 31 used:20
May  7 05:47:35 srv1 kernel: cpu 3 cold: high 62, batch 15 used:42
May  7 05:47:35 srv1 kernel: cpu 4 hot: high 186, batch 31 used:3
May  7 05:47:35 srv1 kernel: cpu 4 cold: high 62, batch 15 used:14
May  7 05:47:35 srv1 kernel: cpu 5 hot: high 186, batch 31 used:57
May  7 05:47:35 srv1 kernel: cpu 5 cold: high 62, batch 15 used:56
May  7 05:47:35 srv1 kernel: cpu 6 hot: high 186, batch 31 used:162
May  7 05:47:35 srv1 kernel: cpu 6 cold: high 62, batch 15 used:53
May  7 05:47:35 srv1 kernel: cpu 7 hot: high 186, batch 31 used:26
May  7 05:47:35 srv1 kernel: cpu 7 cold: high 62, batch 15 used:47
May  7 05:47:35 srv1 kernel: Free pages:	   86284kB (544kB HighMem)
May  7 05:47:35 srv1 kernel: Active:307641 inactive:437349 dirty:0 writeback:0 unstable:0 free:21571 slab:5018 mapped:481 pagetables:3031
May  7 05:47:35 srv1 kernel: DMA free:12288kB min:68kB low:84kB high:100kB active:896kB inactive:356kB present:16384kB pages_scanned:2053 all_unreclaimable? yes
May  7 05:47:35 srv1 kernel: lowmem_reserve[]: 0 0 880 3055
May  7 05:47:35 srv1 kernel: DMA32 free:0kB min:0kB low:0kB high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
May  7 05:47:35 srv1 kernel: lowmem_reserve[]: 0 0 880 3055
May  7 05:47:35 srv1 kernel: Normal free:73452kB min:3756kB low:4692kB high:5632kB active:79564kB inactive:679724kB present:901120kB pages_scanned:28713 all_unreclaimable? no
May  7 05:47:35 srv1 kernel: lowmem_reserve[]: 0 0 0 17406
May  7 05:47:35 srv1 kernel: HighMem free:544kB min:512kB low:2832kB high:5156kB active:1150304kB inactive:1069188kB present:2228012kB pages_scanned:83616 all_unreclaimable? no
May  7 05:47:35 srv1 kernel: lowmem_reserve[]: 0 0 0 0
May  7 05:47:35 srv1 kernel: DMA: 0*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 3*4096kB = 12288kB
May  7 05:47:35 srv1 kernel: DMA32: empty
May  7 05:47:35 srv1 kernel: Normal: 43*4kB 48*8kB 12*16kB 8*32kB 2*64kB 7*128kB 3*256kB 2*512kB 0*1024kB 0*2048kB 17*4096kB = 73452kB
May  7 05:47:35 srv1 kernel: HighMem: 16*4kB 10*8kB 1*16kB 0*32kB 0*64kB 1*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 544kB
May  7 05:47:35 srv1 kernel: Swap cache: add 250563, delete 250523, find 82469/85701, race 0+18
May  7 05:47:35 srv1 kernel: Free swap  = 0kB
May  7 05:47:35 srv1 kernel: Total swap = 859468kB
May  7 05:47:35 srv1 kernel: Free swap:			0kB
May  7 05:47:35 srv1 kernel: 786379 pages of RAM
May  7 05:47:35 srv1 kernel: 557003 pages of HIGHMEM
May  7 05:47:35 srv1 kernel: 7134 reserved pages
May  7 05:47:35 srv1 kernel: 267310 pages shared
May  7 05:47:35 srv1 kernel: 40 pages swap cached
May  7 05:47:35 srv1 kernel: 0 pages dirty
May  7 05:47:35 srv1 kernel: 0 pages writeback
May  7 05:47:35 srv1 kernel: 481 pages mapped
May  7 05:47:35 srv1 kernel: 5018 pages slab
May  7 05:47:35 srv1 kernel: 3031 pages pagetables
May  7 05:47:35 srv1 kernel: Out of Memory: Kill process 4851 (httpd) score 7566 and children.
May  7 05:47:35 srv1 kernel: Out of memory: Killed process 4851 (httpd).
May  7 05:47:35 srv1 kernel: printk: 1 messages suppressed.
May  7 05:47:35 srv1 kernel: oom-killer: gfp_mask=0x201d2, order=0
May  7 05:47:35 srv1 kernel:  [<c0144533>] out_of_memory+0x25/0x13a
May  7 05:47:35 srv1 kernel:  [<c014599c>] __alloc_pages+0x1f5/0x275
May  7 05:47:35 srv1 kernel:  [<c0146b4b>] __do_page_cache_readahead+0xc8/0x1e8
May  7 05:47:35 srv1 kernel:  [<c027f7d4>] io_schedule+0x26/0x30
May  7 05:47:35 srv1 kernel:  [<c027f9f0>] __wait_on_bit_lock+0x4b/0x52
May  7 05:47:35 srv1 kernel:  [<c0141734>] __lock_page+0x51/0x57
May  7 05:47:35 srv1 kernel:  [<c0143c44>] filemap_nopage+0x15b/0x313
May  7 05:47:35 srv1 kernel:  [<c014c108>] __handle_mm_fault+0x26e/0x740
May  7 05:47:35 srv1 kernel:  [<c01154b6>] do_page_fault+0x18a/0x481
May  7 05:47:35 srv1 kernel:  [<c011532c>] do_page_fault+0x0/0x481
May  7 05:47:35 srv1 kernel:  [<c01037f9>] error_code+0x39/0x40
May  7 05:47:35 srv1 kernel: Mem-info:
May  7 05:47:35 srv1 kernel: DMA per-cpu:
May  7 05:47:35 srv1 kernel: cpu 0 hot: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 0 cold: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 1 hot: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 1 cold: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 2 hot: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 2 cold: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 3 hot: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 3 cold: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 4 hot: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 4 cold: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 5 hot: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 5 cold: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 6 hot: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 6 cold: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 7 hot: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: cpu 7 cold: high 0, batch 1 used:0
May  7 05:47:35 srv1 kernel: DMA32 per-cpu: empty
May  7 05:47:35 srv1 kernel: Normal per-cpu:
May  7 05:47:35 srv1 kernel: cpu 0 hot: high 186, batch 31 used:23
May  7 05:47:35 srv1 kernel: cpu 0 cold: high 62, batch 15 used:56
May  7 05:47:35 srv1 kernel: cpu 1 hot: high 186, batch 31 used:20
May  7 05:47:35 srv1 kernel: cpu 1 cold: high 62, batch 15 used:14
May  7 05:47:35 srv1 kernel: cpu 2 hot: high 186, batch 31 used:72
May  7 05:47:35 srv1 kernel: cpu 2 cold: high 62, batch 15 used:55
May  7 05:47:35 srv1 kernel: cpu 3 hot: high 186, batch 31 used:1
May  7 05:47:35 srv1 kernel: cpu 3 cold: high 62, batch 15 used:57
May  7 05:47:35 srv1 kernel: cpu 4 hot: high 186, batch 31 used:160
May  7 05:47:35 srv1 kernel: cpu 4 cold: high 62, batch 15 used:34
May  7 05:47:35 srv1 kernel: cpu 5 hot: high 186, batch 31 used:52
May  7 05:47:35 srv1 kernel: cpu 5 cold: high 62, batch 15 used:14
May  7 05:47:35 srv1 kernel: cpu 6 hot: high 186, batch 31 used:175
May  7 05:47:35 srv1 kernel: cpu 6 cold: high 62, batch 15 used:53
May  7 05:47:35 srv1 kernel: cpu 7 hot: high 186, batch 31 used:16
May  7 05:47:35 srv1 kernel: cpu 7 cold: high 62, batch 15 used:56
May  7 05:47:35 srv1 kernel: HighMem per-cpu:
May  7 05:47:35 srv1 kernel: cpu 0 hot: high 186, batch 31 used:27
May  7 05:47:35 srv1 kernel: cpu 0 cold: high 62, batch 15 used:56
May  7 05:47:35 srv1 kernel: cpu 1 hot: high 186, batch 31 used:16
May  7 05:47:35 srv1 kernel: cpu 1 cold: high 62, batch 15 used:4
May  7 05:47:35 srv1 kernel: cpu 2 hot: high 186, batch 31 used:179
May  7 05:47:35 srv1 kernel: cpu 2 cold: high 62, batch 15 used:56
May  7 05:47:35 srv1 kernel: cpu 3 hot: high 186, batch 31 used:20
May  7 05:47:35 srv1 kernel: cpu 3 cold: high 62, batch 15 used:1
May  7 05:47:35 srv1 kernel: cpu 4 hot: high 186, batch 31 used:166
May  7 05:47:35 srv1 kernel: cpu 4 cold: high 62, batch 15 used:11
May  7 05:47:35 srv1 kernel: cpu 5 hot: high 186, batch 31 used:57
May  7 05:47:35 srv1 kernel: cpu 5 cold: high 62, batch 15 used:54
May  7 05:47:35 srv1 kernel: cpu 6 hot: high 186, batch 31 used:162
May  7 05:47:35 srv1 kernel: cpu 6 cold: high 62, batch 15 used:54
May  7 05:47:35 srv1 kernel: cpu 7 hot: high 186, batch 31 used:26
May  7 05:47:35 srv1 kernel: cpu 7 cold: high 62, batch 15 used:50
May  7 05:47:35 srv1 kernel: Free pages:	   90432kB (3936kB HighMem)
May  7 05:47:35 srv1 kernel: Active:343522 inactive:400304 dirty:0 writeback:0 unstable:0 free:22608 slab:5025 mapped:510 pagetables:3031
May  7 05:47:35 srv1 kernel: DMA free:12300kB min:68kB low:84kB high:100kB active:884kB inactive:356kB present:16384kB pages_scanned:0 all_unreclaimable? no
May  7 05:47:35 srv1 kernel: lowmem_reserve[]: 0 0 880 3055
May  7 05:47:35 srv1 kernel: DMA32 free:0kB min:0kB low:0kB high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
May  7 05:47:35 srv1 kernel: lowmem_reserve[]: 0 0 880 3055
May  7 05:47:35 srv1 kernel: Normal free:74196kB min:3756kB low:4692kB high:5632kB active:243020kB inactive:515592kB present:901120kB pages_scanned:13808 all_unreclaimable? no
May  7 05:47:35 srv1 kernel: lowmem_reserve[]: 0 0 0 17406
May  7 05:47:35 srv1 kernel: HighMem free:3936kB min:512kB low:2832kB high:5156kB active:1130312kB inactive:1085140kB present:2228012kB pages_scanned:17777 all_unreclaimable? no
May  7 05:47:35 srv1 kernel: lowmem_reserve[]: 0 0 0 0
May  7 05:47:35 srv1 kernel: DMA: 1*4kB 1*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 3*4096kB = 12300kB
May  7 05:47:35 srv1 kernel: DMA32: empty
May  7 05:47:35 srv1 kernel: Normal: 203*4kB 61*8kB 12*16kB 8*32kB 2*64kB 7*128kB 3*256kB 2*512kB 0*1024kB 0*2048kB 17*4096kB = 74196kB
May  7 05:47:35 srv1 kernel: HighMem: 668*4kB 108*8kB 1*16kB 0*32kB 0*64kB 1*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3936kB
May  7 05:47:35 srv1 kernel: Swap cache: add 250563, delete 250523, find 82469/85701, race 0+18
May  7 05:47:35 srv1 kernel: Free swap  = 0kB
May  7 05:47:35 srv1 kernel: Total swap = 859468kB
May  7 05:47:35 srv1 kernel: Free swap:			0kB
May  7 05:47:35 srv1 kernel: 786379 pages of RAM
May  7 05:47:35 srv1 kernel: 557003 pages of HIGHMEM
May  7 05:47:35 srv1 kernel: 7134 reserved pages
May  7 05:47:35 srv1 kernel: 267436 pages shared
May  7 05:47:35 srv1 kernel: 40 pages swap cached
May  7 05:47:35 srv1 kernel: 0 pages dirty
May  7 05:47:35 srv1 kernel: 0 pages writeback
May  7 05:47:35 srv1 kernel: 510 pages mapped
May  7 05:47:35 srv1 kernel: 5025 pages slab
May  7 05:47:35 srv1 kernel: 3031 pages pagetables
May  7 05:47:35 srv1 kernel: Out of Memory: Kill process 1945 (httpd) score 6556 and children.
May  7 05:47:35 srv1 kernel: Out of memory: Killed process 1945 (httpd).
May  7 05:47:35 srv1 kernel: Out of Memory: Kill process 4884 (httpd) score 6556 and children.
May  7 05:47:35 srv1 kernel: Out of memory: Killed process 4884 (httpd).
May  7 05:47:35 srv1 kernel: Out of Memory: Kill process 3242 (httpd) score 6500 and children.
May  7 05:47:35 srv1 kernel: Out of memory: Killed process 3281 (httpd).
May  7 05:47:35 srv1 kernel: Out of Memory: Kill process 3242 (httpd) score 6472 and children.
May  7 05:47:35 srv1 kernel: Out of memory: Killed process 3283 (httpd).

 

i pad..

 

co o tym myslicie? Powtarza sie to co jakis czas

Udostępnij ten post


Link to postu
Udostępnij na innych stronach
Witam,

 

Mam taki problem co jakis czas serwer jakby sie zawieszal. Z niczym nie da sie polaczyc.

 

W logach mam (daemon.log):

 

May  7 05:47:35 srv1 kernel: Free pages:	   90432kB (3936kB HighMem)
May  7 05:47:35 srv1 kernel: Active:343522 inactive:400304 dirty:0 writeback:0 unstable:0 free:22608 slab:5025 mapped:510 pagetables:3031
May  7 05:47:35 srv1 kernel: DMA free:12300kB min:68kB low:84kB high:100kB active:884kB inactive:356kB present:16384kB pages_scanned:0 all_unreclaimable? no
May  7 05:47:35 srv1 kernel: lowmem_reserve[]: 0 0 880 3055
May  7 05:47:35 srv1 kernel: DMA32 free:0kB min:0kB low:0kB high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
May  7 05:47:35 srv1 kernel: lowmem_reserve[]: 0 0 880 3055
May  7 05:47:35 srv1 kernel: Normal free:74196kB min:3756kB low:4692kB high:5632kB active:243020kB inactive:515592kB present:901120kB pages_scanned:13808 all_unreclaimable? no
May  7 05:47:35 srv1 kernel: lowmem_reserve[]: 0 0 0 17406
May  7 05:47:35 srv1 kernel: HighMem free:3936kB min:512kB low:2832kB high:5156kB active:1130312kB inactive:1085140kB present:2228012kB pages_scanned:17777 all_unreclaimable? no
May  7 05:47:35 srv1 kernel: lowmem_reserve[]: 0 0 0 0
May  7 05:47:35 srv1 kernel: DMA: 1*4kB 1*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 3*4096kB = 12300kB
May  7 05:47:35 srv1 kernel: DMA32: empty
										  ^^^^^^^^^^^^^
o tu brkuje wolnej pamieci



May  7 05:47:35 srv1 kernel: Normal: 203*4kB 61*8kB 12*16kB 8*32kB 2*64kB 7*128kB 3*256kB 2*512kB 0*1024kB 0*2048kB 17*4096kB = 74196kB
May  7 05:47:35 srv1 kernel: HighMem: 668*4kB 108*8kB 1*16kB 0*32kB 0*64kB 1*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3936kB
May  7 05:47:35 srv1 kernel: Swap cache: add 250563, delete 250523, find 82469/85701, race 0+18
May  7 05:47:35 srv1 kernel: Free swap  = 0kB
May  7 05:47:35 srv1 kernel: Total swap = 859468kB
May  7 05:47:35 srv1 kernel: Free swap:			0kB
May  7 05:47:35 srv1 kernel: 786379 pages of RAM
May  7 05:47:35 srv1 kernel: 557003 pages of HIGHMEM
May  7 05:47:35 srv1 kernel: 7134 reserved pages
May  7 05:47:35 srv1 kernel: 267436 pages shared
May  7 05:47:35 srv1 kernel: 40 pages swap cached
May  7 05:47:35 srv1 kernel: 0 pages dirty
May  7 05:47:35 srv1 kernel: 0 pages writeback
May  7 05:47:35 srv1 kernel: 510 pages mapped
May  7 05:47:35 srv1 kernel: 5025 pages slab
May  7 05:47:35 srv1 kernel: 3031 pages pagetables
May  7 05:47:35 srv1 kernel: Out of Memory: Kill process 1945 (httpd) score 6556 and children.
May  7 05:47:35 srv1 kernel: Out of memory: Killed process 1945 (httpd).
May  7 05:47:35 srv1 kernel: Out of Memory: Kill process 4884 (httpd) score 6556 and children.
May  7 05:47:35 srv1 kernel: Out of memory: Killed process 4884 (httpd).
May  7 05:47:35 srv1 kernel: Out of Memory: Kill process 3242 (httpd) score 6500 and children.
May  7 05:47:35 srv1 kernel: Out of memory: Killed process 3281 (httpd).
May  7 05:47:35 srv1 kernel: Out of Memory: Kill process 3242 (httpd) score 6472 and children.
May  7 05:47:35 srv1 kernel: Out of memory: Killed process 3283 (httpd).

 

i pad..

 

co o tym myslicie? Powtarza sie to co jakis czas

 

konczy sie pamiec w strefie DMA32 (nieco o roznych rodzajach pamieci o tu http://lwn.net/2001/0607/kernel.php3)

 

Co poza apache i mysql dziala na tej maszynie ? ps axl sie przyda Zdarzylo mi sie ze intensywne i/o do urzadzenia blokowego wyssalo

znaczna czesc tej strefy i powodowalo podobne do twoich problemow.

 

oomkiller zabijl apache wiec prawdopodobnie on jest winowajca

sprobuj zmniejszyc wartosc MaxClients w konfigu apache.

 

Dokladanie ramu tu nie pomoże.

 

Mozliwe ze jest to wina kernela (co to za kernel), nie bylo ostatnio jakies zmiany na tym serwerze ?

 

64 bity rozwiazaly by ten problem, ale wiadomo samo sie nie zrobi.

 

Mozna tez sprobowac podzialu ramu 4G/4G wtedy powinnismy miec wiecej miejsca w strefie dma32.

 

--

Lazy

http://lazy.digart.pl/

Udostępnij ten post


Link to postu
Udostępnij na innych stronach
oomkiller zabijl apache wiec prawdopodobnie on jest winowajca

sprobuj zmniejszyc wartosc MaxClients w konfigu apache.

 

afaik oomkiller to zabija nie winowajce tylko tak o sobie wg. wlasnego uznania (losowo?)

(robilem kiedys test, programik ktory zzera caly ram i swap i oomkiller kilowal nie jego ale cos innego (no bo w koncu kto jest winy? kazdy zabiera pamiec), ale niepamietam na ktorej wersji jadra)

Udostępnij ten post


Link to postu
Udostępnij na innych stronach

Bądź aktywny! Zaloguj się lub utwórz konto

Tylko zarejestrowani użytkownicy mogą komentować zawartość tej strony

Utwórz konto

Zarejestruj nowe konto, to proste!

Zarejestruj nowe konto

Zaloguj się

Posiadasz własne konto? Użyj go!

Zaloguj się

Zaloguj się, aby obserwować  

×