系统不定时无故重启

lg8080

最近系统出了点古怪，总在凌晨至早上9点之间无故重启。
各位有什么高招可以查看故障的原因？

系统是：Oracle Linux 6.2，安装在Oracle VM 3.0.3中，存储在IBM N3300。
以下是messages及dmesg日志。

[root@CYCN-APSRV ~]# less /var/log/messages | grep -i error
May 27 07:59:20 CYCN-APSRV kernel: end_request: I/O error, dev xvda, sector 280590
May 27 07:59:20 CYCN-APSRV kernel: end_request: I/O error, dev xvda, sector 280590
May 27 08:00:43 CYCN-APSRV NetworkManager[1118]: <error> [1338076843.460001] [nm-manager.c:1313] user_proxy_init(): could not init user settings proxy: (3) Could not get owner of name 'org.freedesktop.NetworkManagerUserSettings': no such name
May 27 08:00:43 CYCN-APSRV NetworkManager[1118]: <error> [1338076843.460991] [nm-manager.c:1313] user_proxy_init(): could not init user settings proxy: (3) Could not get owner of name 'org.freedesktop.NetworkManagerUserSettings': no such name
May 27 08:00:43 CYCN-APSRV NetworkManager[1118]: <error> [1338076843.461450] [nm-manager.c:1313] user_proxy_init(): could not init user settings proxy: (3) Could not get owner of name 'org.freedesktop.NetworkManagerUserSettings': no such name
May 27 08:00:43 CYCN-APSRV NetworkManager[1118]: <error> [1338076843.461775] [nm-manager.c:1313] user_proxy_init(): could not init user settings proxy: (3) Could not get owner of name 'org.freedesktop.NetworkManagerUserSettings': no such name
May 27 08:00:43 CYCN-APSRV NetworkManager[1118]: <error> [1338076843.462154] [nm-manager.c:1313] user_proxy_init(): could not init user settings proxy: (3) Could not get owner of name 'org.freedesktop.NetworkManagerUserSettings': no such name
May 27 08:00:43 CYCN-APSRV NetworkManager[1118]: <error> [1338076843.462531] [nm-manager.c:1313] user_proxy_init(): could not init user settings proxy: (3) Could not get owner of name 'org.freedesktop.NetworkManagerUserSettings': no such name
May 27 08:00:43 CYCN-APSRV NetworkManager[1118]: <error> [1338076843.462862] [nm-manager.c:1313] user_proxy_init(): could not init user settings proxy: (3) Could not get owner of name 'org.freedesktop.NetworkManagerUserSettings': no such name
May 27 08:00:43 CYCN-APSRV NetworkManager[1118]: <error> [1338076843.463213] [nm-manager.c:1313] user_proxy_init(): could not init user settings proxy: (3) Could not get owner of name 'org.freedesktop.NetworkManagerUserSettings': no such name
May 27 08:00:43 CYCN-APSRV NetworkManager[1118]: <error> [1338076843.463555] [nm-manager.c:1313] user_proxy_init(): could not init user settings proxy: (3) Could not get owner of name 'org.freedesktop.NetworkManagerUserSettings': no such name
May 27 08:00:43 CYCN-APSRV NetworkManager[1118]: <error> [1338076843.463870] [nm-manager.c:1313] user_proxy_init(): could not init user settings proxy: (3) Could not get owner of name 'org.freedesktop.NetworkManagerUserSettings': no such name
May 27 08:00:43 CYCN-APSRV NetworkManager[1118]: <error> [1338076843.464234] [nm-manager.c:1313] user_proxy_init(): could not init user settings proxy: (3) Could not get owner of name 'org.freedesktop.NetworkManagerUserSettings': no such name
May 27 08:00:43 CYCN-APSRV NetworkManager[1118]: <error> [1338076843.464573] [nm-manager.c:1313] user_proxy_init(): could not init user settings proxy: (3) Could not get owner of name 'org.freedesktop.NetworkManagerUserSettings': no such name
May 27 08:00:43 CYCN-APSRV NetworkManager[1118]: <error> [1338076843.464892] [nm-manager.c:1313] user_proxy_init(): could not init user settings proxy: (3) Could not get owner of name 'org.freedesktop.NetworkManagerUserSettings': no such name
May 27 08:00:43 CYCN-APSRV NetworkManager[1118]: <error> [1338076843.465183] [nm-manager.c:1313] user_proxy_init(): could not init user settings proxy: (3) Could not get owner of name 'org.freedesktop.NetworkManagerUserSettings': no such name
May 27 08:00:43 CYCN-APSRV NetworkManager[1118]: <error> [1338076843.465512] [nm-manager.c:1313] user_proxy_init(): could not init user settings proxy: (3) Could not get owner of name 'org.freedesktop.NetworkManagerUserSettings': no such name
May 27 08:00:43 CYCN-APSRV NetworkManager[1118]: <error> [1338076843.465858] [nm-manager.c:1313] user_proxy_init(): could not init user settings proxy: (3) Could not get owner of name 'org.freedesktop.NetworkManagerUserSettings': no such name
May 27 08:00:43 CYCN-APSRV NetworkManager[1118]: <error> [1338076843.466170] [nm-manager.c:1313] user_proxy_init(): could not init user settings proxy: (3) Could not get owner of name 'org.freedesktop.NetworkManagerUserSettings': no such name
May 27 08:00:46 CYCN-APSRV NetworkManager[1118]: <error> [1338076846.307131] [nm-manager.c:1313] user_proxy_init(): could not init user settings proxy: (3) Could not get owner of name 'org.freedesktop.NetworkManagerUserSettings': no such name
May 27 08:06:55 CYCN-APSRV NetworkManager[1124]: <error> [1338077215.899852] [nm-device-ethernet.c:729] real_update_permanent_hw_address(): (eth0): unable to read permanent MAC address (error 0)
May 27 08:06:55 CYCN-APSRV NetworkManager[1124]: <warn> bluez error getting default adapter: The name org.bluez was not provided by any .service files





[root@CYCN-APSRV ~]# dmesg
Initializing cgroup subsys cpuset
Initializing cgroup subsys cpu
Linux version 2.6.32-100.34.1.el6uek.x86_64 (mockbuild@ca-build44.us.oracle.com) (gcc version 4.4.4 20100726 (Red Hat 4.4.4-13) (GCC) ) #1 SMP Wed May 25 17:46:45 EDT 2011
Command line: ro root=/dev/mapper/vg_cycnapsrv-lv_root rd_LVM_LV=vg_cycnapsrv/lv_root rd_LVM_LV=vg_cycnapsrv/lv_swap rd_NO_LUKS rd_NO_MD rd_NO_DM LANG=zh_CN.UTF-8 KEYBOARDTYPE=pc KEYTABLE=us  rhgb quiet
KERNEL supported cpus:
  Intel GenuineIntel
  AMD AuthenticAMD
  Centaur CentaurHauls
BIOS-provided physical RAM map:
BIOS-e820: 0000000000000000 - 000000000009fc00 (usable)
BIOS-e820: 000000000009fc00 - 00000000000a0000 (reserved)
BIOS-e820: 00000000000e0000 - 0000000000100000 (reserved)
BIOS-e820: 0000000000100000 - 00000000f0000000 (usable)
BIOS-e820: 00000000fc000000 - 0000000100000000 (reserved)
BIOS-e820: 0000000100000000 - 0000000410400000 (usable)
DMI 2.4 present.
last_pfn = 0x410400 max_arch_pfn = 0x400000000
MTRR default type: write-back
MTRR fixed ranges enabled:
  00000-9FFFF write-back
  A0000-BFFFF write-combining
  C0000-FFFFF write-back
MTRR variable ranges enabled:
  0 base 000F0000000 mask FFFF8000000 uncachable
  1 base 000F8000000 mask FFFFC000000 uncachable
  2 disabled
  3 disabled
  4 disabled
  5 disabled
  6 disabled
  7 disabled
x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106
last_pfn = 0xf0000 max_arch_pfn = 0x400000000
initial memory mapped : 0 - 20000000
init_memory_mapping: 0000000000000000-00000000f0000000
0000000000 - 00f0000000 page 2M
kernel direct mapping tables up to f0000000 @ 8000-d000
init_memory_mapping: 0000000100000000-0000000410400000
0100000000 - 0410400000 page 2M
kernel direct mapping tables up to 410400000 @ b000-1d000
RAMDISK: 37374000 - 37fef0ec
ACPI: RSDP 00000000000ea020 00024 (v02    Xen)
ACPI: XSDT 00000000fc012c90 00034 (v01    Xen      HVM 00000000 HVML 00000000)
ACPI: FACP 00000000fc012ab0 000F4 (v04    Xen      HVM 00000000 HVML 00000000)
ACPI: DSDT 00000000fc002c40 0FDEF (v02    Xen      HVM 00000000 INTL 20100331)
ACPI: FACS 00000000fc002c00 00040
ACPI: APIC 00000000fc012bb0 000D8 (v02    Xen      HVM 00000000 HVML 00000000)
ACPI: Local APIC address 0xfee00000
No NUMA configuration found
Faking a node at 0000000000000000-0000000410400000
Bootmem setup node 0 0000000000000000-0000000410400000
  NODE_DATA [0000000000018000 - 000000000002dfff]
  bootmap [0000000000100000 -  000000000018207f] pages 83
(8 early reservations) ==> bootmem [0000000000 - 0410400000]
  #0 [0000000000 - 0000001000]   BIOS data page ==> [0000000000 - 0000001000]
  #1 [0000006000 - 0000008000]       TRAMPOLINE ==> [0000006000 - 0000008000]
  #2 [0001000000 - 00022056ac]    TEXT DATA BSS ==> [0001000000 - 00022056ac]
  #3 [0037374000 - 0037fef0ec]          RAMDISK ==> [0037374000 - 0037fef0ec]
  #4 [000009fc00 - 0000100000]    BIOS reserved ==> [000009fc00 - 0000100000]
  #5 [0002206000 - 0002206099]              BRK ==> [0002206000 - 0002206099]
  #6 [0000008000 - 000000b000]          PGTABLE ==> [0000008000 - 000000b000]
  #7 [000000b000 - 0000018000]          PGTABLE ==> [000000b000 - 0000018000]
found SMP MP-table at [ffff8800000fbcf0] fbcf0
[ffffea0000000000-ffffea000e5fffff] PMD -> [ffff880028600000-ffff8800369fffff] on node 0
Zone PFN ranges:
  DMA      0x00000000 -> 0x00001000
  DMA32    0x00001000 -> 0x00100000
  Normal   0x00100000 -> 0x00410400
Movable zone start PFN for each node
early_node_map[3] active PFN ranges
    0: 0x00000000 -> 0x0000009f
    0: 0x00000100 -> 0x000f0000
    0: 0x00100000 -> 0x00410400
On node 0 totalpages: 4195231
  DMA zone: 56 pages used for memmap
  DMA zone: 115 pages reserved
  DMA zone: 3828 pages, LIFO batch:0
  DMA32 zone: 14280 pages used for memmap
  DMA32 zone: 964664 pages, LIFO batch:31
  Normal zone: 43918 pages used for memmap
  Normal zone: 3168370 pages, LIFO batch:31
ACPI: PM-Timer IO Port: 0x1f48
ACPI: Local APIC address 0xfee00000
ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled)
ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)
ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled)
ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled)
ACPI: LAPIC (acpi_id[0x05] lapic_id[0x0a] enabled)
ACPI: LAPIC (acpi_id[0x06] lapic_id[0x0c] enabled)
ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0e] enabled)
ACPI: LAPIC (acpi_id[0x08] lapic_id[0x10] disabled)
ACPI: LAPIC (acpi_id[0x09] lapic_id[0x12] disabled)
ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x14] disabled)
ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x16] disabled)
ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x18] disabled)
ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x1a] disabled)
ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x1c] disabled)
ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0])
IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-47
ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 low level)
ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 low level)
ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 low level)
ACPI: IRQ0 used by override.
ACPI: IRQ2 used by override.
ACPI: IRQ5 used by override.
ACPI: IRQ9 used by override.
ACPI: IRQ10 used by override.
ACPI: IRQ11 used by override.
Using ACPI (MADT) for SMP configuration information
SMP: Allowing 15 CPUs, 7 hotplug CPUs
nr_irqs_gsi: 48
Xen version 4.0.
Xen Platform PCI: I/O protocol version 1
Netfront and the Xen platform PCI driver have been compiled for this kernel: unplug emulated NICs.
Blkfront and the Xen platform PCI driver have been compiled for this kernel: unplug emulated disks.
You might have to change the root device
from /dev/hd[a-d] to /dev/xvd[a-d]
in your root= kernel command line option
PM: Registered nosave memory: 000000000009f000 - 00000000000a0000
PM: Registered nosave memory: 00000000000a0000 - 00000000000e0000
PM: Registered nosave memory: 00000000000e0000 - 0000000000100000
PM: Registered nosave memory: 00000000f0000000 - 00000000fc000000
PM: Registered nosave memory: 00000000fc000000 - 0000000100000000
Allocating PCI resources starting at f0000000 (gap: f0000000:c000000)
Booting paravirtualized kernel on Xen
NR_CPUS:256 nr_cpumask_bits:256 nr_cpu_ids:15 nr_node_ids:1
PERCPU: Embedded 29 pages/cpu @ffff880028200000 s87512 r8192 d23080 u131072
pcpu-alloc: s87512 r8192 d23080 u131072 alloc=1*2097152
pcpu-alloc: [0] 00 01 02 03 04 05 06 07 08 09 10 11 12 13 14 --
Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 4136862
Policy zone: Normal
Kernel command line: ro root=/dev/mapper/vg_cycnapsrv-lv_root rd_LVM_LV=vg_cycnapsrv/lv_root rd_LVM_LV=vg_cycnapsrv/lv_swap rd_NO_LUKS rd_NO_MD rd_NO_DM LANG=zh_CN.UTF-8 KEYBOARDTYPE=pc KEYTABLE=us  rhgb quiet
PID hash table entries: 4096 (order: 3, 32768 bytes)
Initializing CPU#0
Checking aperture...
No AGP bridge found
Calgary: detecting Calgary via BIOS EBDA area
Calgary: Unable to locate Rio Grande table in EBDA - bailing!
PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
Placing 64MB software IO TLB between ffff880020000000 - ffff880024000000
software IO TLB at phys 0x20000000 - 0x24000000
Memory: 16448052k/17043456k available (4365k kernel code, 262532k absent, 332872k reserved, 7027k data, 1688k init)
Hierarchical RCU implementation.
NR_IRQS:4352 nr_irqs:936
Xen HVM callback vector for event delivery is enabled
Console: colour VGA+ 80x25
console [tty0] enabled
allocated 169082880 bytes of page_cgroup
please try 'cgroup_disable=memory' option if you don't want memory cgroups
Fast TSC calibration using PIT
Detected 2128.788 MHz processor.
Calibrating delay loop (skipped), value calculated using timer frequency.. 4257.57 BogoMIPS (lpj=212878
Security Framework initialized
SELinux:  Initializing.
SELinux:  Starting in permissive mode
Dentry cache hash table entries: 2097152 (order: 12, 16777216 bytes)
Inode-cache hash table entries: 1048576 (order: 11, 8388608 bytes)
Mount-cache hash table entries: 256
Initializing cgroup subsys ns
Initializing cgroup subsys cpuacct
Initializing cgroup subsys memory
Initializing cgroup subsys devices
Initializing cgroup subsys freezer
Initializing cgroup subsys net_cls
CPU: L1 I cache: 32K, L1 D cache: 32K
CPU: L2 cache: 256K
CPU: L3 cache: 24576K
CPU 0/0x0 -> Node 0
CPU: Unsupported number of siblings 128
mce: CPU supports 24 MCE banks
Performance Events: unsupported p6 CPU model 47 no PMU driver, software events only.
ACPI: Core revision 20090903
ftrace: converting mcount calls to 0f 1f 44 00 00
ftrace: allocating 22502 entries in 89 pages
Setting APIC routing to physical flat
..TIMER: vector=0x30 apic1=0 pin1=2 apic2=0 pin2=0
CPU0: Intel(R) Xeon(R) CPU E7- 4830  @ 2.13GHz stepping 02
Booting processor 1 APIC 0x2 ip 0x6000
Initializing CPU#1
CPU: L1 I cache: 32K, L1 D cache: 32K
CPU: L2 cache: 256K
CPU: L3 cache: 24576K
CPU 1/0x2 -> Node 0
CPU: Unsupported number of siblings 128
CPU1: Intel(R) Xeon(R) CPU E7- 4830  @ 2.13GHz stepping 02
checking TSC synchronization [CPU#0 -> CPU#1]: passed.
Booting processor 2 APIC 0x4 ip 0x6000
Initializing CPU#2
CPU: L1 I cache: 32K, L1 D cache: 32K
CPU: L2 cache: 256K
CPU: L3 cache: 24576K
CPU 2/0x4 -> Node 0
CPU: Unsupported number of siblings 128
CPU2: Intel(R) Xeon(R) CPU E7- 4830  @ 2.13GHz stepping 02
checking TSC synchronization [CPU#0 -> CPU#2]: passed.
Booting processor 3 APIC 0x6 ip 0x6000

lg8080

Initializing CPU#3
CPU: L1 I cache: 32K, L1 D cache: 32K
CPU: L2 cache: 256K
CPU: L3 cache: 24576K
CPU 3/0x6 -> Node 0
CPU: Unsupported number of siblings 128
CPU3: Intel(R) Xeon(R) CPU E7- 4830  @ 2.13GHz stepping 02
checking TSC synchronization [CPU#0 -> CPU#3]: passed.
Booting processor 4 APIC 0x8 ip 0x6000
Initializing CPU#4
CPU: L1 I cache: 32K, L1 D cache: 32K
CPU: L2 cache: 256K
CPU: L3 cache: 24576K
CPU 4/0x8 -> Node 0
CPU: Unsupported number of siblings 128
CPU4: Intel(R) Xeon(R) CPU E7- 4830  @ 2.13GHz stepping 02
checking TSC synchronization [CPU#0 -> CPU#4]: passed.
Booting processor 5 APIC 0xa ip 0x6000
Initializing CPU#5
CPU: L1 I cache: 32K, L1 D cache: 32K
CPU: L2 cache: 256K
CPU: L3 cache: 24576K
CPU 5/0xa -> Node 0
CPU: Unsupported number of siblings 128
CPU5: Intel(R) Xeon(R) CPU E7- 4830  @ 2.13GHz stepping 02
checking TSC synchronization [CPU#0 -> CPU#5]: passed.
Booting processor 6 APIC 0xc ip 0x6000
Initializing CPU#6
CPU: L1 I cache: 32K, L1 D cache: 32K
CPU: L2 cache: 256K
CPU: L3 cache: 24576K
CPU 6/0xc -> Node 0
CPU: Unsupported number of siblings 128
CPU6: Intel(R) Xeon(R) CPU E7- 4830  @ 2.13GHz stepping 02
checking TSC synchronization [CPU#0 -> CPU#6]: passed.
Booting processor 7 APIC 0xe ip 0x6000
Initializing CPU#7
CPU: L1 I cache: 32K, L1 D cache: 32K
CPU: L2 cache: 256K
CPU: L3 cache: 24576K
CPU 7/0xe -> Node 0
CPU: Unsupported number of siblings 128
CPU7: Intel(R) Xeon(R) CPU E7- 4830  @ 2.13GHz stepping 02
checking TSC synchronization [CPU#0 -> CPU#7]: passed.
Brought up 8 CPUs
Total of 8 processors activated (34057.98 BogoMIPS).
CPU0 attaching sched-domain:
domain 0: span 0-7 level CPU
  groups: 0 1 2 3 4 5 6 7
CPU1 attaching sched-domain:
domain 0: span 0-7 level CPU
  groups: 1 2 3 4 5 6 7 0
CPU2 attaching sched-domain:
domain 0: span 0-7 level CPU
  groups: 2 3 4 5 6 7 0 1
CPU3 attaching sched-domain:
domain 0: span 0-7 level CPU
  groups: 3 4 5 6 7 0 1 2
CPU4 attaching sched-domain:
domain 0: span 0-7 level CPU
  groups: 4 5 6 7 0 1 2 3
CPU5 attaching sched-domain:
domain 0: span 0-7 level CPU
  groups: 5 6 7 0 1 2 3 4
CPU6 attaching sched-domain:
domain 0: span 0-7 level CPU
  groups: 6 7 0 1 2 3 4 5
CPU7 attaching sched-domain:
domain 0: span 0-7 level CPU
  groups: 7 0 1 2 3 4 5 6
regulator: core version 0.5
Time:  0:06:34  Date: 05/27/12
NET: Registered protocol family 16
  alloc irq_desc for 935 on node 0
  alloc kstat_irqs on node 0
ACPI: bus type pci registered
PCI: Using configuration type 1 for base access
bio: create slab <bio-0> at 0
ACPI: EC: Look up EC in DSDT
ACPI: Interpreter enabled
ACPI: (supports S0 S5)
ACPI: Using IOAPIC for interrupt routing
ACPI: No dock devices found.
ACPI: PCI Root Bridge [PCI0] (0000:00)
pci 0000:00:01.1: reg 20 io port: [0xc200-0xc20f]
* Found PM-Timer Bug on the chipset. Due to workarounds for a bug,
* this clock source is slow. Consider trying other clock sources
pci 0000:00:01.3: quirk: region 1f40-1f7f claimed by PIIX4 ACPI
pci 0000:00:02.0: reg 10 32bit mmio pref: [0xf0000000-0xf1ffffff]
pci 0000:00:02.0: reg 14 32bit mmio: [0xf3000000-0xf3000fff]
pci 0000:00:03.0: reg 10 io port: [0xc000-0xc0ff]
pci 0000:00:03.0: reg 14 32bit mmio pref: [0xf2000000-0xf2ffffff]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
ACPI: PCI Interrupt Link [LNKA] (IRQs *5 10 11)
ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)
ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)
ACPI: PCI Interrupt Link [LNKD] (IRQs *5 10 11)
vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none
vgaarb: loaded
SCSI subsystem initialized
libata version 3.00 loaded.
usbcore: registered new interface driver usbfs
usbcore: registered new interface driver hub
usbcore: registered new device driver usb
PCI: Using ACPI for IRQ routing
NetLabel: Initializing
NetLabel:  domain hash size = 128
NetLabel:  protocols = UNLABELED CIPSOv4
NetLabel:  unlabeled traffic allowed by default
Switching to clocksource tsc
pnp: PnP ACPI init
ACPI: bus type pnp registered
pnp: PnP ACPI: found 12 devices
ACPI: ACPI bus type pnp unregistered
system 00:00: iomem range 0x0-0x9ffff could not be reserved
system 00:02: ioport range 0x10c0-0x1141 has been reserved
system 00:02: ioport range 0xb044-0xb047 has been reserved
system 00:03: ioport range 0x8a0-0x8a3 has been reserved
system 00:03: ioport range 0xcc0-0xccf has been reserved
system 00:03: ioport range 0x4d0-0x4d1 has been reserved
pci_bus 0000:00: resource 0 io:  [0x00-0xffff]
pci_bus 0000:00: resource 1 mem: [0x000000-0xffffffffffffffff]
NET: Registered protocol family 2
IP route cache hash table entries: 524288 (order: 10, 4194304 bytes)
TCP established hash table entries: 524288 (order: 11, 8388608 bytes)
TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
TCP: Hash tables configured (established 524288 bind 65536)
TCP reno registered
NET: Registered protocol family 1
pci 0000:00:00.0: Limiting direct PCI/PCI transfers
pci 0000:00:01.0: PIIX3: Enabling Passive Release
pci 0000:00:01.0: Activating ISA DMA hang workarounds
pci 0000:00:02.0: Boot video device
Trying to unpack rootfs image as initramfs...
Freeing initrd memory: 12780k freed
audit: initializing netlink socket (disabled)
type=2000 audit(1338077194.876:1): initialized
HugeTLB registered 2 MB page size, pre-allocated 0 pages
VFS: Disk quotas dquot_6.5.2
Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
msgmni has been set to 32150
SELinux:  Registering netfilter hooks
alg: No test for stdrng (krng)
ksign: Installing public key data
Loading keyring
- Added public key F49AFA82FFAEDEDF
- User ID: Oracle America, Inc. (Kernel Module GPG key)
Block layer SCSI generic (bsg) driver version 0.4 loaded (major 252)
io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered (default)
io scheduler cfq registered
pci_hotplug: PCI Hot Plug PCI Core version: 0.5
pciehp: PCI Express Hot Plug Controller Driver version: 0.4
acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
acpiphp: Slot [0] registered
acpiphp: Slot [1] registered
acpiphp: Slot [2] registered
acpiphp: Slot [3] registered
acpiphp: Slot [4] registered
acpiphp: Slot [5] registered
acpiphp: Slot [6] registered
acpiphp: Slot [7] registered
acpiphp: Slot [8] registered
acpiphp: Slot [9] registered
acpiphp: Slot [10] registered
acpiphp: Slot [11] registered
acpiphp: Slot [12] registered
acpiphp: Slot [13] registered
acpiphp: Slot [14] registered
acpiphp: Slot [15] registered
acpiphp: Slot [16] registered
acpiphp: Slot [17] registered
acpiphp: Slot [18] registered
acpiphp: Slot [19] registered
acpiphp: Slot [20] registered
acpiphp: Slot [21] registered
acpiphp: Slot [22] registered
acpiphp: Slot [23] registered
acpiphp: Slot [24] registered
acpiphp: Slot [25] registered
acpiphp: Slot [26] registered
acpiphp: Slot [27] registered
acpiphp: Slot [28] registered
acpiphp: Slot [29] registered
acpiphp: Slot [30] registered
acpiphp: Slot [31] registered
pci-stub: invalid id string ""
input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
ACPI: Power Button [PWRF]
input: Sleep Button as /devices/LNXSYSTM:00/LNXSLPBN:00/input/input1
ACPI: Sleep Button [SLPF]
processor LNXCPU:00: registered as cooling_device0
processor LNXCPU:01: registered as cooling_device1
processor LNXCPU:02: registered as cooling_device2
processor LNXCPU:03: registered as cooling_device3
processor LNXCPU:04: registered as cooling_device4
processor LNXCPU:05: registered as cooling_device5
processor LNXCPU:06: registered as cooling_device6
processor LNXCPU:07: registered as cooling_device7
  alloc irq_desc for 28 on node -1
  alloc kstat_irqs on node -1
xen-platform-pci 0000:00:03.0: PCI INT A -> GSI 28 (level, low) -> IRQ 28
Grant table initialized
Non-volatile memory driver v1.3
Linux agpgart interface v0.103
Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
00:0a: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
brd: module loaded
loop: module loaded
input: Macintosh mouse button emulation as /devices/virtual/input/input2
Fixed MDIO Bus: probed
ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
PNP: PS/2 Controller [PNP0303S2K,PNP0f13S2M] at 0x60,0x64 irq 1,12
serio: i8042 KBD port at 0x60,0x64 irq 1
serio: i8042 AUX port at 0x60,0x64 irq 12
mice: PS/2 mouse device common for all mice
rtc_cmos 00:05: RTC can wake from S4
rtc_cmos 00:05: rtc core: registered rtc_cmos as rtc0
rtc0: alarms up to one day, 114 bytes nvram
input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input3
device-mapper: uevent: version 1.0.3
device-mapper: ioctl: 4.15.0-ioctl (2009-04-01) initialised: dm-devel@redhat.com
cpuidle: using governor ladder
cpuidle: using governor menu
usbcore: registered new interface driver hiddev
usbcore: registered new interface driver usbhid
usbhid: v2.6:USB HID core driver
TCP cubic registered
Initializing XFRM netlink socket
NET: Registered protocol family 17
PM: Resume from disk failed.
registered taskstats version 1
No TPM chip found, activating TPM-bypass!
XENBUS: Device with no driver: device/vkbd/0
XENBUS: Device with no driver: device/vfb/0
XENBUS: Device with no driver: device/console/0
XENBUS: Device with no driver: device/vbd/51712
XENBUS: Device with no driver: device/vif/0
  Magic number: 12:84:103
rtc_cmos 00:05: setting system clock to 2012-05-27 00:06:36 UTC (1338077196)
Initalizing network drop monitor service
Freeing unused kernel memory: 1688k freed
Write protecting the kernel read-only data: 6552k
dracut: dracut-004-53.el6
dracut: rd_NO_LUKS: removing cryptoluks activation
udev: starting version 147
dracut: Starting plymouth daemon
dracut: rd_NO_DM: removing DM RAID activation
dracut: rd_NO_MD: removing MD RAID activation
input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input4
ata_piix 0000:00:01.1: version 2.13
ata_piix 0000:00:01.1: setting latency timer to 64
scsi0 : ata_piix
scsi1 : ata_piix
ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc200 irq 14
ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc208 irq 15
  alloc irq_desc for 934 on node 0
  alloc kstat_irqs on node 0
blkfront: xvda: barriers enabled (tag)
xvda: xvda1 xvda2
FDC 0 is a S82078B
dracut: Scanning devices xvda2  for LVM logical volumes vg_cycnapsrv/lv_root vg_cycnapsrv/lv_swap
dracut: inactive '/dev/vg_cycnapsrv/lv_root' [20.00 GiB] inherit
dracut: inactive '/dev/vg_cycnapsrv/lv_swap' [15.62 GiB] inherit
dracut: inactive '/dev/vg_cycnapsrv/lv_u1' [33.59 GiB] inherit
dracut: inactive '/dev/vg_cycnapsrv/lv_u2' [29.30 GiB] inherit
EXT4-fs (dm-0): INFO: recovery required on readonly filesystem
EXT4-fs (dm-0): write access will be enabled during recovery
EXT4-fs (dm-0): orphan cleanup on readonly fs
EXT4-fs (dm-0): ext4_orphan_cleanup: deleting unreferenced inode 1183092
EXT4-fs (dm-0): 1 orphan inode deleted
EXT4-fs (dm-0): recovery complete
EXT4-fs (dm-0): mounted filesystem with ordered data mode
dracut: Mounted root filesystem /dev/mapper/vg_cycnapsrv-lv_root
dracut: Loading SELinux policy
SELinux:  Disabled at runtime.
SELinux:  Unregistering netfilter hooks
type=1404 audit(1338077201.852:2): selinux=0 auid=4294967295 ses=4294967295
dracut: /sbin/load_policy: 无法加载策略： 没有那个文件或目录
dracut: Switching root
udev: starting version 147
input: PC Speaker as /devices/platform/pcspkr/input/input5
microcode: CPU0 sig=0x206f2, pf=0x4, revision=0x32
platform microcode: firmware: requesting intel-ucode/06-2f-02
microcode: CPU1 sig=0x206f2, pf=0x4, revision=0x32
platform microcode: firmware: requesting intel-ucode/06-2f-02
microcode: CPU2 sig=0x206f2, pf=0x4, revision=0x32
platform microcode: firmware: requesting intel-ucode/06-2f-02
microcode: CPU3 sig=0x206f2, pf=0x4, revision=0x32
platform microcode: firmware: requesting intel-ucode/06-2f-02
microcode: CPU4 sig=0x206f2, pf=0x4, revision=0x32
platform microcode: firmware: requesting intel-ucode/06-2f-02
microcode: CPU5 sig=0x206f2, pf=0x4, revision=0x32
platform microcode: firmware: requesting intel-ucode/06-2f-02
microcode: CPU6 sig=0x206f2, pf=0x4, revision=0x32
platform microcode: firmware: requesting intel-ucode/06-2f-02
microcode: CPU7 sig=0x206f2, pf=0x4, revision=0x32
platform microcode: firmware: requesting intel-ucode/06-2f-02
Microcode Update Driver: v2.00 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
piix4_smbus 0000:00:01.3: SMBus base address uninitialized - upgrade BIOS or use force_addr=0xaddr
Initialising Xen virtual ethernet driver.
  alloc irq_desc for 933 on node 0
  alloc kstat_irqs on node 0
parport_pc 00:0b: reported by Plug and Play ACPI
parport0: PC-style at 0x378, irq 7 [PCSPP,TRISTATE]
ppdev: user-space parallel port driver
EXT4-fs (xvda1): mounted filesystem with ordered data mode
EXT4-fs (dm-2): mounted filesystem with ordered data mode
EXT4-fs (dm-3): mounted filesystem with ordered data mode
Adding 16383992k swap on /dev/mapper/vg_cycnapsrv-lv_swap.  Priority:-1 extents:1 across:16383992k
NET: Registered protocol family 10
lo: Disabled Privacy Extensions
RPC: Registered udp transport module.
RPC: Registered tcp transport module.
RPC: Registered tcp NFSv4.1 backchannel transport module.
eth0: no IPv6 routers present
CPU0 attaching NULL sched-domain.
CPU1 attaching NULL sched-domain.
CPU2 attaching NULL sched-domain.
CPU3 attaching NULL sched-domain.
CPU4 attaching NULL sched-domain.
CPU5 attaching NULL sched-domain.
CPU6 attaching NULL sched-domain.
CPU7 attaching NULL sched-domain.
CPU0 attaching sched-domain:
domain 0: span 0-7 level CPU
  groups: 0 1 2 3 4 5 6 7
CPU1 attaching sched-domain:
domain 0: span 0-7 level CPU
  groups: 1 2 3 4 5 6 7 0
CPU2 attaching sched-domain:
domain 0: span 0-7 level CPU
  groups: 2 3 4 5 6 7 0 1
CPU3 attaching sched-domain:
domain 0: span 0-7 level CPU
  groups: 3 4 5 6 7 0 1 2
CPU4 attaching sched-domain:
domain 0: span 0-7 level CPU
  groups: 4 5 6 7 0 1 2 3
CPU5 attaching sched-domain:
domain 0: span 0-7 level CPU
  groups: 5 6 7 0 1 2 3 4
CPU6 attaching sched-domain:
domain 0: span 0-7 level CPU
  groups: 6 7 0 1 2 3 4 5
CPU7 attaching sched-domain:
domain 0: span 0-7 level CPU
  groups: 7 0 1 2 3 4 5 6

610302547

回复 2# lg8080


1.    用putty登录，vim message，看看是否有红色显示的日志行，或者err报错！如果是硬件或者系统内核错误都可能在这里显示！

2.   如果排除硬件，就检查系统应用层面，查看系统中运行什么程序，程序中是否写有重启命令！之后看crontab！

系统无故重启和系统无故关机，死机，很难排查！

个人建议：使用nmon这个系统检测工具打印一些日志出来，如果再有重启的问题，根据这个nmon检测出来的日志进行排查，(1),系统当时跑了什么程序，（2）cpu负载！

或者使用hp或者dell提供的硬件检测工具进行排查！

这是我的一些思路，希望能够帮到你！

anonymous0502

RAC节点主机？

lg8080

好久没来了。
这个问题当时解决了，是内存的原因。把内存拆出来，擦一下黄金脚就解决了。

joe_mii

请问你当时是怎么查出来是内存报错的呢？回复 5# lg8080


   

joe_mii

请问你当时是怎么检查并确定是内存的问题的呢？

lg8080 发表于 2013-03-07 10:50
好久没来了。
这个问题当时解决了，是内存的原因。把内存拆出来，擦一下黄金脚就解决了。

joe_mii

请问你当时是怎么检查并确定是内存的问题的呢？

lg8080 发表于 2013-03-07 10:50
好久没来了。
这个问题当时解决了，是内存的原因。把内存拆出来，擦一下黄金脚就解决了。