最新一sybase频繁自动down掉问题

xietong007

sybase 的版本如下：

Adaptive Server Enterprise/15.0.3/EBF 17157 ESD#3/P/x86_64/Enterprise Linux/ase
         1503/2726/64-bit/FBO/Fri Feb  5 01:42:20 2010                     


查看了sybase的日志，几乎每次sybase突然自动停止都会打印类似如下信息：


00:00000:00014:2014/03/10 12:19:42.17 server  Checking external objects.
00:00000:00014:2014/03/10 12:19:43.00 server  The transaction log in the database 'zxuma' will use I/O size of 8 Kb.
00:00000:00014:2014/03/10 12:19:43.02 server  Database 'zxuma' is now online.
00:00000:00001:2014/03/10 12:19:43.03 server  Recovery has restored the value of 'local async prefetch limit' for '64K' pool in 'default data cache' from '80' to 'DEFAULT'.
00:00000:00001:2014/03/10 12:19:43.03 server  Recovery has restored the value of 'local async prefetch limit' for '8K' pool in 'default data cache' from '80' to 'DEFAULT'.
00:00000:00001:2014/03/10 12:19:43.09 server  Recovery has restored the original size for '64K' pool and '8K' pool in 'default data cache'.
00:00000:00001:2014/03/10 12:19:43.10 server  Recovery complete.
00:00000:00001:2014/03/10 12:19:43.10 server  ASE's default unicode sort order is 'binary'.
00:00000:00001:2014/03/10 12:19:43.10 server  ASE's default sort order is:
00:00000:00001:2014/03/10 12:19:43.10 server          'bin_utf8' (ID = 50)
00:00000:00001:2014/03/10 12:19:43.10 server  on top of default character set:
00:00000:00001:2014/03/10 12:19:43.10 server          'utf8' (ID = 190).
00:00000:00001:2014/03/10 12:19:43.10 server  Master device size: 4000 megabytes, or 2048000 virtual pages. (A virtual page is 2048 bytes.)
00:00000:00001:2014/03/10 12:19:43.11 kernel  Warning: Cannot set console to nonblocking mode, switching to blocking mode.
02:00000:00338:2014/03/10 12:28:54.70 kernel  Current process (0x208020 infected with signal 11 (SIGSEGV)
02:00000:00338:2014/03/10 12:28:54.70 kernel  Address 0x0x0000000001974324 (kbfalloc+0x254), siginfo (code, address) = (1, 0x0x000000000000001
02:00000:00338:2014/03/10 12:28:54.70 kernel  Spinlocks held by  kpid 34079240
02:00000:00338:2014/03/10 12:28:54.70 kernel  Spinlock DATACHG_SPIN at address 0x0000000142bbc320 owned by 34079240
02:00000:00338:2014/03/10 12:28:54.70 kernel  End of spinlock display.
02:00000:00338:2014/03/10 12:28:54.70 kernel  pc: 0x0000000001689015 pcstkwalk+0x30()
02:00000:00338:2014/03/10 12:28:54.70 kernel  pc: 0x0000000001688e09 ucstkgentrace+0x199()
02:00000:00338:2014/03/10 12:28:54.70 kernel  pc: 0x000000000164143e ucbacktrace+0x40()
02:00000:00338:2014/03/10 12:28:54.70 kernel  pc: 0x000000000074fa90 terminate_process+0x1430()
02:00000:00338:2014/03/10 12:28:54.70 kernel  pc: 0x0000000001669215 kisignal+0x2f5()
02:00000:00338:2014/03/10 12:28:54.70 kernel  pc: 0x0000000001974324 kbfalloc+0x254()
02:00000:00338:2014/03/10 12:28:54.70 kernel  pc: 0x0000000000b6fcab ptn__pdes_init_colupdcnt+0x5b()
02:00000:00338:2014/03/10 12:28:54.70 kernel  pc: 0x0000000000b6d938 ptn_pdes_install+0x2a8()
02:00000:00338:2014/03/10 12:28:54.70 kernel  pc: 0x0000000000b6d5e2 ptn__pdes_install+0xc2()
02:00000:00338:2014/03/10 12:28:54.70 kernel  pc: 0x0000000000b6e338 ptn__pdes_init_fromrow+0x28()
02:00000:00338:2014/03/10 12:28:54.70 kernel  [Handler pc: 0x0x00000000013a2697 ptn_handler installed by the following function:-]
02:00000:00338:2014/03/10 12:28:54.70 kernel  pc: 0x0000000000b6e106 ptn_pdes_init+0x286()
02:00000:00338:2014/03/10 12:28:54.70 kernel  pc: 0x0000000000b64e98 ind__ides_init_fromrow+0x98()
02:00000:00338:2014/03/10 12:28:54.70 kernel  [Handler pc: 0x0x000000000139ec3c sysind_handler installed by the following function:-]
02:00000:00338:2014/03/10 12:28:54.70 kernel  pc: 0x0000000000b649bd ind_ides_init+0x79d()
02:00000:00338:2014/03/10 12:28:54.70 kernel  [Handler pc: 0x0x0000000001363690 des__errhdl installed by the following function:-]
02:00000:00338:2014/03/10 12:28:54.70 kernel  pc: 0x0000000000b2317c des__fill_common+0x27c()
02:00000:00338:2014/03/10 12:28:54.70 kernel  [Handler pc: 0x0x0000000001363690 des__errhdl installed by the following function:-]
02:00000:00338:2014/03/10 12:28:54.70 kernel  pc: 0x0000000000b2013f des(float, int, long, long)+0x2df()
02:00000:00338:2014/03/10 12:28:54.70 kernel  pc: 0x00000000018c0162 des_get+0x6c2()
02:00000:00338:2014/03/10 12:28:54.70 kernel  [Handler pc: 0x0x00000000014a8aed hdl_backout_msg installed by the following function:-]
02:00000:00338:2014/03/10 12:28:54.70 kernel  pc: 0x0000000000c5fcdb get_name+0xcb()
02:00000:00338:2014/03/10 12:28:54.70 kernel  pc: 0x0000000000bdfd6b rvm_bi_check_obj_access+0x7b()
02:00000:00338:2014/03/10 12:28:54.70 kernel  [Handler pc: 0x0x00000000014af943 lookup_handler installed by the following function:-]
02:00000:00338:2014/03/10 12:28:54.70 kernel  pc: 0x0000000000c65a8e ptngetrowcount+0x29e()
02:00000:00338:2014/03/10 12:28:54.70 kernel  pc: 0x0000000001842629 LeRun+0xb089()
02:00000:00338:2014/03/10 12:28:54.70 kernel  pc: 0x0000000001836b85 LeEvals::LeEvRun(LeRunMode, LeRunStack*, short, LeDataRow*, unsigned char*, int*)+0x55()
02:00000:00338:2014/03/10 12:28:54.70 kernel  pc: 0x0000000001983bd0 LeRestrictOp::_LeOpNext(ExeCtxt&+0x260()
02:00000:00338:2014/03/10 12:28:54.70 kernel  pc: 0x0000000001835ef3 LeEmitSndOp::_LeOpNext(ExeCtxt&+0x123()
02:00000:00338:2014/03/10 12:28:54.70 kernel  pc: 0x000000000182f77b LePlanNext+0x1bb()
02:00000:00338:2014/03/10 12:28:54.70 kernel  [Handler pc: 0x0x0000000000ba9700 le_execerr installed by the following function:-]
02:00000:00338:2014/03/10 12:28:54.70 kernel  [Handler pc: 0x0x0000000000bf6d40 aritherr installed by the following function:-]
02:00000:00338:2014/03/10 12:28:54.70 kernel  pc: 0x000000000193605a exec_lava+0x20a()
02:00000:00338:2014/03/10 12:28:54.70 kernel  pc: 0x0000000000c32633 s_execute+0x6573()
02:00000:00338:2014/03/10 12:28:54.70 kernel  [Handler pc: 0x0x0000000000c5f8a0 hdl_stack installed by the following function:-]
02:00000:00338:2014/03/10 12:28:54.70 kernel  [Handler pc: 0x0x0000000000c3e060 s_handle installed by the following function:-]
02:00000:00338:2014/03/10 12:28:54.70 kernel  pc: 0x00000000019619da sequencer+0x69a()
02:00000:00338:2014/03/10 12:28:54.70 kernel  pc: 0x00000000007602da tdsrecv_language+0xaa()
02:00000:00338:2014/03/10 12:28:54.70 kernel  [Handler pc: 0x0x0000000000ce7520 ut_handle installed by the following function:-]
02:00000:00338:2014/03/10 12:28:54.70 kernel  pc: 0x0000000001828946 conn_hdlr+0xa86()
02:00000:00338:2014/03/10 12:28:54.70 kernel  end of stack trace, spid 338, kpid 34079240, suid 1
02:00000:00338:2014/03/10 12:28:54.70 kernel  ueshutdown: exiting
00:00000:00000:2014/03/10 12:28:54.70 kernel  SySAM: Checked in license for 1 ASE_CORE (2013.03010/permanent/0C94 6187 B194 DF07).


还请哪位高手帮忙看看是什么原因导致的sybase自动停止，万分感谢！

jp_1129

'default data cache'?

mission_g

貌似是一个软件问题.
作为一个临时的解决方案,请尝试

use  zxuma
go

找出其中的table ( select name from sysobjects where type = 'U' )
, 执行 update statistics 命令

hope this helps, good luck !

andkylee

stack trace中出现了Spinlock，ase基于保护机制自动shutdown。
找原厂开case。

Eisen

15.0.3/EBF 17157 ESD#3啊，
这个version里面有问题，以前我也经常碰上这个错，升级到ESD4.3后不见了

zhaopingzi

@xietong007
这个问题解决了吗

xietong007

zhaopingzi 发表于 2014-03-19 13:11
@xietong007
这个问题解决了吗

这个问题还未没有解决，每天数据库自动down掉的时间都是在4：00-5:00之间，非常奇怪。

02:00000:00001:2014/03/18 07:04:59.14 server  Recovery has restored the original size for '64K' pool and '8K' pool in 'default data cache'.
02:00000:00001:2014/03/18 07:04:59.15 server  Recovery complete.
02:00000:00001:2014/03/18 07:04:59.15 server  ASE's default unicode sort order is 'binary'.
02:00000:00001:2014/03/18 07:04:59.15 server  ASE's default sort order is:
02:00000:00001:2014/03/18 07:04:59.15 server          'bin_utf8' (ID = 50)
02:00000:00001:2014/03/18 07:04:59.15 server  on top of default character set:
02:00000:00001:2014/03/18 07:04:59.15 server          'utf8' (ID = 190).
02:00000:00001:2014/03/18 07:04:59.15 server  Master device size: 4000 megabytes, or 2048000 virtual pages. (A virtual page is 2048 bytes.)
02:00000:00267:2014/03/19 04:02:30.92 kernel  Setting console to nonblocking mode.
02:00000:00267:2014/03/19 04:02:30.92 kernel  Current process (0xd900d9) infected with signal 11 (SIGSEGV)
02:00000:00267:2014/03/19 04:02:30.92 kernel  Address 0x0x0000000001974324 (kbfalloc+0x254), siginfo (code, address) = (1, 0x0x000000000000001
02:00000:00267:2014/03/19 04:02:30.92 kernel  Spinlocks held by  kpid 14221529
02:00000:00267:2014/03/19 04:02:30.92 kernel  Spinlock DATACHG_SPIN at address 0x0000000142bbb320 owned by 14221529
02:00000:00267:2014/03/19 04:02:30.92 kernel  End of spinlock display.
02:00000:00267:2014/03/19 04:02:30.92 kernel  pc: 0x0000000001689015 pcstkwalk+0x30()
02:00000:00267:2014/03/19 04:02:30.92 kernel  pc: 0x0000000001688e09 ucstkgentrace+0x199()
02:00000:00267:2014/03/19 04:02:30.92 kernel  pc: 0x000000000164143e ucbacktrace+0x40()
02:00000:00267:2014/03/19 04:02:30.92 kernel  pc: 0x000000000074fa90 terminate_process+0x1430()
02:00000:00267:2014/03/19 04:02:30.92 kernel  pc: 0x0000000001669215 kisignal+0x2f5()
02:00000:00267:2014/03/19 04:02:30.92 kernel  pc: 0x0000000001974324 kbfalloc+0x254()
02:00000:00267:2014/03/19 04:02:30.92 kernel  pc: 0x0000000000b6fcab ptn__pdes_init_colupdcnt+0x5b()
02:00000:00267:2014/03/19 04:02:30.92 kernel  pc: 0x0000000000b6d938 ptn_pdes_install+0x2a8()
02:00000:00267:2014/03/19 04:02:30.92 kernel  pc: 0x0000000000b6d5e2 ptn__pdes_install+0xc2()
02:00000:00267:2014/03/19 04:02:30.92 kernel  pc: 0x0000000000b6e338 ptn__pdes_init_fromrow+0x28()
02:00000:00267:2014/03/19 04:02:30.92 kernel  [Handler pc: 0x0x00000000013a2697 ptn_handler installed by the following function:-]
02:00000:00267:2014/03/19 04:02:30.92 kernel  pc: 0x0000000000b6e106 ptn_pdes_init+0x286()
02:00000:00267:2014/03/19 04:02:30.92 kernel  pc: 0x0000000000b64e98 ind__ides_init_fromrow+0x98()
02:00000:00267:2014/03/19 04:02:30.92 kernel  [Handler pc: 0x0x000000000139ec3c sysind_handler installed by the following function:-]
02:00000:00267:2014/03/19 04:02:30.92 kernel  pc: 0x0000000000b649bd ind_ides_init+0x79d()
02:00000:00267:2014/03/19 04:02:30.92 kernel  [Handler pc: 0x0x0000000001363690 des__errhdl installed by the following function:-]
02:00000:00267:2014/03/19 04:02:30.92 kernel  pc: 0x0000000000b2317c des__fill_common+0x27c()
02:00000:00267:2014/03/19 04:02:30.92 kernel  [Handler pc: 0x0x0000000001363690 des__errhdl installed by the following function:-]
02:00000:00267:2014/03/19 04:02:30.92 kernel  pc: 0x0000000000b2013f des(float, int, long, long)+0x2df()
02:00000:00267:2014/03/19 04:02:30.92 kernel  pc: 0x00000000018c0162 des_get+0x6c2()
02:00000:00267:2014/03/19 04:02:30.92 kernel  pc: 0x0000000001871f77 open__lookup+0x47()
02:00000:00267:2014/03/19 04:02:30.92 kernel  pc: 0x0000000001871aed open__byname+0xfd()
02:00000:00267:2014/03/19 04:02:30.92 kernel  pc: 0x000000000187143d open_user_table+0xfd()
02:00000:00267:2014/03/19 04:02:30.92 kernel  [Handler pc: 0x0x00000000015c7674 trunctaberr installed by the following function:-]
02:00000:00267:2014/03/19 04:02:30.92 kernel  pc: 0x0000000000ce53d1 trunctab+0x141()
02:00000:00267:2014/03/19 04:02:30.92 kernel  pc: 0x0000000000c2f837 s_execute+0x3777()
02:00000:00267:2014/03/19 04:02:30.92 kernel  [Handler pc: 0x0x0000000000c5f8a0 hdl_stack installed by the following function:-]
02:00000:00267:2014/03/19 04:02:30.92 kernel  [Handler pc: 0x0x0000000000c3e060 s_handle installed by the following function:-]
02:00000:00267:2014/03/19 04:02:30.92 kernel  pc: 0x0000000001961525 sequencer+0x1e5()
02:00000:00267:2014/03/19 04:02:30.92 kernel  pc: 0x0000000000c29047 execproc+0x687()
02:00000:00267:2014/03/19 04:02:30.92 kernel  [Handler pc: 0x0x0000000000c5f880 hdl_backout installed by the following function:-]
02:00000:00267:2014/03/19 04:02:30.92 kernel  pc: 0x0000000000c34754 s_execute+0x8694()
02:00000:00267:2014/03/19 04:02:30.92 kernel  [Handler pc: 0x0x0000000000c5f8a0 hdl_stack installed by the following function:-]
02:00000:00267:2014/03/19 04:02:30.92 kernel  [Handler pc: 0x0x0000000000c3e060 s_handle installed by the following function:-]
02:00000:00267:2014/03/19 04:02:30.92 kernel  pc: 0x0000000001961525 sequencer+0x1e5()
02:00000:00267:2014/03/19 04:02:30.92 kernel  pc: 0x0000000000c29047 execproc+0x687()
02:00000:00267:2014/03/19 04:02:30.92 kernel  pc: 0x0000000000c34754 s_execute+0x8694()
02:00000:00267:2014/03/19 04:02:30.92 kernel  [Handler pc: 0x0x0000000000c5f8a0 hdl_stack installed by the following function:-]
02:00000:00267:2014/03/19 04:02:30.92 kernel  [Handler pc: 0x0x0000000000c3e060 s_handle installed by the following function:-]
02:00000:00267:2014/03/19 04:02:30.92 kernel  pc: 0x00000000019619da sequencer+0x69a()
02:00000:00267:2014/03/19 04:02:30.92 kernel  pc: 0x00000000007602da tdsrecv_language+0xaa()
02:00000:00267:2014/03/19 04:02:30.92 kernel  [Handler pc: 0x0x0000000000ce7520 ut_handle installed by the following function:-]
02:00000:00267:2014/03/19 04:02:30.92 kernel  pc: 0x0000000001828946 conn_hdlr+0xa86()
02:00000:00267:2014/03/19 04:02:30.92 kernel  end of stack trace, spid 267, kpid 14221529, suid 10
02:00000:00267:2014/03/19 04:02:30.92 kernel  ueshutdown: exiting
00:00000:00000:2014/03/19 04:02:30.94 kernel  SySAM: Checked in license for 1 ASE_CORE (2013.03010/permanent/0C94 6187 B194 DF07).

xietong007

Eisen 发表于 2014-03-12 19:46
15.0.3/EBF 17157 ESD#3啊，
这个version里面有问题，以前我也经常碰上这个错，升级到ESD4.3后不见了

目前我们这台服务器基本上是每天凌晨4点多点就会自己down掉。 确认升级到ESD4.3就可以解决这个问题？   谢谢！

zhaopingzi

为什么这么有规律，在4-5点，在这个时间段里，数据库有什么操作吗？

xietong007

zhaopingzi 发表于 2014-03-19 14:26
为什么这么有规律，在4-5点，在这个时间段里，数据库有什么操作吗？

目前我们已经停掉了已知的4点左右的所有定时任务，但是还是在这个时间点附件，Sybase会自动down掉。

有没有什么办法捕捉或者跟踪到什么原因导致的这个down掉？