EsgynDB Troubleshooting-*** ERROR[8837] Internal error occurred.

現象

trafci或JDBC鏈接數據庫忽然出現卡頓的現象，卡頓以後報錯*** ERROR[8837] Internal error occurred.，

[trafodion@uatzf04 scripts]$ trafci

Welcome to QianBase Command Interface 
Copyright (c) 2015-2019 Esgyn Corporation

Host Name/IP Address: uatzf01:23400,uatzf02:23400,uatzf03:23400
User Name: trafodion

*** ERROR[8837] Internal error occurred. User: TRAFODION  [2019-07-29 16:31:35]

分析

*** ERROR[8837] Internal error occurred.判斷多是數據庫與LDAP鏈接出現了問題，使用ldapcheck --username=trafodion檢查是否成功，發現一樣出現卡頓的現象。所以判斷就是與LDAP鏈接出現了問題。

[trafodion@uatzf04 scripts]$ ldapcheck --username=trafodion
Lookup request: externalName trafodion, configName 'not available' (configNumber -2), result 2 (Unexpected error returned from LDAP)

檢查slapd服務狀態，

[root@uatzf01 ~]# service slapd status
Redirecting to /bin/systemctl status slapd.service
● slapd.service - OpenLDAP Server Daemon
   Loaded: loaded (/usr/lib/systemd/system/slapd.service; enabled; vendor preset: disabled)
   Active: active (running) since Wed 2019-07-24 09:17:12 CST; 5 days ago
     Docs: man:slapd
           man:slapd-config
           man:slapd-hdb
           man:slapd-mdb
           file:///usr/share/doc/openldap-servers/guide.html
 Main PID: 42947 (slapd)
   CGroup: /system.slice/slapd.service
           └─42947 /usr/sbin/slapd -u ldap -h ldapi:/// ldap:///

Jul 29 16:16:37 uatzf01.esgyn.cn slapd[42947]: warning: cannot open /etc/hosts.allow: Too many open files
Jul 29 16:16:37 uatzf01.esgyn.cn slapd[42947]: warning: cannot open /etc/hosts.deny: Too many open files
Jul 29 16:16:37 uatzf01.esgyn.cn slapd[42947]: fd=1023 DENIED from unknown (172.31.234.13)
Jul 29 16:16:41 uatzf01.esgyn.cn slapd[42947]: warning: cannot open /etc/hosts.allow: Too many open files
Jul 29 16:16:41 uatzf01.esgyn.cn slapd[42947]: warning: cannot open /etc/hosts.deny: Too many open files
Jul 29 16:16:41 uatzf01.esgyn.cn slapd[42947]: fd=1023 DENIED from unknown (172.31.234.12)
Jul 29 16:16:42 uatzf01.esgyn.cn slapd[42947]: warning: cannot open /etc/hosts.allow: Too many open files
Jul 29 16:16:42 uatzf01.esgyn.cn slapd[42947]: daemon: accept(8) failed errno=24 (Too many open files)
Jul 29 16:16:42 uatzf01.esgyn.cn slapd[42947]: warning: cannot open /etc/hosts.deny: Too many open files
Jul 29 16:16:42 uatzf01.esgyn.cn slapd[42947]: fd=1023 DENIED from unknown (172.31.234.11)

咱們能夠看到「Too many open files」之類的錯誤，說明ldap用戶的max open file已經達到上限。

解決

解決方案如博客Linux OpenLAP 修改max open files