Service crashes on Debian 8.6 - 3CX version 15.5.1694

[Oliver_B]

Hey.

Can I get some support for Debian?

I am having issues with the 8.6 Debian Image.

I tried to post on my own thread and got no response?

I am running 3CX linux on Debian 8.6 with the latest release 15.5.1694.

It is running on Hyper-V 2012 Gen 1 as a virtual.

I am receiving regular SIP service crashes and requires me restarting the service manually.

Any one else having this problem?

Here are the log details:

Jul 4 16:24:38 WestRec-3CX kernel: [18445.496419] 3CXPhoneSystem[1685]: segfault at 100000029 ip 00007f7b1690ee20 sp 00007f7 b027f55e0 error 4 in libdum-1.10.so[7f7b1685d000+13c000]

 

[nb]

A) Now here you should have a dump send it to me /var/lib/3cxpbx . In the meantime until I check your dump you do B or C
B) can you try on a standard virtual box for example? Eliminate the hyper V or on a cloud instance?
C) Can you make ANOTHER debian image on the same hyper v? Does it crash? Like this you rule out the hyper v and if it crashes, when we need to dig deeper but if it does not crash on the second one, then we have a problem on the host.

 

[Oliver_B]

A) Now here you should have a dump send it to me /var/lib/3cxpbx . In the meantime until I check your dump you do B or C
B) can you try on a standard virtual box for example? Eliminate the hyper V or on a cloud instance?
C) Can you make ANOTHER debian image on the same hyper v? Does it crash? Like this you rule out the hyper v and if it crashes, when we need to dig deeper but if it does not crash on the second one, then we have a problem on the host.

Ok thanks

Let try the B and C and i will provide the logs for you.

Thanks

Note: Also can generation 1 Hyper-V machines be an issue?

 

[nb]

I doubt the generation of hyper v machines can be an issue. But SIP Server is crashing. Sip server is a network service so it depends 100% on network. If you have a stack that is problematic or the hypervisor is not configured correctly, the guest suffers and the sip server will act like this.
However in this case, I would like to change my analysis here.

libdum-1.10.so is a library which is used deep inside the core of the sip engine. It is at the top layers of the core and this is responsible to build the internal structure of how the dialogs should be sent / built. It calls DUM thread - Dialog usage manager and it is this guy that creates and builds the sip packets in a nutshell.

Get me that core dump. Maybe we can see something from it. I think a call or a specific type of call or a race condition is causing the server to crash.

 

[Oliver_B]

I doubt the generation of hyper v machines can be an issue. But SIP Server is crashing. Sip server is a network service so it depends 100% on network. If you have a stack that is problematic or the hypervisor is not configured correctly, the guest suffers and the sip server will act like this.
However in this case, I would like to change my analysis here.

libdum-1.10.so is a library which is used deep inside the core of the sip engine. It is at the top layers of the core and this is responsible to build the internal structure of how the dialogs should be sent / built. It calls DUM thread - Dialog usage manager and it is this guy that creates and builds the sip packets in a nutshell.

Get me that core dump. Maybe we can see something from it. I think a call or a specific type of call or a race condition is causing the server to crash.

Hello here is the log dump for the crash just moments ago.

Jul 6 06:25:02 WestRec-3CX rsyslogd: [origin software="rsyslogd" swVersion="8.4.2" x-pid="455" x-info="http://www.rsyslog.com"] rsyslogd was HUPed

Jul 6 07:17:01 WestRec-3CX CRON[59608]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)

Jul 6 08:17:01 WestRec-3CX CRON[61028]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)

Jul 6 09:17:01 WestRec-3CX CRON[62513]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)

Jul 6 10:17:02 WestRec-3CX CRON[63982]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)

Jul 6 11:17:01 WestRec-3CX CRON[65407]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)

Jul 6 11:33:17 WestRec-3CX systemd[1]: Starting Cleanup of Temporary Directories...

Jul 6 11:33:17 WestRec-3CX systemd[1]: Started Cleanup of Temporary Directories.

Jul 6 12:17:01 WestRec-3CX CRON[1778]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)

Jul 6 13:17:01 WestRec-3CX CRON[3233]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)

Jul 6 13:44:56 WestRec-3CX kernel: [181663.818896] iptables[DOS]: IN=eth0 OUT= MAC=00:15:5d:03:1c:05:ac:5f:3e:a6:91:5c:08:00 SRC=192.168.4.20 DST=192.168.4.3 LEN=60 TOS=0x00 PREC=0x00 TTL=64 ID=63942 DF PROTO=TCP SPT=45427 DPT=7 WINDOW=65535 RES=0x00 SYN URGP=0

Jul 6 13:44:57 WestRec-3CX kernel: [181664.818029] iptables[DOS]: IN=eth0 OUT= MAC=00:15:5d:03:1c:05:ac:5f:3e:a6:91:5c:08:00 SRC=192.168.4.20 DST=192.168.4.3 LEN=60 TOS=0x00 PREC=0x00 TTL=64 ID=63943 DF PROTO=TCP SPT=45427 DPT=7 WINDOW=65535 RES=0x00 SYN URGP=0

Jul 6 14:17:01 WestRec-3CX CRON[4742]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)

Jul 6 15:17:01 WestRec-3CX CRON[6200]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)

Jul 6 16:17:01 WestRec-3CX CRON[7691]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)

Jul 6 16:53:38 WestRec-3CX kernel: [192985.460953] traps: 3CXPhoneSystem[8322] general protection ip:7fb87d3b7e20 sp:7fb8713e5530 error:0 in libdum-1.10.so[7fb87d306000+13c000]

Jul 6 16:53:38 WestRec-3CX systemd[1]: 3CXPhoneSystem01.service: main process exited, code=killed, status=11/SEGV

Jul 6 16:53:38 WestRec-3CX systemd[1]: Unit 3CXPhoneSystem01.service entered failed state.

Jul 6 17:00:26 WestRec-3CX systemd[1]: Starting 3CX PhoneSystem 01 SIP Server...

Jul 6 17:00:26 WestRec-3CX systemd[1]: Started 3CX PhoneSystem 01 SIP Server.

 

[nb]

You need to send the whole file not the lines you think are important.

 

[Aristotle Reyes]

Hi Nicky,

Which file do you need? Apparently this is the last thread for the syslog. Let me know which one and I will attach it here.

 

[nb]

What do you have in /var/lib/3cxpbx?
Send me screenshot.

 

[Aristotle Reyes]

Here is the content:

total 13188
4 drwxr-xr-x 7 phonesystem phonesystem 4096 Jul 6 16:53 .
4 drwxr-xr-x 30 root root 4096 Jun 25 23:37 ..
4 drwxr-xr-x 3 phonesystem phonesystem 4096 Jun 26 00:02 .aspnet
4 drwxr-xr-x 5 phonesystem phonesystem 4096 Jun 26 00:05 Bin
13160 -rw------- 1 phonesystem phonesystem 177860608 Jul 6 16:53 core
4 drwxr-xr-x 6 phonesystem phonesystem 4096 Jun 26 00:03 Data
4 drwxr-xr-x 3 phonesystem phonesystem 4096 Jun 26 00:06 .dotnet
4 drwxr-xr-x 4 phonesystem phonesystem 4096 Jun 25 23:36 Instance1