3CX Services suddenly stopped

[Nico Salonga]

Any assistance on our 3CX Server.

We received an email notification that the following services were stopped:

3CXCfgServ01 (astcavoip01.3cx.us)
3CXPhoneSystem01 (astcavoip01.3cx.us)

The 3CX Server runs with Debian OS. Is there any particular reason why the services suddenly stopped?

Please advise us on how we can restart the services since the 3CX Management Console cannot be accessed at the moment.

 

[mariosM_3CX]

Hello @Nico Salonga

There are many reasons as to why this could've happened so checking the logs might give you the answer.
As for starting the services, you'll need to connect with SSH to your machine and run this command /usr/sbin/3CXStartServices

 

[Nico Salonga]

Starting the services still failed. See result below:

root@AstcaVoip01:~# /usr/sbin/3CXStartServices
Created symlink from /etc/systemd/system/3CXHotelModule01.service to /lib/systemd/system/3CXHotelModule01.service.
Created symlink from /etc/systemd/system/multi-user.target.wants/3CXHotelModule01.service to /lib/systemd/system/3CXHotelModule01.service.
Job for 3CXHotelModule01.service failed. See 'systemctl status 3CXHotelModule01.service' and 'journalctl -xn' for details.
Job for 3CXQueueManager01.service failed. See 'systemctl status 3CXQueueManager01.service' and 'journalctl -xn' for details.
Job for 3CXPhoneSystemMC01.service failed. See 'systemctl status 3CXPhoneSystemMC01.service' and 'journalctl -xn' for details.
root@AstcaVoip01:~#
root@AstcaVoip01:~#
root@AstcaVoip01:~# systemctl status 3CXHotelModule01.service
● 3CXHotelModule01.service - 3CX PhoneSystem 01 Hotel Module
   Loaded: loaded (/lib/systemd/system/3CXHotelModule01.service; enabled)
   Active: failed (Result: core-dump) since Thu 2017-11-30 07:39:00 SST; 2min 37s ago
  Process: 26405 ExecStopPost=/bin/rm -f /var/run/phonesystem/3CXHotelModule01.pid (code=exited, status=0/SUCCESS)
  Process: 26359 ExecStart=/usr/lib/3cxpbx/HotelModule -p /var/run/phonesystem/3CXHotelModule01.pid (code=dumped, signal=ABRT)
 Main PID: 26359 (code=dumped, signal=ABRT)
Nov 30 07:39:00 AstcaVoip01 systemd[1]: 3CXHotelModule01.service: main process exited, code=dumped, status=6/ABRT
Nov 30 07:39:00 AstcaVoip01 systemd[1]: Failed to start 3CX PhoneSystem 01 Hotel Module.
Nov 30 07:39:00 AstcaVoip01 systemd[1]: Unit 3CXHotelModule01.service entered failed state.
root@AstcaVoip01:~#
root@AstcaVoip01:~# journalctl -xn
-- Logs begin at Wed 2017-11-29 23:31:54 SST, end at Thu 2017-11-30 07:42:31 SST. --
Nov 30 07:42:23 AstcaVoip01 kernel: iptables[DOS]: IN=eth0 OUT= MAC=98:4b:e1:64:67:54:f0:f7:55:bd:c3:c0:08:00 SRC=185.216.140.43 DST=206.80.28.14 LEN=40 TOS=0x00 PREC=0x00 TTL=235 ID=103
Nov 30 07:42:24 AstcaVoip01 kernel: iptables[DOS]: IN=eth0 OUT= MAC=98:4b:e1:64:67:54:f0:f7:55:bd:c3:c0:08:00 SRC=185.216.140.43 DST=206.80.28.14 LEN=40 TOS=0x00 PREC=0x00 TTL=235 ID=139
Nov 30 07:42:24 AstcaVoip01 kernel: iptables[DOS]: IN=eth0 OUT= MAC=98:4b:e1:64:67:54:f0:f7:55:bd:c3:c0:08:00 SRC=185.216.140.43 DST=206.80.28.14 LEN=40 TOS=0x00 PREC=0x00 TTL=235 ID=182
Nov 30 07:42:26 AstcaVoip01 kernel: iptables[DOS]: IN=eth0 OUT= MAC=98:4b:e1:64:67:54:f0:f7:55:bd:c3:c0:08:00 SRC=185.216.140.43 DST=206.80.28.14 LEN=40 TOS=0x00 PREC=0x00 TTL=235 ID=297
Nov 30 07:42:26 AstcaVoip01 kernel: iptables[DOS]: IN=eth0 OUT= MAC=98:4b:e1:64:67:54:f0:f7:55:bd:c3:c0:08:00 SRC=185.216.140.43 DST=206.80.28.14 LEN=40 TOS=0x00 PREC=0x00 TTL=235 ID=537
Nov 30 07:42:28 AstcaVoip01 kernel: iptables[DOS]: IN=eth0 OUT= MAC=98:4b:e1:64:67:54:f0:f7:55:bd:c3:c0:08:00 SRC=185.216.140.43 DST=206.80.28.14 LEN=40 TOS=0x00 PREC=0x00 TTL=235 ID=318
Nov 30 07:42:29 AstcaVoip01 kernel: iptables[DOS]: IN=eth0 OUT= MAC=98:4b:e1:64:67:54:f0:f7:55:bd:c3:c0:08:00 SRC=185.216.140.43 DST=206.80.28.14 LEN=40 TOS=0x00 PREC=0x00 TTL=235 ID=351
Nov 30 07:42:30 AstcaVoip01 kernel: iptables[DOS]: IN=eth0 OUT= MAC=98:4b:e1:64:67:54:f0:f7:55:bd:c3:c0:08:00 SRC=185.216.140.43 DST=206.80.28.14 LEN=40 TOS=0x00 PREC=0x00 TTL=235 ID=417
Nov 30 07:42:31 AstcaVoip01 kernel: iptables[DOS]: IN=eth0 OUT= MAC=98:4b:e1:64:67:54:f0:f7:55:bd:c3:c0:08:00 SRC=185.216.140.43 DST=206.80.28.14 LEN=40 TOS=0x00 PREC=0x00 TTL=235 ID=108
Nov 30 07:42:31 AstcaVoip01 kernel: iptables[DOS]: IN=eth0 OUT= MAC=98:4b:e1:64:67:54:f0:f7:55:bd:c3:c0:08:00 SRC=185.216.140.43 DST=206.80.28.14 LEN=40 TOS=0x00 PREC=0x00 TTL=235 ID=412
root@AstcaVoip01:~#
root@AstcaVoip01:~#
root@AstcaVoip01:~# systemctl status 3CXQueueManager01.service
● 3CXQueueManager01.service - 3CX PhoneSystem 01 Queue Manager Server
   Loaded: loaded (/lib/systemd/system/3CXQueueManager01.service; enabled)
   Active: failed (Result: core-dump) since Thu 2017-11-30 07:39:31 SST; 4min 56s ago
  Process: 26614 ExecStopPost=/bin/rm -f /var/run/phonesystem/3CXQueueManager01.pid (code=exited, status=0/SUCCESS)
  Process: 26586 ExecStart=/usr/lib/3cxpbx/TcxQMsrv -p /var/run/phonesystem/3CXQueueManager01.pid /var/lib/3cxpbx/Instance1/Bin/config.json (code=dumped, signal=ABRT)
 Main PID: 26586 (code=dumped, signal=ABRT)
Nov 30 07:39:31 AstcaVoip01 systemd[1]: 3CXQueueManager01.service: main process exited, code=dumped, status=6/ABRT
Nov 30 07:39:31 AstcaVoip01 systemd[1]: Failed to start 3CX PhoneSystem 01 Queue Manager Server.
Nov 30 07:39:31 AstcaVoip01 systemd[1]: Unit 3CXQueueManager01.service entered failed state.
root@AstcaVoip01:~# systemctl status 3CXPhoneSystemMC01.service
● 3CXPhoneSystemMC01.service - 3CX PhoneSystem 01 Management Console
   Loaded: loaded (/lib/systemd/system/3CXPhoneSystemMC01.service; enabled)
   Active: failed (Result: timeout) since Thu 2017-11-30 07:40:59 SST; 3min 52s ago
  Process: 26356 ExecStart=/usr/lib/3cxpbx/ManagementConsoleJS --pid /var/run/phonesystem/3CXPhoneSystemMC01.pid -p /var/lib/3cxpbx/Instance1/Data/Http/webroot (code=killed, signal=INT)
 Main PID: 26356 (code=killed, signal=INT)
Nov 30 07:38:59 AstcaVoip01 systemd[1]: Starting 3CX PhoneSystem 01 Management Console...
Nov 30 07:40:59 AstcaVoip01 systemd[1]: 3CXPhoneSystemMC01.service start operation timed out. Terminating.
Nov 30 07:40:59 AstcaVoip01 systemd[1]: Failed to start 3CX PhoneSystem 01 Management Console.
Nov 30 07:40:59 AstcaVoip01 systemd[1]: Unit 3CXPhoneSystemMC01.service entered failed state.
root@AstcaVoip01:~#

 

[NickD_3CX]

Apart from these 3 services could you please check if some other one is also stopped? You could use the command systemctl status 3CX* to check.

Also, even though you can't log into the Management Console, do the calls still work?