Solved The dreaded "server error" in web GUI (debian - self hosted)

Status
Not open for further replies.

A.Takacs

Bronze Partner
Joined
Apr 20, 2020
Messages
115
Reaction score
10
Hello

I have the apparently relative common "server error" when trying to my 3cx admin console.
This a a recent self hosted deployment based on Debian (up to date, both 3cx and OS). Users don’t seem to be impacted but no way to connect to the admin console.
All services are listed as running (from SSH).
Is there a standard check list to follow in such cases ?

As an aside may I suggest that the error message is made more detailed - server error does not help…
 
For starters, please provide the information mentioned here to allow us to have a better understanding of your setup: https://www.3cx.com/community/threads/information-to-provide-when-requesting-help.67558/

Also, was this machine deployed using the 3CX ISO?

Regarding the services, in total you must have at least 11 3CX services running:

3CXAudioProvider01.service
3CXCallFlow01.service
3CXCfgServ01.service
3CXEventNotificationManager.service
3CXIVR01.service
3CXMediaServer.service
3CXPhoneSystem01.service
3CXPhoneSystemMC01.service
3CXQueueManager01.service
3CXSystemService01.service
3CXTunnel01.service

plus the nginx and postgresql service.

Please confirm that all these are running. You may want to also consider rebooting the whole machine. I highly recommend doing this during out of office hours to avoid downtime or during a time the PBX is not in use.
 
Ok, here we go (although I believe I already provided all the relevant info, this is not an SBC issue...)

  • 3CX Version, Standard Annual 16.0.8.9
  • Server OS, Debian 9
  • Is the 3CX Server Hosted and where? self hosted dedicated i5 PC
  • IP Phone Make/Model/Firmware Yealink T-4x serie
  • Provisioning Method: Local / VPN / STUN / SBC Local
  • Trunk Provider or Gateway Make/Model Direct SIP trunk
  • Has the Firewall Checker passed: YES
  • Are custom Phone Templates being used: NO
As for the services, having rebooted the server

Code:
root@3cxadmin:~# service --status-all
[ - ]  console-setup.sh
[ + ]  cron
[ + ]  dbus
[ - ]  hwclock.sh
[ - ]  keyboard-setup.sh
[ + ]  kmod
[ - ]  networking
[ + ]  nginx
[ + ]  postgresql
[ + ]  procps
[ - ]  rsync
[ + ]  rsyslog
[ + ]  ssh
[ - ]  sudo
[ + ]  sysstat
[ + ]  udev
[ + ]  unattended-upgrades
root@3cxadmin:~# service 3CX* status
● 3CXTunnel01.service - 3CX PhoneSystem 01 SIP/RTP Tunneling Proxy
   Loaded: loaded (/lib/systemd/system/3CXTunnel01.service; enabled; vendor preset: enabled)
   Active: active (running) since Mon 2021-04-12 15:55:08 CEST; 2h 6min ago
Main PID: 412 (3CXTunnel)
    Tasks: 14 (limit: 4915)
   CGroup: /system.slice/3CXTunnel01.service
           └─412 /usr/sbin/3CXTunnel -n -p /var/run/phonesystem/3CXTunnel01.pid -c /var/lib/3cxpbx/B
in/3CXPhoneSystem.ini

avr 12 15:55:08 3cxadmin systemd[1]: Starting 3CX PhoneSystem 01 SIP/RTP Tunneling Proxy...
avr 12 15:55:08 3cxadmin systemd[1]: Started 3CX PhoneSystem 01 SIP/RTP Tunneling Proxy.

● 3CXIVR01.service - 3CX PhoneSystem 01 IVR Server
   Loaded: loaded (/lib/systemd/system/3CXIVR01.service; enabled; vendor preset: enabled)
   Active: active (running) since Mon 2021-04-12 15:55:12 CEST; 2h 6min ago
Main PID: 604 (3CXIVR)
    Tasks: 14 (limit: 4915)
   CGroup: /system.slice/3CXIVR01.service
           └─604 /usr/sbin/3CXIVR -n -p /var/run/phonesystem/3CXIVR01.pid -c /var/lib/3cxpbx/Bin/3CX
PhoneSystem.ini

avr 12 15:55:11 3cxadmin systemd[1]: Starting 3CX PhoneSystem 01 IVR Server...
avr 12 15:55:12 3cxadmin systemd[1]: Started 3CX PhoneSystem 01 IVR Server.

● 3CXSystemService01.service - 3CX PhoneSystem 01 System Server
   Loaded: loaded (/lib/systemd/system/3CXSystemService01.service; enabled; vendor preset: enabled)
   Active: active (running) since Mon 2021-04-12 15:55:13 CEST; 2h 6min ago
Main PID: 544 (3cxSystemServic)
    Tasks: 38 (limit: 4915)
   CGroup: /system.slice/3CXSystemService01.service
           └─544 /usr/lib/3cxpbx/3cxSystemService -p /var/run/phonesystem/3CXSystemService01.pid /va
r/lib/3cxpbx/Bin

avr 12 15:55:11 3cxadmin systemd[1]: Starting 3CX PhoneSystem 01 System Server...
avr 12 15:55:13 3cxadmin systemd[1]: Started 3CX PhoneSystem 01 System Server.

● 3CXMediaServer.service - 3CX PhoneSystem Media Server
   Loaded: loaded (/lib/systemd/system/3CXMediaServer.service; enabled; vendor preset: enabled)
   Active: active (running) since Mon 2021-04-12 15:55:08 CEST; 2h 6min ago
Main PID: 405 (3CXMediaServer)
    Tasks: 17 (limit: 4915)
   CGroup: /system.slice/3CXMediaServer.service
           └─405 /usr/sbin/3CXMediaServer -n -p /var/run/phonesystem/3CXMediaServer.pid -c /var/lib/
3cxpbx/Bin/3CXPhoneSystem.ini -m /var/lib/3cxpbx/Bin/3cxmediaserver.ini

avr 12 15:55:08 3cxadmin systemd[1]: Starting 3CX PhoneSystem Media Server...
avr 12 15:55:08 3cxadmin systemd[1]: Started 3CX PhoneSystem Media Server.

● 3CXCfgServ01.service - 3CX PhoneSystem Configuration Service
   Loaded: loaded (/lib/systemd/system/3CXCfgServ01.service; enabled; vendor preset: enabled)
   Active: active (running) since Mon 2021-04-12 15:55:11 CEST; 2h 6min ago
Main PID: 533 (3CXSLDBServ)
    Tasks: 19 (limit: 4915)
   CGroup: /system.slice/3CXCfgServ01.service
           └─533 /usr/sbin/3CXSLDBServ -n -p /var/run/phonesystem/3CXCfgServ01.pid -o /var/lib/3cxpb
x/Bin/Objects.cls -c /var/lib/3cxpbx/Bin/3CXPhoneSystem.ini

avr 12 15:55:10 3cxadmin systemd[1]: Starting 3CX PhoneSystem Configuration Service...
avr 12 15:55:11 3cxadmin systemd[1]: Started 3CX PhoneSystem Configuration Service.

● 3CXPhoneSystem01.service - 3CX PhoneSystem 01 SIP Server
   Loaded: loaded (/lib/systemd/system/3CXPhoneSystem01.service; enabled; vendor preset: enabled)
   Active: active (running) since Mon 2021-04-12 15:55:11 CEST; 2h 6min ago
Main PID: 546 (3CXPhoneSystem)
    Tasks: 28 (limit: 4915)
   CGroup: /system.slice/3CXPhoneSystem01.service
           └─546 /usr/sbin/3CXPhoneSystem -p /var/run/phonesystem/3CXPhoneSystem01.pid /var/lib/3cxp
bx/Bin/3CXPhoneSystem.ini

avr 12 15:55:11 3cxadmin systemd[1]: Starting 3CX PhoneSystem 01 SIP Server...
avr 12 15:55:11 3cxadmin systemd[1]: Started 3CX PhoneSystem 01 SIP Server.

● 3CXQueueManager01.service - 3CX PhoneSystem 01 Queue Manager Server
   Loaded: loaded (/lib/systemd/system/3CXQueueManager01.service; enabled; vendor preset: enabled)
   Active: active (running) since Mon 2021-04-12 15:55:14 CEST; 2h 6min ago
Main PID: 600 (TcxQMsrv)
    Tasks: 22 (limit: 4915)
   CGroup: /system.slice/3CXQueueManager01.service
           └─600 /usr/lib/3cxpbx/TcxQMsrv -p /var/run/phonesystem/3CXQueueManager01.pid /var/lib/3cx
pbx/Bin/config.json

avr 12 15:55:11 3cxadmin systemd[1]: Starting 3CX PhoneSystem 01 Queue Manager Server...
avr 12 15:55:14 3cxadmin systemd[1]: Started 3CX PhoneSystem 01 Queue Manager Server.

● 3CXCallFlow01.service - 3CX PhoneSystem 01 CallFlow Server
   Loaded: loaded (/lib/systemd/system/3CXCallFlow01.service; enabled; vendor preset: enabled)
   Active: active (running) since Mon 2021-04-12 15:55:14 CEST; 2h 6min ago
Main PID: 603 (3CXCallFlow)
    Tasks: 17 (limit: 4915)
   CGroup: /system.slice/3CXCallFlow01.service
           └─603 /usr/lib/3cxpbx/3CXCallFlow -p /var/run/phonesystem/3CXCallFlow01.pid /var/lib/3cxp
bx/Bin/config.json

avr 12 15:55:11 3cxadmin systemd[1]: Starting 3CX PhoneSystem 01 CallFlow Server...
avr 12 15:55:14 3cxadmin systemd[1]: Started 3CX PhoneSystem 01 CallFlow Server.

● 3CXPhoneSystemMC01.service - 3CX PhoneSystem 01 Management Console
   Loaded: loaded (/lib/systemd/system/3CXPhoneSystemMC01.service; enabled; vendor preset: enabled)
   Active: active (running) since Mon 2021-04-12 15:55:17 CEST; 2h 6min ago
Main PID: 543 (3CXManagementCo)
    Tasks: 43 (limit: 4915)
   CGroup: /system.slice/3CXPhoneSystemMC01.service
           └─543 /usr/lib/3cxpbx/3CXManagementConsole --pid /var/run/phonesystem/3CXPhoneSystemMC01.
pid -p /var/lib/3cxpbx/Instance1/Data/Http/webroot

avr 12 15:55:11 3cxadmin systemd[1]: Starting 3CX PhoneSystem 01 Management Console...
avr 12 15:55:17 3cxadmin systemd[1]: Started 3CX PhoneSystem 01 Management Console.
avr 12 16:35:10 3cxadmin sudo[1428]: phonesystem : TTY=unknown ; PWD=/var/lib/3cxpbx ; USER=
root ; COMMAND=/usr/sbin/3CXPinningFileUpdate https://downloads-eu.3cx.com/downloads/v160/debianupda
te/stretch.txt
avr 12 16:35:10 3cxadmin sudo[1428]: pam_unix(sudo:session): session opened for user root by (uid=0)

● 3CXAudioProvider01.service - 3CX PhoneSystem 01 Audio Provider Server
   Loaded: loaded (/lib/systemd/system/3CXAudioProvider01.service; enabled; vendor preset: enabled)
   Active: active (running) since Mon 2021-04-12 15:55:11 CEST; 2h 6min ago
Main PID: 545 (3CXAudioProvide)
    Tasks: 6 (limit: 4915)
   CGroup: /system.slice/3CXAudioProvider01.service
           └─545 /usr/sbin/3CXAudioProvider -n -p /var/run/phonesystem/3CXAudioProvider01.pid -c /va
r/lib/3cxpbx/Bin/3CXPhoneSystem.ini

avr 12 15:55:11 3cxadmin systemd[1]: Starting 3CX PhoneSystem 01 Audio Provider Server...
avr 12 15:55:11 3cxadmin systemd[1]: Started 3CX PhoneSystem 01 Audio Provider Server.

● 3CXEventNotificationManager.service - 3CX Event Notification Manager
   Loaded: loaded (/lib/systemd/system/3CXEventNotificationManager.service; enabled; vendor preset:
enabled)
   Active: active (running) since Mon 2021-04-12 15:55:09 CEST; 2h 6min ago
Main PID: 411 (CloudServicesWa)
    Tasks: 25 (limit: 4915)
   CGroup: /system.slice/3CXEventNotificationManager.service
           └─411 /usr/lib/3cxpbx/CloudServicesWatcher -p /var/run/phonesystem/3CXEventNotificationMa
nager.pid -c /var/lib/3cxpbx/Bin/CloudServicesWatcher.exe.config

avr 12 15:55:08 3cxadmin systemd[1]: Starting 3CX Event Notification Manager...
avr 12 15:55:09 3cxadmin systemd[1]: Started 3CX Event Notification Manager.[CODE]
 
Last edited:
Actually, I don't believe you've clearly stated whether you deployed from the 3CX ISO or not. You simply stated that 3CX and the OS was up to date. Updating the OS by any means other than letting 3CX handle it can lead to issues.
 
Aha - you have a point here.

That being said any suggestion for the case at hand ?
 
Since you've already restarted the server and that didn't resolve, the 3CX recommended path would be to copy a backup off the machine, reinstall the from the ISO and restore.
 
  • Like
Reactions: ChrisC_3CX
Done
Back online...

Still I think a more detailed error message would be usefull,
 
  • Like
Reactions: ChrisC_3CX
@A.Takacs
Glad to hear you got this resolved, I'll be closing this thread.
 
Status
Not open for further replies.

Forum statistics

Threads
111,974
Messages
590,081
Members
164,899
Latest member
mazet