3CX on Linux - 'Server error' on Console

Discussion in '3CX Phone System - General' started by ANJOTI, Mar 22, 2018.

Thread Status:
Not open for further replies.
  1. ANJOTI

    Joined:
    Mar 16, 2018
    Messages:
    55
    Likes Received:
    0
    Hi,

    today I was try to dial and the Windows dialler shows a msg like 'server error', after tries to connect to console, shows a red message 'server error'.

    Since its a GCloud Linux, connecting througt SSH and running the command 'service 3CX* status' show only one service '3CXPhoneSystemMC01.service' as down.

    >>> How to fix it?
    >>> There is a way to debug what happened?
    >>> There is a way to self-restart when that happens


    Code:
    ● 3CXPhoneSystem01.service - 3CX PhoneSystem 01 SIP Server
       Loaded: loaded (/lib/systemd/system/3CXPhoneSystem01.service; enabled; vendor preset: enabled)
       Active: active (running) since Fri 2018-03-16 12:08:59 -03; 5 days ago
      Process: 20119 ExecStopPost=/bin/rm -f /var/run/phonesystem/3CXPhoneSystem01.pid (code=exited, status=0/SUCCESS)
     Main PID: 20135 (3CXPhoneSystem)
        Tasks: 18 (limit: 4915)
       CGroup: /system.slice/3CXPhoneSystem01.service
               └─20135 /usr/sbin/3CXPhoneSystem -p /var/run/phonesystem/3CXPhoneSystem01.pid /var/lib/3cxpbx/Instance1/
    Bin/3CXPhoneSystem.ini
    Warning: Journal has been rotated since unit was started. Log output is incomplete or unavailable.
    ● 3CXIVR01.service - 3CX PhoneSystem 01 IVR Server
       Loaded: loaded (/lib/systemd/system/3CXIVR01.service; enabled; vendor preset: enabled)
       Active: active (running) since Fri 2018-03-16 12:09:00 -03; 5 days ago
      Process: 20113 ExecStopPost=/bin/rm -f /var/run/phonesystem/3CXIVR01.pid (code=exited, status=0/SUCCESS)
     Main PID: 20154 (3CXIVR)
        Tasks: 15 (limit: 4915)
       CGroup: /system.slice/3CXIVR01.service
               └─20154 /usr/sbin/3CXIVR -n -p /var/run/phonesystem/3CXIVR01.pid -c /var/lib/3cxpbx/Instance1/Bin/3CXPho
    neSystem.ini
    Warning: Journal has been rotated since unit was started. Log output is incomplete or unavailable.
    ● 3CXSystemService01.service - 3CX PhoneSystem 01 System Server
       Loaded: loaded (/lib/systemd/system/3CXSystemService01.service; enabled; vendor preset: enabled)
       Active: active (running) since Fri 2018-03-09 16:52:09 -03; 1 weeks 5 days ago
     Main PID: 804 (3cxSystemServic)
        Tasks: 26 (limit: 4915)
       CGroup: /system.slice/3CXSystemService01.service
               └─804 /usr/lib/3cxpbx/3cxSystemService -p /var/run/phonesystem/3CXSystemService01.pid /var/lib/3cxpbx/In
    stance1/Bin
    
    Warning: Journal has been rotated since unit was started. Log output is incomplete or unavailable.
    
    ● 3CXTunnel01.service - 3CX PhoneSystem 01 SIP/RTP Tunneling Proxy
       Loaded: loaded (/lib/systemd/system/3CXTunnel01.service; enabled; vendor preset: enabled)
       Active: active (running) since Fri 2018-03-16 12:09:02 -03; 5 days ago
      Process: 20182 ExecStopPost=/bin/rm -f /var/run/phonesystem/3CXTunnel01.pid (code=exited, status=0/SUCCESS)
     Main PID: 20197 (3CXTunnel)
        Tasks: 14 (limit: 4915)
       CGroup: /system.slice/3CXTunnel01.service
               └─20197 /usr/sbin/3CXTunnel -n -p /var/run/phonesystem/3CXTunnel01.pid -c /var/lib/3cxpbx/Instance1/Bin/
    3CXPhoneSystem.ini
    
    Warning: Journal has been rotated since unit was started. Log output is incomplete or unavailable.
    
    ● 3CXPhoneSystemMC01.service - 3CX PhoneSystem 01 Management Console
       Loaded: loaded (/lib/systemd/system/3CXPhoneSystemMC01.service; enabled; vendor preset: enabled)
       Active: failed (Result: signal) since Sat 2018-03-17 20:53:19 -03; 4 days ago
      Process: 9212 ExecStopPost=/bin/rm -f /var/run/phonesystem/management_console01.socket (code=exited, status=0/SUC
    CESS)
      Process: 9168 ExecStopPost=/bin/rm -f /var/run/phonesystem/3CXPhoneSystemMC01.pid (code=exited, status=0/SUCCESS)
     Main PID: 806 (code=killed, signal=KILL)
    
    Warning: Journal has been rotated since unit was started. Log output is incomplete or unavailable.
    
    ● 3CXEventNotificationManager.service - 3CX Event Notification Manager
       Loaded: loaded (/lib/systemd/system/3CXEventNotificationManager.service; enabled; vendor preset: enabled)
       Active: active (running) since Fri 2018-03-09 16:52:07 -03; 1 weeks 5 days ago
     Main PID: 462 (CloudServicesWa)
        Tasks: 20 (limit: 4915)
       CGroup: /system.slice/3CXEventNotificationManager.service
               └─462 /usr/lib/3cxpbx/CloudServicesWatcher -p /var/run/phonesystem/3CXEventNotificationManager.pid -c /v
    ar/lib/3cxpbx/Bin/CloudServicesWatcher.exe.config
    
    Warning: Journal has been rotated since unit was started. Log output is incomplete or unavailable.
    
    ● 3CXCfgServ01.service - 3CX PhoneSystem Configuration Service
       Loaded: loaded (/lib/systemd/system/3CXCfgServ01.service; enabled; vendor preset: enabled)
       Active: active (running) since Fri 2018-03-09 16:52:08 -03; 1 weeks 5 days ago
     Main PID: 789 (3CXSLDBServ)
        Tasks: 15 (limit: 4915)
       CGroup: /system.slice/3CXCfgServ01.service
               └─789 /usr/sbin/3CXSLDBServ -n -p /var/run/phonesystem/3CXCfgServ01.pid -o /var/lib/3cxpbx/Instance1/Bin
    /Objects.cls -c /var/lib/3cxpbx/Instance1/Bin/3CXPhoneSystem.ini
    
    Warning: Journal has been rotated since unit was started. Log output is incomplete or unavailable.
    
    ● 3CXMediaServer.service - 3CX PhoneSystem Media Server
       Loaded: loaded (/lib/systemd/system/3CXMediaServer.service; enabled; vendor preset: enabled)
       Active: active (running) since Fri 2018-03-16 12:09:23 -03; 5 days ago
      Process: 20230 ExecStopPost=/bin/rm -f /var/run/phonesystem/3CXMediaServer.pid (code=exited, status=0/SUCCESS)
     Main PID: 20253 (3CXMediaServer)
        Tasks: 17 (limit: 4915)
       CGroup: /system.slice/3CXMediaServer.service
               └─20253 /usr/sbin/3CXMediaServer -n -p /var/run/phonesystem/3CXMediaServer.pid -c /var/lib/3cxpbx/Bin/3C
    XPhoneSystem.ini -m /var/lib/3cxpbx/Bin/3cxmediaserver.ini
    
    Warning: Journal has been rotated since unit was started. Log output is incomplete or unavailable.
    
    ● 3CXAudioProvider01.service - 3CX PhoneSystem 01 Audio Provider Server
       Loaded: loaded (/lib/systemd/system/3CXAudioProvider01.service; enabled; vendor preset: enabled)
       Active: active (running) since Fri 2018-03-09 16:52:08 -03; 1 weeks 5 days ago
     Main PID: 805 (3CXAudioProvide)
        Tasks: 6 (limit: 4915)
       CGroup: /system.slice/3CXAudioProvider01.service
               └─805 /usr/sbin/3CXAudioProvider -n -p /var/run/phonesystem/3CXAudioProvider01.pid -c /var/lib/3cxpbx/In
    stance1/Bin/3CXPhoneSystem.ini
    
    Warning: Journal has been rotated since unit was started. Log output is incomplete or unavailable.
    
    ● 3CXQueueManager01.service - 3CX PhoneSystem 01 Queue Manager Server
       Loaded: loaded (/lib/systemd/system/3CXQueueManager01.service; enabled; vendor preset: enabled)
       Active: active (running) since Fri 2018-03-16 12:09:04 -03; 5 days ago
      Process: 20108 ExecStopPost=/bin/rm -f /var/run/phonesystem/3CXQueueManager01.pid (code=exited, status=0/SUCCESS)
     Main PID: 20171 (TcxQMsrv)
        Tasks: 23 (limit: 4915)
       CGroup: /system.slice/3CXQueueManager01.service
               └─20171 /usr/lib/3cxpbx/TcxQMsrv -p /var/run/phonesystem/3CXQueueManager01.pid /var/lib/3cxpbx/Instance1
    /Bin/config.json
    Warning: Journal has been rotated since unit was started. Log output is incomplete or unavailable.
     
    #1 ANJOTI, Mar 22, 2018
    Last edited: Mar 22, 2018
  2. Legop

    Joined:
    Feb 22, 2018
    Messages:
    15
    Likes Received:
    0
    Try to restart the service. 'systemctl start 3CXPhoneSystemMC01' works for on debian.
    Did someone try to add an extension in the management console? This appears to sometimes cause the service to crash. (if done in a specific way)
     
  3. ANJOTI

    Joined:
    Mar 16, 2018
    Messages:
    55
    Likes Received:
    0
    I used the command 'service 3CXPhoneSystemMC01 start' and seems to be working again but 'for enjoy the moment', I just used 'aptget update' + 'aptget upgrade' + reboot to keep server updated.

    >>>> But the main curious is, how to avoid this to happen again? What exactly caused that?
     
  4. ANJOTI

    Joined:
    Mar 16, 2018
    Messages:
    55
    Likes Received:
    0
    Should we monitor these services thought SNMP??
     
  5. Legop

    Joined:
    Feb 22, 2018
    Messages:
    15
    Likes Received:
    0
  6. YiannisH_3CX

    YiannisH_3CX Support Team
    Staff Member 3CX Support

    Joined:
    May 10, 2016
    Messages:
    4,891
    Likes Received:
    321
    Services could stop for any number of reasons and we need to individually check each case separately. Since this only happened once i would recommend keeping an eye on the situation and let us know if this happens again. If it does you will need to set your logging level to verbose so that the actual reason that this happens gets logged properly. Once the issue is replicated you can open a ticket with our support department and they can take a look at the issue or we can take a quick look here to try to find the cause.
     
  7. ANJOTI

    Joined:
    Mar 16, 2018
    Messages:
    55
    Likes Received:
    0
    Hi @YiannisH_3CX,

    I just purge my logs and restart the server after Linux updates, so I´ll check the log file (already in Verbose mode) if it happens again.
     
Thread Status:
Not open for further replies.