Solved On-Premise Broken

[hitmusic]

Hello,

We've had v20 installed for around 2 weeks without a problem.

Windows 11 does an update and on restart 3CX doesn't start back up. We've tried restarting multiple times and when trying to login to an extension it just says 502 - OK.

Looked in services.msc and only a couple of services have started, the majority of them say they fail to start.

Tried uninstalling 3CX completely (as we have a recent backup) and tried re-installing and the config page opens with the port settings, then it gets stuck in binding user to PBX and won't go any further. Again the services won't start even on a fresh install and restarting between uninstalling and re-installing.

This is a fresh Windows 11 and dedicated to the phone system.

Don't really know how to proceed.

 

[Evolute IT]

Run it on Linux instead of Windows.

Much less issues.

 

[TheodorosG_3CX]

Something is blocking 3CX services from starting. You will need to check in the Windows Event log for the reason.

 

[HERETIC]

Nearly the same thing here, running on Linux.

It seems that 3CX backup failed and either that or something else has broken the instance, because now none of the phones are working and the web interface is only slightly functioning.

The error I see in the dev console (of all browsers):
"Http failure response for https://[redacted].3cx.us:5001/webclient/api/MyPhone/session: 503 OK"

 

[Alphabetic]

If you're on v20 you should be using port 443 not 5001 unless you changed it?

 

[hitmusic]

Something is blocking 3CX services from starting. You will need to check in the Windows Event log for the reason.

Hello,

Here are some of the event notifications when trying to run or install 3CX on the latest Windows 11 update.

I've had to attach it to a text file as it was too long to post.

 

[hitmusic]

One of the event errors we keep getting relating to 3CX is a .net and dependency error when trying to start the service. This is after installing update KB5039302.

We have tried re-installing the C++ 2015 v14.0..23026 runtimes to see if that was the issue but now we can't proceed as it's now coming up that our FDQN has been requested too many times and we have to wait for the timer to reset.

So I'm guessing we have no phones for a week?

 

[TheodorosG_3CX]

The exception here is related with the OS:

"Exception Info: System.AccessViolationException: Attempted to read or write protected memory. This is often an indication that other memory is corrupt."

Is there any 3rd party installation running on the machine?

 

[hitmusic]

The exception here is related with the OS:

"Exception Info: System.AccessViolationException: Attempted to read or write protected memory. This is often an indication that other memory is corrupt."

Is there any 3rd party installation running on the machine?

Hi,

No other software running, it's just for 3CX. Everything has been running fine and we've been running v18 for over a year without a problem. Installed v20 2 weeks ago, again everything was fine... then Windows wanted to restart due to a Windows Update and upon restarting, the phone wouldn't work, and couldn't login to the admin panel either, that's when I checked the services and they were not running.

I've tried reinstalling net 8 runtime and still services won't run, but then again it won't get passed the FDQN part anywhere now because we've attempted it too many times.

I dont want to reset Windows at the moment as it was a brand new Windows 11 PC last year and its only been used for the phones.

 

[TheodorosG_3CX]

The error is related with the OS. If a full update of Windows and a reboot does not resolve the issue then you might need to re-deploy the OS as i strongly believe that even if you uninstall and reinstall 3CX you will still have issues.

 

[hitmusic]

The error is related with the OS. If a full update of Windows and a reboot does not resolve the issue then you might need to re-deploy the OS as i strongly believe that even if you uninstall and reinstall 3CX you will still have issues.

So 3CX force users to upgrade from v18 that runs perfectly fine, to v20 that's not even a finished polished product and still in beta, where a wibdows update could force you to reinstall Windows to get 3CX to work.

Surely you guys are having a laugh right?

 

[Alphabetic]

So 3CX force users to upgrade from v18 that runs perfectly fine, to v20 that's not even a finished polished product and still in beta, where a wibdows update could force you to reinstall Windows to get 3CX to work.

Surely you guys are having a laugh right?

Run hyperv off the machine, install Debian.

 

[hitmusic]

Run hyperv off the machine, install Debian.

So if we spend several hours tonight installing Debian, can we use the backup from the Windows version? And would we be able to install it anyway as the FQDN yesterday was saying we'd tried to install it too many times, even though the install never got past binding user.

 

[SteveITS]

The backups are compatible. It shouldn't take "hours." You should install using the 3CX ISO, and restore your backup during the install. https://www.3cx.com/docs/manual/installing-debian-linux-pbx/

As a plus you won't need an Enterprise license going forward, if you're no longer using Windows. Also version upgrades don't require an uninstall and reinstall.

Is the message you're seeing regarding the Let's Encrypt certificate? LE limits the amount of requests per hostname and I think IP...

 

[hitmusic]

The backups are compatible. It shouldn't take "hours." You should install using the 3CX ISO, and restore your backup during the install. https://www.3cx.com/docs/manual/installing-debian-linux-pbx/

As a plus you won't need an Enterprise license going forward, if you're no longer using Windows. Also version upgrades don't require an uninstall and reinstall.

Is the message you're seeing regarding the Let's Encrypt certificate? LE limits the amount of requests per hostname and I think IP...

Thanks Steve,

I've never used Linux or Debian, without re-formating the hard drive etc can we run it in Windows 11 virtually?

 

[SteveITS]

Yes, you can use Hyper-V: https://www.3cx.com/docs/installing-microsoft-hyper-v/

There is not much to do with a Linux 3CX...if you have automatic updates on, 3CX will install security updates also. (to be clear, they will not do so if updates are manually installed...but you can enable automatic updates only when desired)

 

[Lee Cramman]

Debian is surely the way to go for everyone. I just can't see the case for running on Windows unless you have a legacy setup to contend with.

It's more expensive, more difficult to deploy, slower to deploy, more "fragile", more difficult to manage, worse performance on the same hardware, more difficult to virtualise... and these are all OS issues.

3CX on Debian installed via a supported method has given me years of trouble free operation. In fact I'm only now having my first Debian / 3CX OS problem in years, and I don't even have to bother trying to troubleshoot it because I can blow away my VM including OS, create a new one, and restore from backup in probably less than half the time it takes to install Windows.

I would, however, love to see a containerised version of 3CX in the future... whether that be LXC / Docker / Kubernetes / Podman or similar. Then rebuilds would take seconds... and resilience could be top tier.

 

[hitmusic]

Thanks for all the information everyone. I've managed to install 3CX on Debian using the ISO, however it still says that the FDQN cannot create a certificate due to too many requests in the last 7 days due to the issues on Windows we have been having.

Can this be reset?

 

[Alphabetic]

Thanks for all the information everyone. I've managed to install 3CX on Debian using the ISO, however it still says that the FDQN cannot create a certificate due to too many requests in the last 7 days due to the issues on Windows we have been having.

Can this be reset?

No, this'll be a LetsEncrypt limit and you'll have to wait for the timeout to reset.

 

[Lee Cramman]

I suspect the limit you've hit is certificates per domain per week or renewals per domain per week - these are the main ones that reset every 7 days.

They use a rolling 7-day period so the likely first day it would work would be 7 days after the first day of attempts.

I do wonder if a feature suggestion for 3CX should be that, for new installs, renewals must succeed on the Let's Encrypt staging platform before being attempted on the live platform. This would eliminate these sorts of problems.