Ok the fact that increasing the load on the server appears to correlate with the increase of the problem may be telling, but we should still look at some minor details just in case we missed something.
Let's try and get a few other things out of the way that may be affecting the performance:
- The more BLFs you load up on the phones, the harder it is for them to process. If the issue persists with lets say just a single BLF in total, then that's another story so better check with a single BLF
- The more contacts the phones have, the lesser their performance may be. If you have 1000+ contacts on those phones, they may potentially suffer performance-wise so take that into account
- Check the server CPU and memory load during the time when the issue occurs. Make sure you switch the task manager to show individual cores. Do you see any weird behavior?
- Make sure you have updated your AMD chipset drivers, and Ethernet drivers!
- I seem to remember Windows had some issues with the thread scheduler on Ryzen platforms, which they patched in later versions. Your current version of Windows Server 2019 might not have those enhancements. This is a long shot of course, but it could end up affecting performance in weird ways. Not sure if this can be corrected without installing something Windows 10 build 21H2...
Let me know if any of the above provides any positive results.