Local Transcription - Multiple 3CX Instances to single GPU server?

[Marco@]

Hello,

Is this possible yet, or do you have an anticipated timeline for this yet.

Thank You,
MP

 

[KyriacosS_3CX]

Hello,

This is on the roadmap and for the relatively near future, as has been mentioned here before. Still there is no set time for the feature release.

 

[dallaskincaid]

Will each system be completely siloed from other instances using the GPU? Obviously for clients who have regulatory concerns such as HIPAA or PCI are going to want this to be the case.

 

[KyriacosS_3CX]

@dallaskincaid , while I do not have any version that will handle multi-pbx transcriptions available to reply definitively (it is still under development), I can commend from a more general point of view - this are discussion points, I would wait for the product to be available before any certainty can exist.

Firstly what would you/they considered to be "completely siloed"?

The audio files are transferred to the transcription server and processed individually, the engine does not learn from these files and each recording goes through its own pipe in isolation, not interacting with any other recordings. For me this is siloed enough.

Now the files will of course exist on the server at the same time, but as each transcription completes the result is pushed back to the originating PBX - the PBXs themselves only have a "write access" to the transcription engine, they cannot poll it or read from it to get info about what else is being processed.

Whether this is sufficient or not, that should be decided per client - for some perhaps only a dedicated device in their own network will do.

 

[Marco@]

@KyriacosS_3CX -
what is the update process for the standalone transcription engine looking like?
Is this going to be kicked off from the 3cx server that the transcription engine is connected to, manual by script, apt-get/package manager? automatically?

are there any concerns with running any of the nvidia or other updates on the transcription engine server?

gpuserver:~# apt list --upgradable
Listing... Done
firefox-esr/oldstable-security 140.9.0esr-1~deb12u1 amd64 [upgradable from: 140.7.0esr-1~deb12u1]
firmware-nvidia-gsp/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
gir1.2-gst-plugins-base-1.0/oldstable-security 1.22.0-3+deb12u6 amd64 [upgradable from: 1.22.0-3+deb12u5]
gir1.2-javascriptcoregtk-4.0/oldstable-security 2.50.6-1~deb12u1 amd64 [upgradable from: 2.50.4-1~deb12u1]
gir1.2-javascriptcoregtk-4.1/oldstable-security 2.50.6-1~deb12u1 amd64 [upgradable from: 2.50.4-1~deb12u1]
gir1.2-webkit2-4.0/oldstable-security 2.50.6-1~deb12u1 amd64 [upgradable from: 2.50.4-1~deb12u1]
gir1.2-webkit2-4.1/oldstable-security 2.50.6-1~deb12u1 amd64 [upgradable from: 2.50.4-1~deb12u1]
gstreamer1.0-gl/oldstable-security 1.22.0-3+deb12u6 amd64 [upgradable from: 1.22.0-3+deb12u5]
gstreamer1.0-plugins-base/oldstable-security 1.22.0-3+deb12u6 amd64 [upgradable from: 1.22.0-3+deb12u5]
gstreamer1.0-x/oldstable-security 1.22.0-3+deb12u6 amd64 [upgradable from: 1.22.0-3+deb12u5]
imagemagick-6-common/oldstable-security 8:6.9.11.60+dfsg-1.6+deb12u7 all [upgradable from: 8:6.9.11.60+dfsg-1.6+deb12u6]
libcuda1/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
libcudadebugger1/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
libegl-nvidia0/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
libgles-nvidia1/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
libgles-nvidia2/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
libglx-nvidia0/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
libgnutls30/oldstable-security 3.7.9-2+deb12u6 amd64 [upgradable from: 3.7.9-2+deb12u5]
libgstreamer-gl1.0-0/oldstable-security 1.22.0-3+deb12u6 amd64 [upgradable from: 1.22.0-3+deb12u5]
libgstreamer-plugins-base1.0-0/oldstable-security 1.22.0-3+deb12u6 amd64 [upgradable from: 1.22.0-3+deb12u5]
libjavascriptcoregtk-4.0-18/oldstable-security 2.50.6-1~deb12u1 amd64 [upgradable from: 2.50.4-1~deb12u1]
libjavascriptcoregtk-4.1-0/oldstable-security 2.50.6-1~deb12u1 amd64 [upgradable from: 2.50.4-1~deb12u1]
libjavascriptcoregtk-6.0-1/oldstable-security 2.50.6-1~deb12u1 amd64 [upgradable from: 2.50.4-1~deb12u1]
libmagickcore-6.q16-6-extra/oldstable-security 8:6.9.11.60+dfsg-1.6+deb12u7 amd64 [upgradable from: 8:6.9.11.60+dfsg-1.6+deb12u6]
libmagickcore-6.q16-6/oldstable-security 8:6.9.11.60+dfsg-1.6+deb12u7 amd64 [upgradable from: 8:6.9.11.60+dfsg-1.6+deb12u6]
libmagickwand-6.q16-6/oldstable-security 8:6.9.11.60+dfsg-1.6+deb12u7 amd64 [upgradable from: 8:6.9.11.60+dfsg-1.6+deb12u6]
libnss3/oldstable-security 2:3.87.1-1+deb12u2 amd64 [upgradable from: 2:3.87.1-1+deb12u1]
libnvcuvid1/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
libnvidia-allocator1/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
libnvidia-api1/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
libnvidia-cfg1/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
libnvidia-egl-gbm1/unknown 1.1.3-1 amd64 [upgradable from: 1.1.2.1-2]
libnvidia-egl-xcb1/unknown 1:1.0.5-1 amd64 [upgradable from: 1:1.0.3-1]
libnvidia-egl-xlib1/unknown 1:1.0.5-1 amd64 [upgradable from: 1:1.0.3-1]
libnvidia-eglcore/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
libnvidia-encode1/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
libnvidia-fbc1/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
libnvidia-glcore/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
libnvidia-glvkspirv/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
libnvidia-gpucomp/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
libnvidia-ml1/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
libnvidia-ngx1/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
libnvidia-nvvm4/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
libnvidia-nvvm704/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
libnvidia-opticalflow1/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
libnvidia-pkcs11-openssl3/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
libnvidia-present/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
libnvidia-ptxjitcompiler1/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
libnvidia-rtcore/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
libnvidia-sandboxutils/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
libnvidia-tileiras/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
libnvidia-vksc-core/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
libnvoptix1/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
libpng16-16/oldstable-security 1.6.39-2+deb12u3 amd64 [upgradable from: 1.6.39-2+deb12u1]
libvpx7/oldstable-security 1.12.0-1+deb12u5 amd64 [upgradable from: 1.12.0-1+deb12u4]
libwebkit2gtk-4.0-37/oldstable-security 2.50.6-1~deb12u1 amd64 [upgradable from: 2.50.4-1~deb12u1]
libwebkit2gtk-4.1-0/oldstable-security 2.50.6-1~deb12u1 amd64 [upgradable from: 2.50.4-1~deb12u1]
libwebkitgtk-6.0-4/oldstable-security 2.50.6-1~deb12u1 amd64 [upgradable from: 2.50.4-1~deb12u1]
libxnvctrl0/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
linux-compiler-gcc-12-x86/oldstable-security 6.1.164-1 amd64 [upgradable from: 6.1.159-1]
linux-headers-amd64/oldstable-security 6.1.164-1 amd64 [upgradable from: 6.1.159-1]
linux-image-amd64/oldstable-security 6.1.164-1 amd64 [upgradable from: 6.1.159-1]
linux-kbuild-6.1/oldstable-security 6.1.164-1 amd64 [upgradable from: 6.1.159-1]
linux-libc-dev/oldstable-security 6.1.164-1 amd64 [upgradable from: 6.1.159-1]
nvidia-driver-cuda/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
nvidia-driver-libs/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
nvidia-driver/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
nvidia-egl-icd/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
nvidia-kernel-open-dkms/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
nvidia-kernel-support/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
nvidia-modprobe/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
nvidia-open/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
nvidia-opencl-icd/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
nvidia-persistenced/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
nvidia-settings/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
nvidia-vdpau-driver/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
nvidia-vulkan-icd/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
nvidia-xconfig/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]
usbmuxd/oldstable-security 1.1.1-2+deb12u1 amd64 [upgradable from: 1.1.1-2]
xserver-xorg-video-nvidia/unknown 595.58.03-1 amd64 [upgradable from: 590.48.01-1]

 

[Kevin Attard Compagno]

I suggest you hang on for just a few more days. The new version will become available VERY soon, bring a number of optimizations, and an improved installer that should take care of adding auto-update functionality.

There is typically no forcing reason to force an update of the nvidia drivers. In fact our current configuration is to intentionally block updates to the nvidia drivers to avoid complications arising from possible misalignment between kernel image, kernel header packages, and nvidia kernel modules, and to avoid possible compilation failures during the driver upgrade process.

 

[Marco@]

I suggest you hang on for just a few more days. The new version will become available VERY soon, bring a number of optimizations, and an improved installer that should take care of adding auto-update functionality.

There is typically no forcing reason to force an update of the nvidia drivers. In fact our current configuration is to intentionally block updates to the nvidia drivers to avoid complications arising from possible misalignment between kernel image, kernel header packages, and nvidia kernel modules, and to avoid possible compilation failures during the driver upgrade process.

Thank you for clarifying!

 

[lucazevedo]

Good afternoon.

Any estimated time for the release of the Transcription Engine from a single server to multiple 3CX servers?

Thank you.

 

[KP | aconitas GmbH]

Hello,

any update when the option to add multipe 3CX Servers is available?

thanks

regards

 

[nikolascx]

Hi Guys
Not exactly sure on the timelines, but let's say before the end of July.. this can change of course, but we are close.
Get your servers ready.. And maybe some macmini's