Update 6 BETA - Grafana Reporting Is Finally Here!

[SweetAction]

In the meantime, instead of rushing to upgrade, I would prefer you list what Cloud services you use because I need to start to prepare a list of potential suggestions where and to what solution data should be offloaded.

Hi,
We have customers who have on-premise data storage using MSSQL, MySQL, and PostgreSQL that cannot/won't use cloud solutions to store the data. Today they replicate/convert the entire 3CX postgresql database to (mostly MSSQL) their preferred engine om-premise and then <process the data>.

Are you planning on supporting exporting to non-cloud solutions?

 

[UCMUserAZ]

This looks great. Going thru setup now. Question, as my org sets my Google role on my own Google account, is it possible to setup a user/service account for the BigQuery API and Storage so I can avoid having my own Google account changed to Super Admin? Thanks in advance.

 

[UCMUserAZ]

This looks great. Going thru setup now. Question, as my org sets my Google role on my own Google account, is it possible to setup a user/service account for the BigQuery API and Storage so I can avoid having my own Google account changed to Super Admin? Thanks in advance.

Instructions were easy to follow. Thanks. I am just waiting on the 3cx to BigQuery connection to see if I can avoid having to get SuperAdmin rights. Is that only temporary for the initial setup? Security will ask when I request. Thanks.

 

[UCMUserAZ]

Hi,
We have customers who have on-premise data storage using MSSQL, MySQL, and PostgreSQL that cannot/won't use cloud solutions to store the data. Today they replicate/convert the entire 3CX postgresql database to (mostly MSSQL) their preferred engine om-premise and then <process the data>.

Are you planning on supporting exporting to non-cloud solutions?

This would be a nice option for Enterprise licenses to use on-prem SQL. I am still going to setup the BigQuery, but larger orgs may like this option. Grafana is very powerful and was pretty easy to setup. These types of updates are great where you are not having to do full/complete re-installs or uplifts like legacy vendors have you do.

 

[nikolascx]

I would say AWS Aurora would work. Another one is Azure Data Lake, which can be connected to BI as well.

One little note on Google BigQuery. I was expecting it to use the JSON key from the storage section, and prompt us to simply enable the API and create a table, but it seems it requires Google Workspace, which we don't use, but I'd still like to be able to use those Google stuff.

Azure Data Lake is something we are researching - yes for use with Powerbi. Problem here is that from our research,PowerBI direct to Azure data lake will be slow for large storage files and little bit limited for what we intend to achieve.
So then we would need to go the PowerBI via Synapse to ADL and this is an extra complication. For now Azure will be positioned last.

Re BigQuery - Yes you should expect a Json File. Yes it definitely requires Google Workspace.You should consider doing this because it is a great advantage over traditional Google services and will definitely help you.

If you want to use the google stuff, then go in Google Bigquery and tell it to scape the data from your postgres instance.. This is all new stuff still in preview.

Basically it's "nearly" exactly what we did, but the reverse. So instead of 3CX Pushing to Bigquery, Bigquery pulls from Postgres. The drawback is that you would need to open the port from postgres. But if you want to try, this is your best shot until you get Google workspace. Then you can offload the data yourself.

 

[nikolascx]

Instructions were easy to follow. Thanks. I am just waiting on the 3cx to BigQuery connection to see if I can avoid having to get SuperAdmin rights. Is that only temporary for the initial setup? Security will ask when I request. Thanks.

Hello @UCMUserAZ
The credentials are stamped in the JSON Certificate.
3CX will present the json cert when it authenticates to google.
The permissions are not temporary. If you add on setup and then remove, you will get permission problems later (Either during 3CX to Bigquery offload or later on the Grafana visuals)

I would send to IT Sec ops the link to the blogpost so they can better understand the context.

 

[nikolascx]

Hi,
We have customers who have on-premise data storage using MSSQL, MySQL, and PostgreSQL that cannot/won't use cloud solutions to store the data. Today they replicate/convert the entire 3CX postgresql database to (mostly MSSQL) their preferred engine om-premise and then <process the data>.

Are you planning on supporting exporting to non-cloud solutions?

Yes no problem. Anyway, in today's ecosystem, what is the difference between cloud and non cloud? They are both "just another nonbranded machine instance"

So if you have an instance on amazon running postgres and another machine in a private area of your infra, these are still the same technology to offload because the underlying database is postgres. We know that there are many machines hosted with Databases on them that are not necessarily on Google, AWS or Azure. Next step is to put support for all these via the Postgres Plugin.
We thought of this already. Yes, We will definitely add support for offload to SQL on any machine you want. There is no difference for us if it is on premise or cloud.

 

[nikolascx]

This looks great. Going thru setup now. Question, as my org sets my Google role on my own Google account, is it possible to setup a user/service account for the BigQuery API and Storage so I can avoid having my own Google account changed to Super Admin? Thanks in advance.

Yes definitely. You need to create a service account for 3CX.
Give the rights and roles to the service account.
Then manage the creation of the key from this service account.

You should not be doing this on your google account because yours is more exposed (because you work with it from different services).

IAM & Admin > Service Accounts and Create a service account for your 3CX PBX.

 

[N_G]

Hi,
We have customers who have on-premise data storage using MSSQL, MySQL, and PostgreSQL that cannot/won't use cloud solutions to store the data. Today they replicate/convert the entire 3CX postgresql database to (mostly MSSQL) their preferred engine om-premise and then <process the data>.

Are you planning on supporting exporting to non-cloud solutions?

You can already use an on prem Postgres no problem at all. Existing or new. Instructions are for new but you can use existing. Definitely we will make support for on prem MS SQL too.

 

[PBX128]

On https://www.3cx.com/blog/releases/grafana-reporting/ you're mentioning an additional right option:
"User Operation rights extended to include viewing and changing another user’s call forwarding settings."
That is a very welcome new feature!

Unfortunately in Changelog (https://www.3cx.com/blog/change-log/phone-system-change-log-v20/) is this point missing. Maybe you can add it there.

 

[Alphabetic]

Hi, noob question.

"Use the setup guides for Google BigQuery and AWS PostgreSQL to get started."

Do I need both for this or is it one or the other?

***edit

"Update 6 includes the ability to connect your 3CX system to an external data source, such as Google BigQuery or PostgreSQL"

answered my own question.

 

[nikolascx]

Hi, noob question.

"Use the setup guides for Google BigQuery and AWS PostgreSQL to get started."

Do I need both for this or is it one or the other?

***edit

"Update 6 includes the ability to connect your 3CX system to an external data source, such as Google BigQuery or PostgreSQL"

answered my own question.

Hi @Alphabetic
It's either Google BigQuery or AWS. And there will be more options to come.

 

[Alphabetic]

Great stuff.
Is there any way we can specify the location the data is stored during set up or is this a default setting within the google account that needs to be specified first?
Just having a play, looks good. Im assuming there will be more templates out for Grafana in the future? I've got a specific set of data that I need 3CX/Grafana to be able to present and It looks absolutely doable but have no idea how to use the queries

 

[deangreen4]

+1 for postgres templates please. Have built a postgres/grafana docker box and am now very eager to try it out!

 

[nikolascx]

+1 for postgres templates please. Have built a postgres/grafana docker box and am now very eager to try it out!

Sure - Currently WIP.. approx 1 week..

 

[nikolascx]

Great stuff.
Is there any way we can specify the location the data is stored during set up or is this a default setting within the google account that needs to be specified first?
Just having a play, looks good. Im assuming there will be more templates out for Grafana in the future? I've got a specific set of data that I need 3CX/Grafana to be able to present and It looks absolutely doable but have no idea how to use the queries

We are working on a video. Will give all the things you need to know.
The url is known after the json is uploaded.
Yes more templates will come of course - Currently working to get them on the grafana market place so we can all go and get them from there instead of downloading zip files.

Provide more information on your case, what do you need. You mention specific set of data - but what data is this? With Grafana you can do anything.

 

[UCMUserAZ]

This is awesome stuff. Thank you for all the answers @nikolascx I will try the 3cx service account route as suggested. Looking forward to the additional Grafana templates and more data storage options. Thanks.

 

[Alphabetic]

We are working on a video. Will give all the things you need to know.
The url is known after the json is uploaded.
Yes more templates will come of course - Currently working to get them on the grafana market place so we can all go and get them from there instead of downloading zip files.

Provide more information on your case, what do you need. You mention specific set of data - but what data is this? With Grafana you can do anything.

Hi Nikolas,

I will DM you my requirements.

 

[Ryan_Fisher_Techmode]

I used AI to convert a template file, and now it can work with a PostgreSQL data source.

This is great! Is there a version in English? I imported this one and it worked great but much of it is in Chinese.

 

[gpaillot]

So, there is no way to self-host this ? we have to use (paid) cloud services ?

What prices to expect for the AWS db server ?