Call recording archive using sftp not working due to missing subfolders

[dungsedv]

Hi community.

we have a huge amount of call recordings and we want to archive them on a SFTP Server (https://www.nsoftware.com/sftp/sftpserver/#prod-overview).
We can setup the archive and the 3cx instance is able to connect to the SFTP Server. If i start the archive process for a recording i can see the progressbar on the right buttom. In my SFTP Server logs i cen see that the upload failed:

SFTPServer.exe Error: 0 : [09/09/2020 15:09:48] [13080] [15] SFTP error: -1 Could not open file: Could not find a part of the path 'F:\FTP Root\252\[CQ-OPS-Sales%3A011111209017]_001111111-252_20200909115028(7674).wav'.

If i create the extension subfolder (for example: 252) for this recording and restart the archive - everything is working fine. The file will be uploaded and shown as archived at the list of recordings. After that i can download the recording without any issues.

Is it really necessary to create all subfolders manually? This should mean: Everytime i create a new extension i have to remember to create the subfolder...
Is there a way to do this automatically???
Is this a bug?

We are running Enterprise v16.0.641
Will be happy to get some responses...

Greetings Marcus

 

[JohnS_3CX]

Hi Marcus,

No that should not be necessary. Perhaps the rights of the user you created for the PBX to use on the SFTP are not enough to grant full access?

As a test, try setting up a FileZilla SFTP server and test it to see if you get a different behavior

 

[dungsedv]

Thanks JohnS_3CX,

we test the permissions directly from the console of the instance using command sftp. We can create folders, put and get files. So this can't be a permission problem...

 

[JohnS_3CX]

I would give FileZilla a shot too, just to have 2 independent samples

 

[dungsedv]

Thanks for the help but can't do that. The (s)ftp server is hosted by the customer and he don't want to do that at the moment. So i adviced him to create all the subfolders...

 

[CFP]

Thanks for the help but can't do that. The (s)ftp server is hosted by the customer and he don't want to do that at the moment. So i adviced him to create all the subfolders...

i've been wracking my brain about this also (have posted on another thread) - creating the extension folder manually allows the call recording archive to work.

however 3CX's SFTP client won't create the folder. Using WinSCP i can loginn with the same account and the same key / passphrase and create a directory myself without issue. so it does seem to be related to the 3CX SFTP client.

i'm using Syncplify.me SFTP server on a Windows Server VM.

 

[JohnS_3CX]

In your management console, did you include the full path including slash?
Or did you just give it the address?



sftp://10.20.30.40 - might fail
sftp://10.20.30.40/users/john/3cxbackup/ - might work

Also, ftp servers can have various user rights options and you can disallow certain commands like MKDIR which would stop you from creating directories

 

[CFP]

In your management console, did you include the full path including slash?
Or did you just give it the address?

View attachment 18449

sftp://10.20.30.40 - might fail
sftp://10.20.30.40/users/john/3cxbackup/ - might work

Also, ftp servers can have various user rights options and you can disallow certain commands like MKDIR which would stop you from creating directories

i'm afraid that didn't work.

the user account being used for the SFTP site has full permissions. it looks like the client being used to write / modify doesn't work with certain SFTP servers.

i've also noticed that the client seems to struggle with renaming a file, in my case it's the backup .ZIP file. it looks like it creates a temp file of the same name then tries to raname it but also fails.

 

[JohnS_3CX]

That could be that case, would it be possible to retrieve verbose logs from the SFTP server during a session that 3CX connects and tries to create files/directories?

 

[CFP]

That could be that case, would it be possible to retrieve verbose logs from the SFTP server during a session that 3CX connects and tries to create files/directories?

I'm sure i can get those for you. On a seperate note (which is part of another thread) i'm checking to see if mapping a windows drive to an S3 bucket also works as a workaround to uploading these recordings / backups of the server to AWS S3 buckets. - would love native support of this to be honest!

 

[cobaltit]

3CX doesn't care about what happens under the hood. So if you are on Windows and you can get XYZ cloud/storage/magic beans to present itself as a local drive and 3CX has the correct permissions it will work.

 

[JohnS_3CX]

If you are referring to converting your Recordings Location (not archive) to an S3 bucket then see our documentation regarding recordings, we recommend that you mount SAN, iSCSI or Local drives only.

If the disk access is not block-level, then you might experience data loss (ie. NAS/SMB style drive mappings will not be reliable)

https://www.3cx.com/3cxacademy/videos/intermediate/call-recording/ see slide 3

 

[CFP]

If you are referring to converting your Recordings Location (not archive) to an S3 bucket then see our documentation regarding recordings, we recommend that you mount SAN, iSCSI or Local drives only.

If the disk access is not block-level, then you might experience data loss (ie. NAS/SMB style drive mappings will not be reliable)

https://www.3cx.com/3cxacademy/videos/intermediate/call-recording/ see slide 3

No i'm speaking purely on the archiving front. recording location is on the local server, however Archiving is targeting an SFTP server which is mapped to a S3 bucket (although not supported by AWS) - as mentioned in a previous thread, AWS S3 bucket integration would render this workaround not needed.