Hi,
Can you see what number is set to take incomming calls for this line? and please make sure that the extension is registered at the time of calling.
Thanks for pointing out this delay, can you tell us which provider you are using so that we can try to reproduce the situation? Also if you are using a stun server can you please let us know which? it has been the case that a slow STUN server slows down the call process.