In some situations, SCP can stall after just around 5-10 seconds, and it happens consistently. This can sometimes be solved by limiting the bandwidth SCP asks for.
Reference: http://askubuntu.com/questions/82984/why-does-scp-get-stalled-how-do-i-resolve-it