Getting a little into hack territory with this fix, but if the network issues are difficult to eliminate how about making both the tower and towed immune to collision damage? They're usually going fairly slow anyway so there might not be too many negative consequences.