I don't know if this could be a possible reason for this behavior but I'm recalling that someone has reported that the email verification can slow down some things. Maybe you disable this setting to see if it has an impact on this issue: 1.9:
->Admin Panel->Settings->Email->uncheck "Verify email address domain" 1.10:
->Admin Panel->Emails>Settings>uncheck "Verify email address domain"