Are you using any security plugin that restricts access to your wp admin directory? If so, that may be your issue with the site slowing with Woocommerce. At checkout, Woocommerce accesses your admin-ajax.php, which resides in the wp-admin directory. This little snippet basically allows for access to the file. Just add it to your htaccess file in the wp admin.