If you’re not careful, you can cause a processor to come to an immediate and full stop while it waits for data to move around in memory. That’s probably not the performance boost you were looking for.
In order to avoid these delays, you need to be aware of two things and make sure to test your code to fully understand what it’s doing.