In reply to Ryan Hellyer.

You're right. It's not just your perception.

I never had problems when I used normal shared hosting, a VPS, a dedicated server running cPanel, etc. with no caching.

I didn't start having problems until I moved to a dedicated WordPress host.