That's not been my experience. I've been selfhosting email on a small provider VPS for years, never had any deliverability issues that I know of. I've set up DKMS, SPF..etc records properly and I send maybe a dozen emails a day at most.