I also looked at getting a flip phone but decided it wasn't really viable. Realistically you need to have an iOS or Android phone, because even if you don't need it /most/ of the time, you do need it sometimes.

The trick is to find ways to carry it with you less.