Sure. But activating such phones typically requires a telephone call. Or at least, it did the last time I tried it. And pay phones are now rare in the US.

Also, even if the phone is totally anonymous, you'll be geo-located as soon as you use it. By cell towers at least, and perhaps by WiFi and GPS.