Understood, but somehow the discussion ended up around achieving orbital velocity instead of escape velocity (the one relevant to the original sub-thread topic), two very different numbers (though escape velocity is ultimately a higher number.)
Sure, but they're not orthogonal at all. One is just a lot more delta-v than the other. It's the same basic thing. Point the rocket nozzle in the opposite direction that you want to go and turn it on (modulo the fact that the "direction you want to go" might not be intuitive because orbital mechanics).
While you could theoretically do this by accelerating directly up, You still have to accelerate somehow.