Well, the natural thing to do is compile the lisp to javascript and use webgl!
Would be interesting to see how much is needed to get it running with some other gl context. Also -- maybe this'll run under OS X and windows without requiring a X server for the GL context?