So I built the mesa GL libs from Ubuntu and tried 3D acceleration and it still doesn't work. Not really sure why. Might just be that I need to rebuild things in a different order, I'm thinking about it now. I'm hoping to get the 3D acceleration working as I suspect using Compiz might give better overall performance, letting the graphics chip handle the window management...moving windows around and stuff is pretty slow at present.
Still haven't tested the video playback stuff.