By definition in OpenGL, the camera is always in (0,0,0).
You then change the modelview matrix to "move the world" around the camera.

So you have to keep track yourself of where in your virtual...