Camera Jumping when using the "look at" puzzle

Here is a link to a setup that replicates the problem. Click the “Click Me” HTML element at the bottom so see what I’m talking about. I’m not sure if it’s a puzzles bug or the way I have my camera set up in blender being sub-optimal.

I’m a little unclear about the different camera control options. I want to be able to pan but I don’t want the camera to move it’s position from the origin (messing up the perspective on the 360 photo sphere. Scrolling (zooming in) actually changes the camera position instead of viewing angle. I want to disable zoom and position changes but allow panning and have the “look at” functional. What setup should I use? Orbit, Flying, No control?

Okay I get the issue now. I want the camera to be setup to pan but not around an object (orbit). I just want to click and drag to rotate my view (like a 360 youtube video). In order to do this, I am currently using a small camera offset from center (0,0.01,0) and using the origin as my target. So the camera orbits the origin and all works as I want.
When I use the “look at” puzzle, the orbit target changes to the object. Now my view is distorted because I’m no longer in the center of the sphere and I’m no longer panning around the origin, I’m panning around an object on the surface of my sphere. I want the camera to be pointed at an object but not rotate around it.
Could I/should I use a different camera set up to achieve what I’m after (A camera locked to the origin and able to pan and look at specific items on the interior surface of a sphere)

Thanks, your suggestion got me to an acceptable behavior for my application. Generally I’d like to know the proper way to implement a camera mode which is “pan only” and can be pointed at various targets without rotating around them (like the orbit camera does.) I’ll post on the forum if I figure it out.