Prevent Zoom Camera Clipping

I am sure you are familiar with cameras going through walls and into objects where you don’t want your user.

I am currently using a camera Constraint Material that allows me to prevent the camera from going beyond the Constraint Material and keeping the camera from going through the walls. Works well as long as zoom is set to 0.

However, I would like to keep zoom functionality if possible yet still keep it constrained or at least stop the zoom before it clips with any object in the scene.

Hoping someone has a workaround or elegant solution.