GizmoViewport AxisHead events being consumed by meshes behind it instead

[Bungalow12]

Hi all,

I am working on a 3D editor built with React Three Fiber and am using drei for my GizmoViewport to allow for the interactions to move the camera.
The thing that is confusing me the most is that everything works beautifully unless I have a mesh "behind" the sprite that makes up the GizmoViewport AxisHead. When this happens the raycast into the 3D scene happens first and I believe stops the propagation from ever reaching the AxisHead. (At least I am getting this from my logs by not seeing the pointerDown listener firing) I have the render order set such that it draws on top but the rest of my scene is getting the interaction instead.

Does anyone have an idea of what I might be able to try to ensure the raycast for the GizmoViewport is used over the one given by default in React Three Fiber?