what im trying next is to use simple gesture like those found in flutter (hands raising, finger slide right, left etc) to activate abilities. And for minor camera panning movement, to use facetracknoIR. A freeware that allows one to control the mouse look via your face movement.