Ed
Considered a number of layouts in my efforts and would not use a yoke to mount the potentiometer. Simply screw through the panel into a relatively large diameter bushing and run the direction selector lever on that. Large bush isolates the pot knob from the lever and gives you somewhere to put an O ring for drag if need be.
Switches go outside the potentiometer so its all pretty flat. Shallowest form is to lay the micro switches flat on the front with the switch operating operating / detent notches directly on the outside of the lever boss instead of using a separate cam. Put a slot at the bottom of the cover to accommodate the direction lever swing, ± 20° should be more than adequate. Big advantage of that layout is it gives a nice surface for speed calibration dial. Direction lever and switch pack should come out rather under half inch deep depending on how thick you make the cover.
Clive.