On machine tools these sight glasses are almost invariably simply pushed in to a cleanly bored hole.
Thin metal housing flange distorts slightly to grip and seal against negligible pressure. Theoretically they can be punched out without damaging the thin flange and a new window fitted. Maybe a wooden dowel just the right size pushed from inside. "Are you feeling lucky"
Quick google for oil sight glasses turns up a fair number of suppliers, prices from £5 to £15 (ish) seem common.
Most common are screw in units for hydraulic systems working under significant pressure. But I guess the glass / plastic window could be extracted and inserted into a push in flange.
Or this looks promising **LINK** push in, range of sizes but probably a bit spendy.
Clive