I set a true running bar up in the machine and measure off that. A taper fitting test bar is ideal although I usually just put a known straight rod up in a collet.
Precise adjustment is hardest thing using the usual push, tap, curse method. Best to make some sort of opposed push screw thingy to fix on the cross slide and give positive, controlled, movement both ways. Geo. H. Thomas recommended 2 BA screws for pusher duties. That or 10-32 UNF seem a good compromise between stout enough to push and fine threaded enough for accuracy. 4 mm is nearly double the pitch and a bit too coarse.
Its advisable to have a good scrub up and lubricate under the topslide before attempting precise setting. Swarf, bits and general grunge do tend to work in there and the shop gremlins will take great pleasure in nudging the contamination into just the right place to ensure that things shift a bit when you tighten down after getting the setting just so. Push from the side locking systems, such as the circular wedge and angled pusher used by Boxford, Southbend et al suffer more in this respect than the simple through bolt or Tee nut in slot variety.
Clive