What feeds and speeds are you using? Too high?
If the tube is steel, in view of your problems, I would suggest a maximum cutting speed of 20 metres per minute (Cautious, but the object is a fine finish not ten a minute)
You are looking to remove 1mm from each side
So you need to take ar least one roughing cut (say 0.50, then 0.30, before a fine finishing cut (no more than 0.1 mm) at a slowest possible feed rate. (0.05 to 0.1 mm per rev)
Stating the obvious, the tool, needs to be sharp, and at centre height, with minimum overhang.
Possibly, lubrication for the finishing cut may help
Presunably the gibs are correctly set? Lack of rigidity will allow chatter to take place.
A worn or badly adjusted machine will rarely produce good work consistently
Let us know how you get on!
Howard