It sounds as if your saw would benefit from a detailed check of all adjustments, to ensure that the guide rollers are correctly set, and that the tracking is correct; once you are sure that there are no fixings loos that should be tight.
Don't forget that the pins on which the guide rollers run are eccentric to provide adjustment
If the bearings for the Idler wheel are worn, that needs to be rectified before starting on further adjustments.
Worn Driver wheel bearings will be evident by oil leaking through the lower seal. Remedy, new bearings and seal, plus making a substantial replacement for the thin tube masquerading as a bearing spacer. Whilst the wormbox is apart, it may be worth taking a few thou off the back of the wormwheel to prevent the teeth rubbing on the casting.
HTH
Howard