Put a small bush in the ally plate to prevent the hole wearing and capture the rod end with locknuts and thrust washers. If you wanted to get really posh use 6mm ID thrust bearings and nylocks or locknuts.
A lot depends on if the moving part slides or hinges. If it hinges they you'll have to allow for the rod to swing a bit unless the range of movement is very small.