Uniball had a lot of play in it, I thought the nylon also had play due to being worn but it turns out it isn’t supposed to be tight on the shaft. I’m learning.
Once I loosened everything and started moving the clamps off the uprights the column started binding up. I marked the position of the clamps and put everything back together but I wasn’t able to find the position in which everything lined up smoothly.
I will try what Benn suggested and will report back. Thanks