I think that last nut on the bottom is supposed to unscrew. Probably corroded.
Is that a spacer separate from the nut? If so, you may have to crimp it with some vice grips to hold the rod still while you bust it loose.
If not, you may be forced to take it all apart to get it all loose.
I think you are on the right track, but the fixture isn't working as intended.