Removing exterior door handle on 308

I am removing my passenger door handle to refinish it and I am having a hard time getting the nut loose that retains the bottom of the cable inside the door, as access is difficult. The best way to get to it would be to remove the door latch assembly from the door but I don't know if that is going to turn into a whole big nightmare so I have been hesitant to do that. Anyone have any experience with this area?
Thanks in advance.
John

 

So, removing the latch assembly would be a nightmare as I thought but once the bolts are out you can move the assembly somewhat, making it easier to get a socket on the nut holding the cable. What works best is one of those flexible socket extensions hooked to a drill. Then you just need some way to stop the cable/bolt from spinning. I hooked a vise grip to the cable so it couldn't spin around. Once that nut is loose, you can slide out the cable. Unscrew the pivot screw, which the handle pivots on, in the door jamb area and then manipulate the handle and cable out the slot on the outside of the door. You need to remove the very delicate plastic trim ring before the handle will fit out.