Roll the window down and remove the door panel. There are two 10mm nuts inside holding the mirror to the door. After the mirror is off, there are two more 10mm bolts inside the base holding the mirror glass and swivel joint inside the housing. If you have a remote adjusting mirror you'll have to fish the cable through also.
I just did this converting a remote adjusted mirror with a simple swivel arrangement and kept my painted housing.
