You shouldn't need to take it off, but it makes it a lot easier. Its really easy to get at the bolts for the crossover anyway, so I would say take the crossover off.
I didn't bother to take mine off. 1st remove converter/flexplate inspection cover. It also helps to have and assistant (esp. for reinstall) unless you are installing a mini-starter.