If it's close to the heater box, with or without the shield, I'd also take a look between that point and the cat.
Look at the 3/4" body seam joint and see if it's up against that too.
I opened my holes in the downpipe to 3/8" and it allows for more play. If you can move the exhaust that will help for sure.