I'd suspect vacuum leaks first. Then maybe the fuel pump. However, a fuel pump hotwire kit MAY help.
If you've got a vacuum leak, then the vacuum you SHOULD be developing on the FPR isn't there. Therefore, when you pull the line off, no much happens to make it go up. Along the same lines if that same vacuum leak that is there at idle is STILL there while you're driving and under boost, then it's basically a boost leak. This would cause your FP to fail to rise.
Run ALL your vacuum lines FIRST. Basically trace them from the vacuum block until you can't see them any more. Check for cracks everywhere along the lines and any connectors. There are also some "hard plastic" or nylon lines. Check those to make sure there are no breaks in those lines. I'm betting you'll find a leak. I guess it's possible that a bad regulator will cause your problem, but I don't think it's likely.
How long have you had the car? Was it kept / maintained well before that? Did it sit for a long time in a garage without being driven?