I removed my front years ago when the car was mostly stock. Obviously, the handling got worse. Added a big rear sway bar and a 6 point cage a few years after that. Obviously, the handling got better again. Added 27.5 inch tall skinnies in the front and 28 inch tall drag radials to the back a year after that. Obviously, the handling got worse again. This is still how it is today.
This current set-up is absolutely terrible. It handles like a wheelbarrow filled with water. I drive it a lot on the street but have to drive it cautiously. This combination will change soon. I no longer have room for a sway bar up front. Something custom may have to be fabricated or whatever.......
Like anything else, It seems as if it's the total combination of parts and your tolerance for unpleasantries that will dictate what you end up with. Try it. It may not bother you.