I used to have the VF stage 2 setup and yes you lose the OEM bracket. Mine always wobbled a little bit but never a problem. Be very careful not to pull the dipstick tube out of the block. It has a retained O ring but is a pain to put back. It can be done but only from underneath the car.
I can't remember it being too hard to remove the dipstick. I hope the dipstick tube has not been bent more and crushed. You do need to work out the correct orientation to move the dipstick so that it is "flat" sided to get around the corners.