Actually, turning the AC off should turn it off. But once the radiator fans start running they will continue to run until you shut down and restart the car - it common and they all seem to work that way. But the compressor does turn off.I've also noticed that turning OFF the AC doesn't actually turn it OFF once the evap coil has frozen over -- it gets stuck in a infinite cycle --
As for removing the AC, I wouldn't. At the very least, if you get caught out is a heavy rainstorm in a humid environment, some tiimes the only way to defog the windshield is with the defroster on along with the AC. I'd keep it if only for that use...