I started with an Elise, moved to an Exige, got a regular Evora (selling it now (want to buy?) as I upgraded to an Evora S). I love both. Evora is a much cushier car for sure. Much easier to live with and get in and out of. Other than being low, I'd say the biggest problem is the wide doors but you'll have that problem with any coupe. Fortunately they have a detent and you can get in and out ok with that detent when you park next to someone but it still takes getting used to.
The Exige - well, you can do what I did and add a rear camera so you can see out the back when exiting a parking spot. Still need to check your mirrors but its not so bad.
Driving daily - well, depends on what you want. Exige is a race car for the street. Its fun to drive every day and the door is not nearly as wide so you can actually park next to others without the wide door of the Evora. But you gotta accept the gymnastics getting in and out of the car.
Exige is definitely noisier but I upgraded my sound system in both cars and it works fine. I regularly take the Exige to the track and while it definitely is noisier it doesn't bother me. On the other hand, its more like a 1.5 seater as you will be pretty chummy with the person next to you (rubbing elbows and what-not). Very cosy inside but once you get in the driving position is absolutely perfect in my opinion.
BTW, the Evora rear seats are for emergency only (for1 person, forget 2) but are useful for storage.
Bottom line - Exige is a go-kart for the street and fun even for daily driving but a bit noisy. Ultimate street/track car so if you think you'll do a lot of AutoX and/or track days definitely get it. Nice dead pedal, very easy to position the car, no one sees you so you have to look for them, point and shoot, lots of fun.
Evora - more expensive, worse gas mileage, easier to be in, quieter, less raw, still pretty fun but not as go-kart like. More elegant. No dead pedal but you can sort of prop your foot up. More torque than the Exige (even the supercharged Exige in my opinion - I have one of each although the Evora S blows the regular Evora away in this department).
Both cars get looks (of course what color you get also makes a huge difference). If you do decide you are interested in an Exige, make sure you are willing to get in and out a number of times and are ok with that.