I have had to replace the head gasket and the O2 sensor twice. Both were one year apart from having them replaced the first time. The A/C also went out and it took the dealer 3 times to finally repair it. It is still temperamental but the headache of dealing with them is not worth it.
The service from the dealers is really horrible and I wouldn't recommend this car to anyone.
I generally agree with this review, but I just wanted to add some other things. I have many problems with the cooling system and have gone through quite a few thermostats. this is all under normal driving conditions. I disagree about the performance level though. I have recently gotten into a few races in the neon and I was rather impressed with the pick-up and the speed of the vehicle; for only a little four-banger.