The clutch started to chatter and shifting became difficult at 15k miles. It was "fixed" at about 20k, but began to act up again shortly after it was fixed. I do not drive it too hard, and I have never had any other trouble with a manual transmission.
There is a lot of wind noise, and the cabin isn't too comfortable for me, I'm only 5'11" and athletic, but I don't feel like I fit well in the drivers seat.
The headlights are poorly aimed and seem too dim to do any good.
It handles reasonably well and all wheel drive is a great thing to have, but the clutch acts up so much I don't want to deal with it anymore.
The same thing happened to me with my 2001 Legacy L wagon. In approximately 30 years of driving cars with a clutch this is the worst I have had, otherwise I generally like the car. I am looking now to replace the clutch with an Exedy Sport clutch kit to end my troubles in this area, but Subaru should admit problem and pay partial replacement costs.