You don't think RM CYA's is reasonable?
Anyway, take it form someone who was thinking like you, car is a bit cheaper and tax is a bit cheaper so it leaves you more money to insure it and run it. After having mine for 5 months, I really wish i'd spent the extra on an 06 facelift. I really love the newer lights and they'll cost you nearly a grand, then you have the LED rear lights which will cost you another couple of hundred. Not to mention the extra 20 horses which will cost you an up-rev, an exhaust and hight flow drop in filter = another grand+. So for another 2.5k you could have a decent enough 04 car with the power and main upgrades to match the looks of the 06+.
Total cost 9k, which is about the same as you'll pay for a great looking 06+, but it'll have 2 more years of mileage, seat wear and corrosion. Plus, you'll never be able to get the upgraded interior of the 06+ in an 04 without selling your liver.
Just buy the 06+, I wish I had.