My 2 cents
I'm in the same boat as you, trying to decide between an RV and a Kitfox. As has been said before, decide upon your mission and choose your plane based on that. If you want to fly to weekend destinations 600 miles away and you build the ktifox you will not be happy. On the other hand, if you want to fly low and slow and land in that field next to the river for a quick swin and you build an RV, you will not be happy.
Now, you say you just want to fly. I used to think the same way. However the more I flew the more I realized I want more out of flying than just being up in the air. I know this sounds like blasphemy, but flying just to fly gets boring really fast. Soon you're going to want to GO somewhere. What you need to figure out is where is it you want to go. Whether more often than not you want to fly 50 miles for a burger or you want to fly 500 miles for a weekend. Once you can answer that question then it's a no brainer to choose your plane.
In a perfect world I would build both planes, but I don't have the time or $$$ to pull that one off. I have access through my flying club to a C210 at $160/hour. For me, the 210 and the RV fulfill the same mission, to get to a far away place fast. The upside of the 210 is I can bring more than 1 passanger, the downside is it's not an RV. But for only $160 an hour its hard for me to justify the time and money outlay that would be required to build an RV. Of course the 210 isn't as fast, aerobatic, as good looking, can't use the latest and greatest avionics and burns more fuel. But I also don't have to lay down a min of $65K to get in it either.
The kitfox satisfies my urge to fly low and slow, putting around the sky, and landing at just about any where there is a clear 1,000 feet. It's not a great plane to go from point A to point B fast, but when you want to cruise up the coast at 60mph and 500 feet with the doors off I don't think you can beat the kitfox.
If you're serious about this kitfox find out more about it, what model is it, what engine is it, what is the history of the engine, etc. Also read up on the various models of the kitfox to get an idea of what the differences are between them. My opinion is I wouldn't fly anything earlier than a model 4, and I wouldn't fly behind a 2 stroke. This is based soley one what I've read, I have never flown a kitfox or spoken to anyone who has. I'm just not comfortable with the reliability of a 2-stroke motor, and the earlier kitfox models are said to have some intersting flying qualities.
As you have already found the best resource for information on the RV, here are some places to read up on the kitfox:
http://www.teamkitfox.com
http://www.iperlman.com/MyKitfox.html