Rbc deliver oxygen. The more available through rbc due to increased numbers, the better the cardio-respiratory systems work and produce. Performance experts know this for quite some time and they use epo doping to produce the oposite of what you say.
Less rbc equals closer to anemic status, which is well known that impairs performance for the above mentioned reasons.