Explanation

"Rarely" means not often, which fits the contrast given by "but" in the sentence.

The sentence implies that despite being wealthy, he does not frequently help the poor.