The song is not about “rich men” in general but about politicians in Washington DC. Those are, specifically, the “rich men north of Richmond” he is discussing.
His claim is not that business owners pay too little, but that the government is taking too much, and giving it to welfare queens.
You may want to consider reading the actual lyrics.