In the first few presidential elections, only white, male landowners could vote. Less than 5% of the U.S. population voted.