There are more Americans every year, but the population is growing at a moderate pace