Over 4 million Irish lived in Ireland during the Potato Famine, but only 1 million Irish fled to America to escape the famine. The Potato Famine devastated Ireland's population, though most Irish stayed in their home country despite the hardships rather than emigrating.