In his inaugural speech, President Lincoln is primarily addressing American citizens, the people who make up the Union.
He specifically speaks to Southerners who have seceded from the Union and people in states that are planning to secede.
He may also be addressing the international community, particularly the country's allies, to reassure them.
