How does Dickens present Scrooge as an outsider to society?

In Charles Dicken's A Christmas Carol, Ebenezer Scrooge is presented as a miserly old man, who is social outcast and is quite happy to be one! At least in the beginning.
His only concern is the amount of money he can make for himself. Scrooge obviously has a reputation, and nobody wants to be around him. He is cold and greedy, not the kind of man people want to befriend.