The difference is that the founding fathers claimed that freedom is a right for all men and the old south didn't take slaves to be people. For the southerners, every slave was only 3/5ths of a man, so they weren't people and therefore they couldn't have their freedom and the constitution did not apply to them. That is why slavery lasted as long as it did, because people fought abolishing slavery.