A memoir isn't considered a historical document because, its not the larger piece of the story, but instead a piece of it. It's like the "I remember" part of it. The writer of the memoir takes it back to a corner of the story instead of the whole thing.