Charles Spencer made a series of damning claims about the King in a new memoir