"When we have to change an opinion about any one, we charge heavily to his account the inconvenience he thereby causes us."