"You know, I have found out in the course of a long public life that the things I did not say never hurt me."