"I was a sort of son to Ike, and it was the other way round with Kennedy."