"I cut myself off from the mainstream of jazz. It stood me in good stead later on, as a musician."