"I thought I had swell ideas, and wonderful musicians, but the hell of it, no one else did."