"We were on the cover of Women's Wear Daily, which was hardly rock 'n' roll, but it pleased me."