"I didn't want to be known as Madonna's playboy, her boy toy."