"It really comes down to the fact that, because I was perceived as a bad guy for leaving the show, I think people were rooting against the movies. That was really unfortunate."