"There's a lot of Americans, black and white, who think that we've arrived where we need to be and nothing else needs to be done and affirmative action needs to be dismantled."