"If I felt we had alienated the Unionists, it would worry me because we've spent a great deal of time trying to open up discussion and dialogue with the Unionist Parties."