"I think the Prime Minister has embarked on a journey and he has no idea where he's taking us."