"We have to be careful that in throwing out the devil, we don't throw out the best part of ourselves."