"Authority is something from which we are constantly subtracting, of which there remains always a residue, and which we attempt to make smaller and smaller."