Just previous to the fall of Vicksburg, a self-constituted committee, solicitous for the morale of our armies, took it upon themselves to visit the President and urge the removal of General Grant.