In my experience this is almost impossible to do, since even when it appears successful, the sweater returns to its original size shortly thereafter. I think the best approach might be to undo the seams, if there are any, and resew them several stitches in. You can then trim the extra bulk from the seam, since the sewing will prevent the stitches from unraveling.