Send him a bill for xxx hours of housework/chores (time it took to make the sweater) and xxx dollars the cost of the yarn. You’ll never collect, but it might dawn on him why you are upset and why joking about it is NOT funny.
We have a rule in our house, he can do his laundry and any household items, but he is not “allowed” to wash my clothes without checking with me first. Early in our relationship, I realized all his clothes were mid range brown, green, blue or grey. All his clothes could be washed together without incident. He had never had to deal with bright colors or bright whites until he had my clothes to deal with. He still checks, and only rarely do I need to rescue anything.