If you have stuck water shut off valve, you should turn off the water at the main valve. Then use a wrench to unscrew the old one and put in a new one. If you’re using a plunger and it still won’t budge, it might be time to call in a plumber. If you don’t have one on hand, try calling your local hardware store for help.