Pull the wire off of the oil pressure switch with the engine off. If the alarm stops unscrew the OP switch, take it to a convenient auto parts store, and get a new one. The reason for taking it with you is to make sure you get the correct size, threads, and taper.
If the alarm doesn't stop you have a ground short in the wiring or buzzer circuit.