Take it off and have a look-see. The rivets will drill out with a 3/16" bit. As JS said, you want the area to be smooth.
I would not weld it. The mast is very thin and the result will almost certainly be weaker.
A reinforcing plate is a possibility, though probably not needed. Perhaps all you need to do is move the exit plate up, or better, find a longer exit plate.