Chapter and verse on the rules is getting carried away here.
As most windsurfers will realize, stand-on & give-way doesn't really have that much meaning in most encounters between power driven boats and a windsurfer. The last thing a windsurfer (most sane ones anyway

) wants to do is fall into the water right in front of a power driven boat, even if the boat is going slow.
What is becoming clear is that you encountered a learner on a long board who wasn't going at a planing speed. An experienced windsurfer on a short board, fully powered-up in a strong wind is very fast and highly maneuverable and would have no problem doing circles around a slow moving sailboat under power. But this doesn't appear to be the case.
It sounds like you encountered a guy who may have been struggling just to keep his balance on the board. If he is sailing along slowly, in conditions where the wave action may have been confused (breakwater behind him, boats crossing in front of him), he may have been sailing in the only direction where he felt comfortable standing on his board. In light wind he can't make his way upwind very easily and besides he doesn't want to cross in front of you because there is a significant risk that he can fall off at just the wrong time. He can't turn downwind very easily because he loses power in the sail and the board becomes even less stable. And it is difficult to stop and just bob in the water while trying to maintain balance (but that wouldn't be the worst thing because he could just climb back on and uphaul and sail away once you were clear). He probably intended to maintain a collision course until the very last instant and then turn momentarily downwind to clear your stern. He may have even been uncertain about what he wanted to do earlier in the encounter -but his reaction (by sarcastically saying 'thanks') seems to indicate that his intention was to turn downwind at the last instant to clear your stern and you made it more difficult by slowing down).
I know from experience that when on a windsurfer, you can get comfortable with making the maneuver to clear close by the stern. It is just about timing, and it makes no difference if you clear the stern of a sailboat by 10' or 100' as long as the sailboat just keeps moving in the same direction at the same speed.
What most don't realize, though, is that there are circumstances when a windsurfer is underpowered (or just learing) when the only point of sail that is comfortable is essentially a close or beam reach ... bearing off downwind can be very tricky, due to loss of power and the board becomes far less stable so the windsurfer probably just didn't want to change his course until he had to because bearing off downwind early-on may have been unstable for him. Regardless of him technically being a sailing craft and having stand-on status, I am sure that he didn't want to pass your bow because of the chance that he could fall right in front of you. In that circumstance, he has to rely on you paying attention enough not to run him over, even if you are going slow.
A windsurfer isn't something that you just turn the ignition and point the board in a direction. It actually has a surprisingly steep learning curve, and it requires a well-developed sense of balance, agility and strength applied in the most efficient way. Many (or even most) people who even try to learn give up in frustration because of the degree of difficulty. Expecting a learner to react strictly in regard to the rules of navigation is asking too much in some circumstances - more from an athletic standpoint than a knowledge standpoint. Some leeway has to be expected.