Hello!
Sorry I made my initial post so unclear. For future reference, I cruised at over 5 knots with 2500RPM (Yanmar 1GM10) going into 1 foot swells with no wind.
While that speed is good for that boat, I'm not sure that the fact that you are making it at 2500 rpm is necessarily a good thing. That is, it's
possible you are over propped.
Rather than asking how fast your propulsion system can push the boat, I think you need to ask whether it is working as designed. Once you know that, then your speed under various conditions is going to be what it is, and you'll come to know what it is specifically as you actually take out the boat in those situations.
You have a 1GM10 vs. a straight 1GM (such as I have), which does give you a couple of extra HP. But nevertheless, your boat is certainly under powered for its 6000# displacement. If you are actually getting over 5 kts. in no wind AND NO FAVORABLE CURRENT, then that is probably as good as it gets for that boat speed-wise. But you do want the engine operating in its favored RPM range. Top RPM for that engine is 3600. If you can get within a few hundred RPM of that IN GEAR and under way (not tied to the dock) then I would say you are not over propped. But if that 2500 is the most you can get running it flat out, then your prop is either too big and/or has too much pitch and should be replaced or re-pitched. And this is irrespective of what speeds you are seeing.
Cruising RPM for your engine is more like 2850-2900. It is rated to run continuously at 3400 if you needed to, but it should be very happy running it at ~2900, give or take for day to day use. Note that the Yanmar tach is inaccurate, so you should buy (or borrow)
a cheap optical tach so you can make a deviation table of how far off your tach is at any given RPM setting. (The error is not linear.)
Having the correct prop is very important to get the most out of any engine, and can affect not only the speeds you see but also the life of the engine itself.