If your 5411 is set up like mine, & presumably all of the 5411's then you have a toggle switch which you must hold down manually when you engage the glow plugs. So really you shouldn't be able to run the glow plugs & turn over the engine at the same time. That's why the switch is manually held down, so that the glow plugs are not left on, where they would eventually burn up from overheating.
First off, if your engine is slow to turn over after engaging the glow plugs, you have a weak battery, that is being insufficiently re-charged when the boat is sitting idle, or the battery is old & weak & needs to be replaced. 9 times out of 10 when a battery gets to the stage where it is so weak that it won't crank the engine, then it is likely 4 or more years old & is worn out. Replacing the starting battery is the easiest way to find out if that's the starting problem. Diesel engines, even as small as the 5411 have stronger compression requirements & need more torque from the starter & battery to turn over.
But if you are cranking the engine & it won't start, my second guess is that you have one or more bad glow plugs. They are pretty cheap to replace, & they do wear out over time. The only time my 5411 has ever failed to start in 3 years is when I forgot to heat up the glow plugs for 30 seconds before attempting to start. It was in summer time, & that engine would have cranked all day without starting. After engaging the glow plugs for 30 seconds she fired up immediately. Actually I am now religious about counting out 30 long one thousand counts for the glow plugs, & my 5411 always starts IMMEDIATELY, without ANY hesitation whatsoever. As a matter of fact, I've had 5 sailboats, & no engine has ever started faster, or run more reliably then the 5411 for me. So get a new battery, & if she still doesn't start easily, replace your glow plugs.
If you still have issues, then move on to a clogged fuel filter or blocked fuel pickup line inside your fuel tank. All a diesel engine needs is clean fuel, no air leaks in the injection system, good compression & they will always start. Good luck.