Keep the check valve
I have been using a check valve for years because of the back flow issue. If you keep your bilge clean, you should not have a problem.
There can, however, be a problem with air-lock so that the pump runs but will not pump water out of the bilge, You could drill a small hole in the outflow tube before the check valve, but I have a better solution. Keep the hose very short between the pump and the check valve. That has solved my problem and eliminated the air lock.
I have been using a check valve for years because of the back flow issue. If you keep your bilge clean, you should not have a problem.
There can, however, be a problem with air-lock so that the pump runs but will not pump water out of the bilge, You could drill a small hole in the outflow tube before the check valve, but I have a better solution. Keep the hose very short between the pump and the check valve. That has solved my problem and eliminated the air lock.