It's called "prop walk"
when it goes in a certain direction in reverse. Do a search on this forum and read all about it.
Most boats back slower because of the way the prop is made, and most people try to go too slow in reverse -unless you're moving, the rudder will provide no directional assistance because water is not flowing over it.
You do NOT have an unusual condition.