I would always leave the rudder on, except when launching or recovery by trailer. I think it is a good safety to have the rudder in-place, what if the motor quits? With the rudder in you have more options to maneuver the boat, rudder sculling to turn the boat, raising a sail and so on.