Go to the hardware store
Oxalic acid will remove rust stains, just rinse well when your done. You can get this at hardware stores and most big name home stores. You can find it in the deck cleaning products. Don't buy the bleach type, read and look for oxalic acid as the main ingredient. It is a very mild acid by the way, much kinder that HCL or bowl cleaner.Steve P.