Unfortunately, yes
Swing keels and centerboards can move around under sail. This seems to be a common problem with these boats as they age: wear and tear loosens up the formerly tight-fitting pins, blocks and other parts, resulting in the fin banging around in its trunk. If your board bangs around every time you tack or shoulder into a swell, it would be worth it to haul your boat and have the yard block the hull high enough so that you can drop the board and see just what the issue is. You may need to replace the pivot pin or the blocks that hold it up. I am unfamiliar with the Oday 28 set up, but if you look in the archives of this site, you will find many articles describing your fellow sailors' efforts at disassembling and fixing their Oday centerboards.