Is your boat a swing keel C 25 or a fixed keel? I am assuming it is a fixed keel.
If it is a fixed keel, then the problem is wet rot in the keel stub, where plywood has rotted out between the keel bolts & the bilge fiberglass pan. You will have to cut out the fiberglass pan liner, all rotted plywood & fill with either more marine plywood, or what ever none rotting filler material you desire such as Starbrite, Coretex, fiberglass matt & roving with Epoxy, etc. You have to build up enough layers to fill the void where the plywood is removed, approximately 1.5"to 2" thick.
I must admit, I have never heard of the compression post pushing upwards, unless badly grounded at the keel. Usually the compression post sags from rot at the mast step or base of the keel where core rot occurs. I used to own a swing keel C 25 that had its own structural issues with a cracked keel trunk when I bought her. But keel problems can always be fixed, & afterwards the boat will be good for years to come. God luck on your repairs, & talk to a good marine service yard with experience on keel stub repairs.