Bail attachment
Usually bails are attached, at least on booms, with through bolts. The weakness of this is that the bearing area for strength is only the thin wall of the boom extrusion on a relatively skinny bolt. What many of us have done is drill an over sized hole, thus increasing the area and circumference of the hole and used bushings that are the width of the boom plus a tad for the thru bolts to rest inside. The bushings are simply tube steel or aluminum, the inner diameter big enough for the thru bolts and the holes in the bail ends, and the outer dimenion is the size of the oversize hole you drill in the extrusion.
Your application is a bit different in that it appears you are working at the base of your mast, thus maybe not wanting to do thru bolts. It's unclear from the picture as to what the "inner sleeve" is, but I assume, thus requiring your confirmation, that it's an added thickness of material inside the mast at that level. Since you've already tapped the hole in the sleeve, how'd you do that without tapping the mast, too? If you can tap them both, then that'll be better because you'll have more area that threads are engaged, thus more strength.
You could also consider the thru bolts with bushings. That would work at the bottom of a deck stepped mast with no halyards running through.