It all depends on the sailing conditions you see routinely, and your skill and level of comfort. If you will be seeing winds in excess of 20 knots on a routine basis, you might want to consider a bigger, heavier boat. Remember, this boat was designed as a trailer sailer and the gear is not sized to handle real ocean sailing, especially on a routine basis. I've seen the trades kick up over 25 knots in the Carribean, and while some might be comfortable on an Oday 23 in those conditions, I'm not one of them. Don't get me wrong: I love my boat and its great for the conditions I see on Long Island Sound. And I could see sailing around the islands in protected and semi-protected waters in safety and (relative) comfort. But not between islands if you will be exposed to open ocean winds and conditions.
Some of this is subjective (how much stability you need to "feel" safe or comfortable), but some of it is based on the strength of the fittings and hull scantlings. The Oday 23 was built as a modestly-priced trailer/camper sailer. It was not designed or built to handle six foot seas and thirty knot winds. That's not an opinion, it's fact. And while I doubt a well-maintained Oday 23 would break apart in those conditions, it would be a very rough ride indeed.
So if you will be day sailing with the occasional overnighter in protected or semi-protected waters, I think the Oday 23 is a great choice. Once you leave that realm, I would start looking at bigger and more robust choices.