I am on the West coast but the wife and I became familiarized by chartering. That would be the prudent first step. There are many ways to charter but the easiest is a skippered day charter with a local company. Power and sail in a variety of sizes is available at most major port facilities. Take a day trip with each and see what interests you more.
After that there are any number of schools that can train you in the safe operation of your chosen style. Many on this site grew up in the boating lifestyle but some of us coming at it a little later in life find these classes shorten up the learning curve quite a bit.
Searching this site you'll find a wealth of knowledge on many topics that may help guide you but there is no substitute for getting out on the water and seeing if it suits you.
Craig - AKA Some Clueless Idiot
The person who is saying something is impossible should not interrupt the person who is doing it.