That takes in a lot of places! A few to get you started...
You skipped Block Island, great destination, we prefer Great salt Pond, you anchor in there but the holding can be sketchy, plenty of moorings.
Up on the mainland, we really liked the anchorage off Naptree Beach, great beach. Or you can try to get a mooring nearby in Watch Hill Harbor, Watch Hill is a fun place. For us it was easier to scoot over there in the Whaler.
Of course then further east, you have Narragansett Bay and the Sakonnet River, dozens of moorings and a few fun anchorages. What type of setting are you looking for? Something for everyone in there.
We were based in Westport Harbor MA on a mooring during the summers, living aboard full time. Loved it. A good restaurant there called the Back Eddy, a little pricey. Easy dinghy access to the far, less busy side of lovely Horseneck beach with a nice beach on the riverside, plus a popular sandbar in the harbor. Fuel, water and services at Tripp's marina and boat yard, who administer the moorings, provide the launch and dinghy dock. Town pump out boat too. We had cars there, so getting up into the town proper was easy, a great and expensive supermarket there called Lees, a few good restaurants, a good fish and lobster store, other services. You can usually get a ride from someone at Tripps.
Jumping back south to the islands, set of Cuttyhunk on the Vineyard Sound side is Tarpaulin Cove anchorage, very pretty and undeveloped. Further east is the popular Hadley Harbor anchorage; pretty and and protected, gets crowded.
On the mainland again, east of Westport is Padanarum aka South Dartmouth, moorings, a charming town and services. A very nice stop if you require more services close at hand than Westport offers. Lovely.
Have you been into all the harbors on the Vineyard? I really liked Memensha, and we anchored off once off the beach under nice conditions, limited moorings and dock in the harbor but really lovely if you can get in there.
So there are just a few top of mind ideas.
"There's the Right Way, the Wrong Way, and what some guy says he's gotten away with"