Since you had Raleigh, NC as an option I figured I'd throw out two option with culture and much more IMO to do.
In NC - New Bern, NC. On the Pimlico Sound, a smaller Charleston but with a lot of history and good food and people. Also pretty central to other coastal destinations.
Further...