Lydia Clemmons, Charlotte, Vermont