He married Mary Theresa Caffrey in 1847 and they moved to Boston after the Irish rebellion of 1848. Their first child, Dorcas, died at the age of three, and another baby, Rose, died of scarlet fever.