Horatio Phillips Van Cleve was a lieutenant in Wisconsin, but quit the military when he married his wife Charlotte. He joined the army again at the start of the Civil War, becoming colonel of the Second Minnesota Volunteer Infantry Regiment. His regiment saw brutal fighting in the campaign for Chattanooga with the battles of Chickamauga and Missionary Ridge. The regiment also took part in General Sherman's March to the Sea.