In May 1863, Union forces attacked Vicksburg, Mississippi in a siege that lasted for six weeks. The Fourth Minnesota was among the Union regiments to force the surrender of Confederate soldiers. On July 4, 1863, the Minnesotans led the Union army into the surrendered city of Vicksburg.

Painter Francis David Millet captured this victorious moment in "Fourth Minnesota Regiment Entering Vicksburg," created between 1905-1915. The painting is one of six Civil War murals hanging in the Governor's Reception Room at the Minnesota State Capitol. Discussions about Capitol art in fall 2016 led the Minnesota Historical Society to decide to keep the Civil War paintings in place. Millet also painted "Treaty of Traverse des Sioux," which will be relocated but remain in the Capitol. Millet died on the Titanic in April 1912.