Whitestone Hill State Historic Site, located 23 miles southeast of Kulm, Dickey County, marks the scene of the fiercest clash between Indians and white soldiers in North Dakota. On September 3, 1863, General Alfred Sully's troops attacked a tipi camp of Yanktonai, some Dakota, Hunkpapa Lakota, and Blackfeet (Sihasapa Lakota), as part of a military mission to punish participants of the Dakota Conflict of 1862. In the ensuing battle, many Indian men, women, and children died or were captured. Military casualties were comparatively light. The Indians also suffered the destruction of virtually all of their property, leaving them nearly destitute for the coming winter.

Today, Whitestone Hill State Historic Site includes a portion of the battlefield and a small museum with exhibits explaining the 1863 Sibley and Sully expeditions and the Battle of Whitestone Hill (the museum burned November 2009 and is currently being renovated). There are two monuments, one honoring the Indian dead and a second commemorating the soldier who died in the battle. A marker also recognizes two early settlers, Tom and Mary Shimmin. A fieldstone shelter beside the trail provides a resting point overlooking part of the battlefield and a freshwater lake. Nearby is a picnic area with a shelter, table, pit toilets, and a parking lot. The site is open May 16 through September 15, Thursday through Monday. Admission is free, and donations are accepted.