In 1861, Grafton was primarily Unionist. But it was part of Virginia, which had seceded. Here Confederate troops tried to keep the Union from controlling the rail lines.

At this site on May 22, 1861, Union Private Thornbury Bailey Brown was shot by a Confederate. This was the first Civil War killing of a soldier by an enemy soldier.