I did take the side trip to the ATC HQ but that was only about a mile extra.
I didn go off into Harpers Ferry, ATC was the only distraction from the trail. This stretch of the AT is very rocky so wear boots with good support and traction.