This is a 1903 map of the current location of the Department of State, on C St. between 21st and 23rd. Obviously, it was very different back then, with New York Ave. running through where the building stands today.
Source: Library of Congress
Two things really jump out at me when checking this out. One is the dog pound that’s located at 23rd and C St. The other is the Herdic-Phaeton building at 19th and E St. Doing some quick Wikipedia research, I learned that this was a local stagecoach company that ran transportation around the city, and two of their stops still stand today on the east side of the Capitol.