Portsmouth’s downtown is lined with brick, Federal-style buildings, many of them built after a disastrous fire in the early 1800s.