A few of Andrew Barnum's descendants mentioned that his brother Henry had received a head injury when young, and that he was mentally challenged or perhaps blind as a result. It may be assumed that Andrew had the care of Henry because Henry was living with the family of Andrew in the 1871 census of Stanhope Township, in what was then called Peterborough (now Haliburton) County. There is also a Henry Barnum buried in the same plot as Andrew at Saint Peter's Anglican Church Cemetery. Henry never married.