One story Sister Adams tells will illustrate his noble generosity: While he was acting as mayor of the city, a colored man called Anthony was arrested for selling liquor on Sunday, contrary to law. He pleaded that the reason he had done so was that he might raise the money to purchase the freedom of a dear child held as a slave in a Southern State. He had been able to purchase the liberty of himself and wife and now wished to bring his little child to their new home. Joseph said,

"I am sorry, Anthony, but the law must be observed, and we will have to impose a fine."

The next day Brother Joseph presented Anthony with a fine horse, directing him to sell it, and use the money obtained for the purchase of the child.