Late anonymous biography of Sarah Kingsley Cleveland indicates her husband was a non-Mormon.
Sarah M. Cleveland, Biography, 1911, 2, MS CR 11 256, Church History Library
When the Saints were driven from Nauvoo Mr. Cleveland made arrangements to come west with her daughter, and somehow leaving her husband and son, as Mrs. Cleveland would follow the Mormons no farther, Brigham Young and council learning of this came to her and counciled her to stay with her Husband as he was a good man, having shown himself kind ever helping those in need, therefore <although for> some reason his mind was darkened as to the gospel.